k8s-for-greeks / gpmr Goto Github PK

Greek Pet Monster Race - K8s and Cassandra at scale

License: Apache License 2.0

Makefile 0.62% Python 3.62% Batchfile 0.41% JavaScript 28.40% Shell 3.02% Java 32.55% HTML 15.78% CSS 12.83% Gherkin 0.01% Scala 2.76%

gpmr's People

Contributors

Stargazers

Watchers

Forkers

mward29 chrislovecnm slachiewicz yepengxj nkhine revandarth gopu84 dmiruke spenfraz

gpmr's Issues

Custom Cassandra Docker Image

python / cqlsh is not working on the 3.7 custom image. Need to include probably more python modules, not just python-min

build scripts for Dockers

What do we think about build scripts for the dockers?? Shell?
cc: @mward29

K8s Snitch and Provider

KubernetesSeedProvider java class
KubernetesSnitch java class

Please submit a PR to https://github.com/k8s-for-greeks/cassandra. The https://github.com/k8s-for-greeks/cassandra/tree/removed-10731-migration-task-wait branch should probably be merged into a main offshoot that we maintain.

Rack should be based on GCE Availzone, and DC should probably be ENV props. Thoughts? We could also do rack and DC off of node tags ... Your choice ... I like to do it off of k8s, so @mward29 can use it in aws :)

GCE K8s instances already have the az tagged so that is super easy to pick-up. You should be able to access the k8s api for the node tag. I cannot find the example for a po access its nodes api ... but it should be pretty easy :)

Custom K8s deployment

Need to cut a custom version of 1.3 for deployment to get pd-ssd supported.

branch off of 1.3
verify the following PRs are in the branch
- logging kubernetes/kubernetes#27409
- kubernetes/kubernetes#27542
Add custom code to provision pd-ssd
- Line number https://github.com/kubernetes/kubernetes/blob/master/pkg/cloudprovider/providers/gce/gce.go#L2213
- K8s issue kubernetes/kubernetes#23525

GCE Multiple K8s DC C* Deployment - Networking

@paralin please submit a PR for getting muitple DC's Racks on GCE.

Bash scripts for networking
VPN Docker
Documentation

Once you have submitted a PR, let me know and I can get you a baby k8s cluster.

Huge pages

So does it work in k8s?

https://tobert.github.io/tldr/cassandra-java-huge-pages.html

Cassandra basic docs?

Hey,

Could you potentially make a short readme on how to set up the cassandra petset? Just to get me up to speed? I'm reading through it right now and it seems to make sense except for:

$ kubectl create -f cassandra-petset-local.yaml
unable to decode "cassandra-petset-local.yaml": quantities must match the regular expression '^([+-]?[0-9.]+)([eEinumkKMGTP]*[-+]?[0-9]*)$'

Just a short doc with how you usually go about testing it would be nice. Nothing fancy or polished.

Thanks.

Docker build failed - what did I do wrong??

core@k8snode-01 /Users/clove/Workspace/src/github.com/k8s-for-greeks/gpmr/pet-race-devops/docker/py3numpy $ docker build .
Sending build context to Docker daemon  5.12 kB
Step 1 : FROM alpine:3.3
3.3: Pulling from library/alpine

d0ca440e8637: Pull complete
Digest: sha256:0403115a0e66f07a50190183baa210d894e3ec1ef5221cadfc95a81ee8c4f8c2
Status: Downloaded newer image for alpine:3.3
 ---> 13e1761bf172
Step 2 : ENV LANG C.UTF-8
 ---> Running in 14fd1770b682
 ---> 7d48ddbe4a33
Removing intermediate container 14fd1770b682
Step 3 : ENV GPG_KEY 97FC712E4C024BBEA48A61ED3A5CA953F73C700D
 ---> Running in 96a301d5c4d6
 ---> 5046e2254ed7
Removing intermediate container 96a301d5c4d6
Step 4 : ENV PYTHON_VERSION 3.5.1
 ---> Running in 84c4d933d328
 ---> ef01ff328f35
Removing intermediate container 84c4d933d328
Step 5 : ENV PYTHON_PIP_VERSION 8.1.2
 ---> Running in 88d918999ddf
 ---> cd5692591a86
Removing intermediate container 88d918999ddf
Step 6 : ADD repositories /etc/apk/repositories
lstat repositories: no such file or directory

Cassandra docker stop issues

Per @paralin -

Also we need to mint a new image for cassandra that uses dumb-init, the current one does not process the terminate signal properly, which means Cassandra will always wait the 30 second grace period and then be killed ungracefully.

Yaml examples for Petset

you bring your own disks
k8s creates disks for you
emptydir

@paralin can you share at all?

Docker improvements

kubernetes/kubernetes#27075

See that for C*

Alpine DNS issues

grrr... we may want to dump Alpine

Alpine Linux does not support the search keyword in resolv.conf. This breaks many tools that rely on DNS service discovery (e.g. Kubernetes, Tutum.co, Consul).

https://github.com/janeczku/docker-alpine-kubernetes

@mward29 thoughts?