minikube testing about testing HOT 9 CLOSED

@jlewi can you link to the Argo workflows pls? I might be interested in taking care of this …

from testing.

Basic testing is done.
We should consider whether we want to run some of our other tests on minikube as well.

from testing.

Some thoughts on possible approaches.

• Investigate kube_test and see what it does
• Run minikube on a VM and run everything via ssh

This should map pretty well to our existing E2E tests. Our existing E2E tests are Argo workflows that just run series of scripts. So the only change we'd need to make is to execute those scripts via ssh on the remote VM rather than in the pod itself.

from testing.

Thanks.

Every repo should have a prow_config.yaml at the root. If you look at the contents you can find links to our Argo workflows.

This is our main workflow
https://github.com/kubeflow/kubeflow/blob/master/testing/workflows/components/workflows.libsonnet

from testing.

@mhausenblas Are you still thinking of taking this on?

from testing.

I did some initial experimentation this morning.

• I looked at kubetest but it didn't seem to offer any support for minikube.

• I setup minikube on a GCE VM using driver=None.

• I was able to connect to that minikube deployment from a pod running in an actual GKE cluster by

  • Copying the .kube directory to the pod from the VM
  • Copying the .minikube directory to the pod from the VM
  • Modifying .kube/config to change the paths of the .minikube files (certs)

• It looks like the K8s master is running on the GCE internal IP

• So E2E tests running on minikube should work nearly identical to our existing E2E tests on GKE. The only difference would be that we would need to deploy a K8s cluster via minikube.

from testing.

Thank you @jlewi and yes, I plan to work on it next week (on travel now) but if you want to have it earlier, feel free to start the work and I chime in when I'm back home?

from testing.

Sounds great. Let me see how far I can get this week.

from testing.

Note that you can also use nested virtualization and the kvm2 driver on gce for a more traditional minikube testing setup.

from testing.