Scalability Test: Can CNF increase and decrease capacity? about testsuite HOT 5 CLOSED

Acceptance Criteria for peer review:

Common steps

• Find or create a K8s cluster to use
  - [ ] Steps for creating will be in another ticket
  - [ ] Talk with team for access to an existing cluster
• Set the KUBECONFIG environment variable for accessing the target K8s cluster
• Pull down latest version of CNF conformance test code from develop branch
• Run shard install
• Find the names of the containers in the CNF's helm chart
• Create an environment variable called TARGET_CONTAINER with the list of container names

When using the test increase_decrease_capacity command the CNF should PASS the increase and decrease test successfully:

• Run crystal src/cnf-conformance.cr increase_decrease_capacity
• I expect to see the output and results from the increase test
• I expect to see the output and results from the decrease test
• I expect to see PASSED for the increase test
• I expect to see PASSED for the decrease test

The CNF should scale-up in capacity when the increase successfully

• Follow common steps above
• Run command

crystal src/cnf-conformance.cr increase_capacity

• There will be output on the screen showing the current replica set count (eg. 1 container) before the increase happens
  • eg. Test runs kubectl describe command
• Behind the scenes: The test Increase containers to "more than default"
• There will be output on the screen showing the new replicate set count (eg. 3 containers)
  • eg. Test runs kubectl describe command
• Behind the scenes: The test resets the containers to default (Eg. 1)
• There will be output showing if the test PASSED or FAILED
• I would expect the output to say PASSED'

The CNF should scale-down in capacity when the decrease successfully

• Follow common steps above
• Run command

crystal src/cnf-conformance.cr decrease_capacity

• Behind the scenes: The test Increase containers to "default that is more than 1 replica set"
• There will be output on the screen showing the current replica set count (eg. 3 container) before the decrease happens
  • eg. Test runs kubectl describe command
• Behind the scenes: The test decrease containers to "less than default"
• There will be output on the screen showing the new replicate set count (eg. 1 containers)
  • eg. Test runs kubectl describe command
• Behind the scenes: The test resets the containers to a default (Eg. 1 or 3)
• There will be output showing if the test PASSED or FAILED
• I would expect the output to say PASSED'

I would expect the CNF to pass the increase and decrease test when the scalability category runs

• Follow common steps above
• Run crystal src/cnf-conformance.cr scalability
• I expect to see the output and results from the increase and decrease grouped test
• I expect to see PASSED for the increase test
• I expect to see PASSED for the decrease test

I would expect the CNF to pass the increase and decrease test when I run the entire test suite (all)

• Follow common steps above
• Run crystal src/cnf-conformance.cr all
• I expect to see the output from the increase test
• I expect to see the output from the decrease test
• I expect to see PASSED for the increase test
• I expect to see PASSED for the decrease test

Steps after A/C fails

If all A/C fails for peer reviewer

• Add a comment to the PR summarizing the problem tagging the developer
• Attach any console output or logs that can help the developer fix the issue

Steps after A/C Passes

If all A/C passes for developer

• open a Pull Request to master branch and mark as "developer approved"
• Tag team members for peer review

If all A/C passes for peer reviewer

• Mark the PR as approved and merge the PR into master

from testsuite.

Initial task planning https://hackmd.io/Be2pyIA4Tue-HMT3KdfOPA

from testsuite.

Level of effort in pts: 0, 1, 2, 3, 5, 8, 13, 21, infinity: 8 pts

@wavell 8 pts
@williscool 13 pts
@lixuna 8 pts
@denverwilliams 8 pts
@taylor 8 pts
ashleigh 8 pts
@nupejosh 8 pts

from testsuite.

PoC #22

from testsuite.

@taylor went through A/C and all steps passed, closing issue

from testsuite.