Improve Satellite 6 Automation Pipeline about robottelo-ci HOT 8 CLOSED

We can close this once PR #393 is merged.

from robottelo-ci.

Also it will be very nice to have the automation use different nodes for different Tiers.
a) Tier1 and Tier2 for unit-tests/CRUD functionality testing/ All API tests in here on node Box1.

b) RHAI, Tier3 and Tier4 with functionality test cases , which requires isolated VLANs. Also none of the tests for this Tier should be using data-driven/subTests. some of the scenarios which fall under this are Compute Resource, Errata, OSCAP, End-To-End, Discovery/PXELess/IPXE, BootDisk, Provisioning and so on node Box2.

NOTE: Also no API tests should be running for this node as it creates dummy data ( non functional tests) and that should be part of node Box1.

from robottelo-ci.

API Creates dummy data in the sense,
a) Fake Capsule running with multiple fake Capsule features on a fake port, without the Capsule actually in existence. Any calls to remove the hosts or content-hosts associated with the capsule would result in http://pastebin.test.redhat.com/382121
b) Fake hosts/content-hosts, this needs to be avoided as it may complicate issues similar to a)

from robottelo-ci.

• Provisioning
• Snapshot
• Tier1
• Reset + Snapshot restore
• Tier2
• Reset + Snapshot restore
• Tier3
• Reset + Snapshot restore
• RHAI
• Reset + Snapshot restore
• Tier4

Currently we are having too much trouble to cleanup the entities that are left in the system between tiers, on a system with too many organizations some features does not works well (manifest import, dashboard etc.) so Reset + Snapshot restore would be great between tiers.

EDIT: This has been implemented in here,
a) #304
b) SatelliteQE/automation-tools#360
c) SatelliteQE/snap-guest#2
d) updated the PROVISIONING_CONFIG file in jenkins for target_image to be suffixed as "-base"
e) git clone https://github.com/SatelliteQE/snap-guest.git on basil and use the latest updated code.

from robottelo-ci.

Agreed, that is a good idea. But we have this bug here, https://bugzilla.redhat.com/show_bug.cgi?id=1321951

And from past experiences, unless we have a GA build, I keep seeing this satellite-installer --reset break most of the times.

Also we had to disable RESET now due to the above bug mentioned, #287 :(

from robottelo-ci.

@kbidarkar is snapshot taking an easy thing to do with libvirt? If that is the case than taking snapshot and restoring it looks promising.

from robottelo-ci.

It seems that this is already done. @kbidarkar can you close this issue if the current automation architecture covers what mentioned here please?

from robottelo-ci.

PR #393 is merged, so will be closing this, we can reopen this if required again.

from robottelo-ci.