d3sw / conductor Goto Github PK

In order to encourage reusability, we would like workflows and tasks to be named in a uniform manner. All workflows and tasks should follow the same casing so they're readable and names should also provide as much information about potential usage as possible without being too long.

Here are some example conventions:

• names should be less than 50 characters long
• task names should include the task type, i.e., http-xml-call-service, http-json-call-service
• workflow names should include basic categorization information
• all names should be lowercase (or TitleCase)

In order to facilitate microservice scaling, we need to update conductor-api to use service discovery to access the db. This allows us to run the db on dynamic host ports as well as to potentially scale the db horizontally without having to stop the api.

Conductor is currently configured to use v1r3n/dynomite as the data storage engine. Research which data stores are supported and then decide which will be the best to use on our platform. Once a data store has been chosen, open a new issue to set it up.

In order to facilitate microservice scaling, we need to update conductor-ui to use service discovery to access the api. This allows us to run the api on dynamic host ports as well as to potentially scale the api horizontally without having to stop the ui.

As soon as data is populated in ElasticSearch, enable (hourly) snapshots on the following EBS volumes in corp-test and corp-live:

conductor.search.test: vol-0424e61729a51bf10
conductor.search.test: vol-0b46950098fb1f2ba
conductor.search.test: vol-0ce0e364902753a8f

conductor.search.live: vol-01ed2e7bced985dc7
conductor.search.live: vol-067406e0deb8157c0
conductor.search.live: vol-0c7efd275247f29f7

Currently, conductor-server is running dynamite internally. In order for us to scale the api, we need to run a high-availability data store as the backend.

One of the first changes to conductor to allow it to run in as a cloud-native application was to modify the properties code to use environment variable as overrides for all configurable properties. The change needs to be document and submitted to Netflix.