A job for scheduling solver to resolve dependency graphs of new packages
You can run this job locally. The job will talk to OpenShift API to schedule jobs in Thoth's middletier namespace and will check for packages which were not analyzed yet by talking to a cluster Dgraph's instance:
$ pipenv install # Install all the requirements
$ oc login <cluster-url> # Make sure you are logged in
$ KUBERNETES_VERIFY_TLS=0 THOTH_INFRA_NAMESPACE=thoth-test-core GRAPH_SERVICE_HOST=graph.test.thoth-station.ninja GRAPH_TLS_PATH=./tls-test pipenv run python3 ./app.py
You need to obtain TLS certificates in order to talk to a cluster graph database and place them into ./tls-test directory as shown above.
The job is run periodically as OpenShift's CronJob. It can be also triggered automatically by Thoth's monitoring system when there is no workload happening in Thoth's middletier namespace.
Note
- graph-refresh job is run in Thoth's frontend namespace
- templates for solvers are picked from Thoth's infra namespace - see installed solvers endpoint on Management API for available solvers in the deployment
- solvers are scheduled in Thoth's middletier namespace
- workload operator makes sure solvers are run based on resources available in the middletier namespace
- graph sync scheduler makes sure results of solver runs get synced into Thoth's graph database (raw JSON files are stored on Ceph)
Packages which are not resolved yet might be coming from:
- user requests on advises for software stacks
- user requests for provenance checks
- container image scans
- explicitly registering Python packages to Thoth on Management API endpoint