ooici / coi-services Goto Github PK

link:
#2120
and
https://github.com/ooici/coi-services/pull/2120/files#diff-6d42d79e053b93262f550ef0fc0a7bf4R64

From Michael:
Place a general try-except Exception block around the main threads. These are long running and you cannot afford to lose them to some random exception

Ingestion workers lack the capability to handle large amounts of message congestion. As of this bug report, the ingestion workers can only consume on average load 2 msgs per second. Several components to consider assisting in congestion reduction are:

• buffering messages at the instrument agent to reduce network traffic, also increasing message content (optimize bandwidth utility)
• add multiple ingestion workers
• reduce overhead of HDF I/O operations.