Problems connecting to storage about ache HOT 5 CLOSED

Glad someone else is coming across this problem. I was able to fix this problem on my local machine by using proper model files provided by our data scientist Christine. Unfortunately, this did not work in the case of our deployed servers, which are still suffering from this problem, despite using the same model files that I used on my local machine.

I'll talk with Christine today and see what the status is of our ache debugging, and I may be able to tackle this problem freshly by creating new model files on our deployment server.

I'll let you know how it goes, since we are in the same boat :).

from ache.

I'm also trying to reproduce this error and understand what is going on. I'll let you know if I find something.

from ache.

So we managed to fix this on our deployment box by redeploying it on a new machine. We never managed to figure out why it was failing, and were never able to reproduce the bug. Wish I could help you guys out.

from ache.

What version are you running? Is it the version from branch master of this repository?

Here's what I found so far about this problem. The ACHE crawler has three main services: TargetStorage, LinkStorage and CrawlerManager. This exception happens when the TargetStorage tries to communicate with the LinkStorage, but the LinkStorage is not running.

When running the crawler using the command ache startCrawl, all services are started at the same time in different threads of the same process. Sometimes the TargetStorage tries to connect to LinkStorage, but the LinkStorage has not finished initializing yet, so this exception happens. As the TargetStorage tries to reconnect automatically, everything works fine when the LinkStorage is ready. In this case, this is not a real problem, but the logs are misleading.

When each service is started in a different process, if the LinkStorage dies the same problem will happen. You need to restart the LinkStorage process in this case.

I've been working on improving the logs and detect any problems that may cause the LinkStorage stops working. This changes will be pushed to this repository soon.

from ache.

Already fixed in commit 0c066bc

from ache.