Handling Closed Connections about lanarky HOT 8 CLOSED

Hey @awtkns! Really glad to see this library being used in a bigger project.

I don't have a solution right now but I will start investigating. I believe this is a critical feature for all users.

P.S. I'll look into github sponsors as well 😄

from lanarky.

@awtkns i've published a new version with a possible fix:

pip install "lanarky[openai]"

let me know if the error rate reduces. I will keep this issue open until then.

from lanarky.

Unfortunately the error rate has not seem to go down. 😢

This is how we are receiving the stream in the front end. We are using fetch here instead of eventsources as the streaming response didn't seem to work with JS eventsource.

from lanarky.

I can confirm it looks like connection are being closed properly now! Thanks for your help!

from lanarky.

Unfortunately after upgrading to 0.7.5 the issue still persists. I did not install with lanarky[openai] as we already had the openai dependancy. Could that be the issue?

@ajndkr thanks for all your help :)

from lanarky.

I don’t think missing dependencies is an issue here. Manually setting the session object and then closing it at the end should have worked.

I’ll keep investigating for a better solution. In the meantime, it’ll be good to know if the error rate has atleast decreased with the new version, if not resolved completely.

from lanarky.

Thanks for the update! It appears we are dealing with nested awaitable functions which are unaffected when the session is closed.

I hope to find a solution soon 🤞

from lanarky.

@awtkns published a new version: pip install lanarky==0.7.6

I haven't been able to reproduce the "unclosed connection" error locally with the latest changes. So I'm really hoping we've arrived at a solution.

from lanarky.