Support to Custom Chains about lanarky HOT 3 CLOSED

glad you like the new feature!

We really need a docs page for this project 😅

I see 2 approaches here:

Approach 1:

You define a new callback handler called AsyncConversationalRetrievalWithSourcesChainStreamingCallback and register it as follows:

@register_streaming_callback("ConversationalRetrievalWithSourcesChain")
class AsyncConversationalRetrievalWithSourcesChainStreamingCallback(
    AsyncConversationalRetrievalChainStreamingCallback
):
    """AsyncStreamingResponseCallback handler for ConversationalRetrievalWithSourcesChain."""

    pass

Approach 2:

We update fastapi_async_langchain to auto-detect using chain class name (as we do now) but if the chain type is not supported, we search for the inherit chain class name. This could work for your use-case but I sense there might be bugs down this road as some custom chains will simply inherit from Chain and it might break the application.

I think approach 1 is a better solution. Try it out and let me know how it goes!

from lanarky.

@rogalvil fyi: https://lanarky.readthedocs.io/en/latest/advanced/custom_callbacks.html

feel free to make suggestions via pr.

from lanarky.

@ajndkr Cool, thanks

from lanarky.