[BUG] embeddings model needs to be provided when using Azure API about zep HOT 6 CLOSED

@danielchalef I can confirm that the bug fix works. Thanks a lot for your help!

from zep.

Hi there - I think there may be an issue with the Azure OpenAI implementation. You may want to try using LiteLLM as a proxy. Configure Zep to use the standard OpenAI integration and LiteLLM to use Azure OpenAI for LLM and embedding inference.

from zep.

@danielchalef Thanks for your reply. I took a look at the code at pkg/llms/llm_base.go that is responsible for printing the error to the console. It looks to just check for the existence of cfg.LLM.AzureOpenAIModel.EmbeddingDeployment which should correspond to the environment variable ZEP_LLM_AZURE_OPENAI_EMBEDDING_DEPLOYMENT which I have set to the deployment name for the hosted ada embeddings model - but the console log persists and causes zep to fail.

I can try LiteLLM but it looks like either a bug in the zep code or I have misconfigured somehow? FWIW, zep has served us well and the only problems we have really had have been around environment config - a bit of clarity in the docs would go a long way. Really appreciate your hard work!

from zep.

@TheAdamGalloway I've committed an Azure OpenAI config fix. Would you please try the latest zep-cloud container, version [0.26.0](https://github.com/orgs/getzep/packages/container/zep-cloud/233512546?tag=0.26.0) and let me know if this works for you.

from zep.

Closing as dup of #296

from zep.

Great to hear!

from zep.