Comments (6)
@danielchalef I can confirm that the bug fix works. Thanks a lot for your help!
from zep.
Hi there - I think there may be an issue with the Azure OpenAI implementation. You may want to try using LiteLLM as a proxy. Configure Zep to use the standard OpenAI integration and LiteLLM to use Azure OpenAI for LLM and embedding inference.
from zep.
@danielchalef Thanks for your reply. I took a look at the code at pkg/llms/llm_base.go
that is responsible for printing the error to the console. It looks to just check for the existence of cfg.LLM.AzureOpenAIModel.EmbeddingDeployment
which should correspond to the environment variable ZEP_LLM_AZURE_OPENAI_EMBEDDING_DEPLOYMENT
which I have set to the deployment name for the hosted ada embeddings model - but the console log persists and causes zep to fail.
I can try LiteLLM but it looks like either a bug in the zep code or I have misconfigured somehow? FWIW, zep has served us well and the only problems we have really had have been around environment config - a bit of clarity in the docs would go a long way. Really appreciate your hard work!
from zep.
@TheAdamGalloway I've committed an Azure OpenAI config fix. Would you please try the latest zep-cloud
container, version [0.26.0](https://github.com/orgs/getzep/packages/container/zep-cloud/233512546?tag=0.26.0)
and let me know if this works for you.
from zep.
Closing as dup of #296
from zep.
Great to hear!
from zep.
Related Issues (20)
- No google gemini support yet? HOT 3
- #314 Regarding this issue please see my comment on this one which you closed HOT 1
- [BUG] Zep Admin console leaks database password HOT 2
- Issue while adding ZEP Session HOT 1
- SDKs don't work OOB - assume v2 API HOT 3
- Support httpx 0.27.0 HOT 3
- [FEAT] Support concurrent updates for Zep users HOT 12
- [BUG] main page reports error 404 - Oops, something went wrong. Sorry, we couldn't find your page. HOT 1
- [QUESTION] Is the zep-nlp server required? HOT 2
- Using Zep as Document Storage? HOT 2
- [BUG] Can I use the postgresql that I already have without installing postgresql docker? HOT 2
- [FEAT] Unconventional Job Application HOT 1
- Update, delete and insert messages on Langchain SDK HOT 1
- [BUG] HOT 11
- [FEAT] LangGraph support via Zep checkpointer HOT 7
- [BUG] Cannot change config values when deployed to Render HOT 1
- level=fatal msg="store.type must be set" HOT 9
- [BUG] ZepClient not working
- Request takes a long time for sessions with large chat history HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from zep.