Comments (2)
Currently, in order to use a model in local container (or any other model online), you'd have to overwrite the functions here:
https://github.com/a16z-infra/ai-town/blob/main/convex/lib/openai.ts
These are the only LLM entrypoints in the repo, so customising them to use your API is enough.
Similarly with the vector DB, seems like all the relevant functions are here:
https://github.com/a16z-infra/ai-town/blob/main/convex/lib/pinecone.ts
So you can customise queryVectors
to query your database instead of pinecone and so on.
You change these two files and I think that's basically it. Now the question is, what can be done to generalise support for custom 3rd parties, so that it's easier and allows people to add integrations?
from ai-town.
Would folks be ok mapping from the OpenAI request type to a custom request, or change all the callsites to use a more generic interface? A few things I'm worried would be lost with the latter:
- separating context into distinct messages, vs. one big prompt
- streaming support
- providing functions (afaik an openai-specific feature)
Anyone have an API they want to propose? Just default LangChain stuff? I've been wary of pulling in LangChain, since I find things more understandable when there's fewer layers of indirection. Even the openai library is hard to find the actual input and output types. I wrote the openai.ts to not have any dependencies or imports, so it's portable and lightweight, but it's also not standardized like LangChain is
from ai-town.
Related Issues (20)
- do people want a 3d spatial computing town? HOT 1
- [feature request] windows .bat launcher
- "Interact" button doesn't work HOT 2
- Agents not having any conversations
- Backend won't start HOT 2
- Provide support for Groq
- Error fetching POST http://127.0.0.1:3210/api/push_config 500 Internal Server Error HOT 8
- Localhost refused to connect HOT 2
- Pop OS - Agents Not Having Conversations HOT 3
- Meet [Could not resolve "convex/values"] when running on Linux system
- Is there a way to connect to the simulator with my own custom agents?
- Getting an error when running npm run dev HOT 1
- no convex/config.ts? and no just? HOT 2
- Is there a way to change the dimensions of the map? HOT 1
- Convex Local Backend error and termination HOT 1
- Getting Pointer being free is not allocated error in convex-local-backend HOT 2
- Has anyone encountered Unexpected end of JSON input error HOT 1
- Convex Local Backend Errors HOT 1
- Unable to import FS HOT 1
- language setting HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ai-town.