Comments (3)
Currently the model
config option applies to all LLM calls. All agents should have their own model
, as well as other config options. I'll open a PR implementing the refactor soon.
from autopr.
Sorry for the long pause, I've implemented a refactor that allows agents to have their own config options, but haven't yet implemented picking different models for different actions. This will come with a refactor into an "action choice engine".
I did some testing, and I experienced a pretty bad performance drop with gpt-3.5-turbo
, even for parsing steps. Although, earlier this week we changed how we were specifying instructions in guardrails, and it seems to greatly improve gpt-3.5-turbo
performance; I'll try again to see if we can offload parsing steps to it.
from autopr.
yeah forget gpt-3.5-turbo. I think it's just too unreliable for code generation. may as well focus on using whatever tools are most likely to work rather than wrestling with 3.5
from autopr.
Related Issues (20)
- Error fixing "Translate id method to python" HOT 1
- ValueError: Error looking at files HOT 13
- Iterate with code review comments
- How to know if OpenAI key is valid? HOT 2
- Restricting code changes to the current commit
- OpenAI error HOT 1
- ValueError: Cannot end root section; openai.error.InvalidRequestError: The model `gpt-4` does not exist or you do not have access to it. HOT 4
- Branch hard-coded to `main` - should use config branch HOT 1
- Empty commit with [placeholder] title HOT 5
- [AutoPR] TODO make these configurable
- [AutoPR] TODO this depends on the filename of the event jso ...
- [AutoPR] FIXME does nice syntax highlighting for tracebacks ...
- [AutoPR] TODO subtract length of rest of prompt
- [AutoPR] TODO implement this so that we can pass variables ...
- [AutoPR] TODO we should consolidate these forward refs with ...
- [AutoPR] TODO migrate to pydantic 2.0, and use a nested sel ...
- [AutoPR] TODO use jsonpath_ng instead
- [AutoPR] TODO if it's a template, enforce dict structure on ...
- [AutoPR] TODO split out multiple triggered workflows into s ...
- Error fixing "Error in test_select" HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from autopr.