Comments (5)
You have increased the temperature
setting, leading to more random output, and are using a model that's weaker for tool calls (gpt-4o
) in JSON mode. This is expected to happen, because the model might produce invalid JSON output in such a setting.
from ai.
I tried this example with gpt-3.5-turbo
and a temp of 0
, and still receiving AI_JSONParseError
. Even the example copy/pasted from https://sdk.vercel.ai/examples/next-app/basics/generating-object produces something similar.
Is this expected?
from ai.
Please try without mode
: json
(then it uses tool calling w/ the OpenAI provider, which is often more robust). For better tool calling results, check out the prompt engineering with tools tips.
from ai.
Thanks for the reply. No difference for me, even if I use generateText
, for example. The error message is odd, too:
cause: JSONParseError [AI_JSONParseError]: JSON parsing failed: Text: �webpack/lib/util/registerExternalSerializer�webpack-sources/RawSource�__webpack_require__.r(__webpack_exports__);
Clearly something is off given that it's parsing webpack 😅. All I'm trying is:
export async function GET(request: NextRequest) {
// imports...
const { text } = await generateText({
model: openai("gpt-3.5-turbo"),
prompt: "tell me a good joke.",
temperature: 0,
});
console.log({ text });
return new NextResponse();
}
I'm simply running this code within an API route. I must be doing something incorrectly. Just not sure what.
from ai.
Problem solved ✅
Solution: Changing the API route from a GET
to a POST
I'm guessing there were weird caching issues from marking the route as a GET
that goes away when switching to a POST
. Hope that this helps anyone that might stumble across this issue.
from ai.
Related Issues (20)
- Anthropic user content inside tool result HOT 9
- Bedrock Provider using profile HOT 11
- Provider registry doesn't work with model IDs that have a colon HOT 3
- [perplexity] streamObject fails HOT 7
- Feature parity for `useChat` SolidJS
- Please export the type for onFinish callback on streamText HOT 1
- AWS Bedrock Agent Provider HOT 1
- Add `isLoading` and `stop` functionality to `useObject` hook HOT 3
- If the request fails, the previous message is not restored HOT 3
- Support streaming tools in streamText, streamUI HOT 2
- Tool calling visibility HOT 2
- Incorrect `args` format in `tool-call` messages when calling functions with no parameters HOT 5
- Azure Provider: add api version parameter HOT 2
- `streamObject` with `@ai-sdk/anthropic` only provides a full object once finished via `.toTextStreamResponse()` HOT 5
- Tool calls stopped working when switching from gpt-4o to anthropic claude-sonnet HOT 6
- useObject hook's isLoading and stop functionality not working as expected during streaming HOT 2
- useObject hook's isLoading remains true after stopping the stream HOT 2
- UI Update Failure in Production with AI SDK 3.2.14 on Vercel Edge Runtime HOT 6
- Allow showing a spinner while client-side tools are running
- Responses not adhering to Zod schema with OpenAI models HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ai.