OpenAI function calling returns invalid JSON when streaming about ai HOT 4 OPEN

I think the issue here is that you are trying to parse the accumulated text, but since the text is coming in as chunks, it is not a valid JSON object yet. So the error you are getting is expected.

You can view how the package parses a streamed response by checkout out this file: https://github.com/vercel/ai/blob/main/packages/core/shared/process-chat-stream.ts

from ai.

I think the issue here is that you are trying to parse the accumulated text, but since the text is coming in as chunks, it is not a valid JSON object yet. So the error you are getting is expected.

You can view how the package parses a streamed response by checkout out this file: https://github.com/vercel/ai/blob/main/packages/core/shared/process-chat-stream.ts

I don't think that's it. If I use a tool like Postman to hit the API (so it's not my code parsing it) I can see the JSON is invalid.

from ai.

I have the exact same issue but it's only happening on production when deploying on Vercel. 😨

I'm super confused and I don't know how I can debug that...

ai package is up to date.

Here is the invalid JSON it returns:

{"tool_calls":[ {"id": "call_Io6uRXyMRhniyd71oBvAXuG4", "type": "function", "function": {"name": "getWeather", "arguments": "{\n"city": "London"\n}"}}]}

from ai.

Give the fn-stream library a try. It includes a streaming, incremental JSON parser that returns nodes of the response.

from ai.