Groq API Support? about ai HOT 6 CLOSED

https://github.com/vercel/ai/blob/main/examples/next-groq/app/api/chat/route.ts

from ai.

+1. The groq example within the examples folder doesn't work and uses non-existing imports from 'openai'

from ai.

it must be a dedicated provider. it will be great so we can use it along langchain or similar.

A proper docs is also needed.

from ai.

@surjithctly why is

const groq = createOpenAI({
  apiKey: process.env.GROQ_API_KEY ?? '',
  baseURL: 'https://api.groq.com/openai/v1',
});

not sufficient for you?

I'm going to close this unless someone can provide strong reasoning for Groq to have their own provider

from ai.

why is ... not sufficient for you?

I'm always in favor of avoiding duplicate code and avoiding repetition, but I care even more about type safety and there are a few differences that might warrant more consideration. Groq has some limitations with a few options, and minor differences with expected behavior in one or two places, that seems like enough of a justification to at least have some helper methods or types for groq.

See:

• https://console.groq.com/docs/tool-use#known-limitations
• https://console.groq.com/docs/openai
• https://console.groq.com/docs/text-chat#json-mode-object-object (look for "known limitations")

fwiw I totally get your perspective and won't lose too much sleep if you don't want to do this, but it'd be awesome if you did.

from ai.

@MaxLeiter A dedicated docs will be a good first step because, I have never found this option in the docs in the first place. We usually look the providers page since everything else is there, so its easy to think "oh! its not supported yet".

Also, I can see the entire docs is now changed and now I can see custom provider option, but still that doesn't explain I can use OpenAI with other providers. Even inside the /openai page, it's not mentioned.

from ai.