feature request: I tried to replace ollama with lm studio, but llm failed to response

[uptonking]

• it seems easy to replace ollama with lm studio by updating src/app/api/generate/route.ts like below

import { createOpenAICompatible } from '@ai-sdk/openai-compatible';

  } else if (process.env.USE_OLLAMA === "true") {
    // const ollama = createOllama({
    //   baseURL: process.env.OLLAMA_API_URL || "http://localhost:11434/api",
    // });
    const ollama = createOpenAICompatible({
      name: 'lmstudio',
      baseURL: process.env.OLLAMA_API_URL || 'http://localhost:1234/v1',
      supportsStructuredOutputs: true,
    });

    model = ollama(process.env.MODEL_NAME || "gpt-oss:120b-cloud");

  }

• but no response from llm. I cannot figure it out 🤔
• Could you please add support for lm studio?

[delfireinoso]

This project is in Alpha mode. External APIS and services will be incporporated

[ItzCrazyKns]

• it seems easy to replace ollama with lm studio by updating src/app/api/generate/route.ts like below

import { createOpenAICompatible } from '@ai-sdk/openai-compatible';

} else if (process.env.USE_OLLAMA === "true") {
// const ollama = createOllama({
// baseURL: process.env.OLLAMA_API_URL || "http://localhost:11434/api",
// });
const ollama = createOpenAICompatible({
name: 'lmstudio',
baseURL: process.env.OLLAMA_API_URL || 'http://localhost:1234/v1',
supportsStructuredOutputs: true,
});

model = ollama(process.env.MODEL_NAME || "gpt-oss:120b-cloud");

}

• but no response from llm. I cannot figure it out 🤔
• Could you please add support for lm studio?

The OpenAI provider tries using the parse endpoint but I think it is not available in Lm Studio yet. Please wait till we officially support the LM Studio API.