Mistral Document AI

[anyb1s]

can instructor work with mistral document AI, it is better than chat for extracting file data?

[ddebowczyk]

Instructor can be used to build something like Mistral Document AI that would be cross-platform (unlike Mistral, which I think works only with Mistral models).

Check examples:

• https://github.com/cognesy/instructor-php/tree/main/examples/A05_Extras/ImageToData
• https://github.com/cognesy/instructor-php/tree/main/examples/A05_Extras/ImageToDataAnthropic
• https://github.com/cognesy/instructor-php/tree/main/examples/A05_Extras/ImageToDataGemini

They only differ in which LLM they use.

Example using 1.0 API:

// ...
$receipt = (new StructuredOutput)
    ->using('openai') // or 'anthropic', or 'gemini', or 'mistral'
    ->withInput(Image::fromFile(__DIR__ . '/receipt.png'))
    ->withResponseClass(Receipt::class)
    ->withPrompt('Extract structured data from the receipt.')
    ->withOptions(['max_tokens' => 4096])
    ->get();

// now you can work with $receipt object