Using the Albert API model

[gundesli]

Is it possible to use the llm-chain library with the Albert API model ?

Do you have an example of implementation please ?

Thank you in advance for your answers.

[OskarStark]

Hi, unfortunately not yet. Feel free to check the code and open a PullRequest.

Do you know if it uses the OpenAi API specification? As the link is in French I cannot get any information.

[gundesli]

Hi,

There is a github repository if that helps : https://github.com/etalab-ia/albert-api

[OskarStark]

As they are using OpenAI API specification, this should work out of the box.

Check #366 for more information. Note this is untested.

Please give some feedback, once tested, thanks

[OskarStark]

PR updated

[gundesli]

Very good news, thank you 👍

I wanted to test the changes made on feat/albert-api-support but I use the llm-chain-bundle bundle and I was inspired by the llm-chain-symfony-demo.
I plugged the llm-chain-bundle bundle to use the feat/albert-api-support branch.

On the feat/albert-api-support branch, the PhpLlm\LlmChain\Store\Embedder class doesn't exist, which poses a problem for the bundle.

[chr-hertel]

@gundesli you're right the bundle got lost a bit - will catch up

[gundesli]

Hi,

I've tested the chat to the Albert API with the "feat: add Albert API support" branch.

public function submitMessage(string $message): void
    {
        $messages = $this->loadMessages();

        $messages->add(Message::ofUser($message));

        $platform = PlatformFactory::create(
            apiKey: $_ENV['ALBERT_API_KEY'],
            albertUrl: $_ENV['ALBERT_API_URL']
        );

        $model = new GPT('albert-large');

        $chain = new Chain($platform, $model);

        $response = $chain->call($messages);

        assert($response instanceof TextResponse);

        $messages->add(Message::ofAssistant($response->getContent()));

        $this->saveMessages($messages);
    }

it works well 👍

What's next step ?

[OskarStark]

Thanks for the feedback.

@chr-hertel open for merging the corresponding PR? I guess we also need to update the bundle then?

[chr-hertel]

Do i see it right, that i can not easily get access to that Albert API to get an API key myself for executing the examples?

[gundesli]

Unfortunately, you have to be part of the French administration to obtain an api key.

[chr-hertel]

hmm, i'm afraid that's not on my personal bucket list ... we cannot take any guarantees than and I wonder if you want to maintain the code yourself over us integrating it in the lib and not testing the functionality - but also fine to merge and ignore the bridge

[chr-hertel]

we could basically use this to proof and document how to use your own platform with the lib and bundle 🤔