As discussed we should explore with the help of the integrations team how we could bridge the upstream AI plugin to use the model connected in Nextcloud. Problem was that there is no streaming API provided.
@chrip As discussed please get in touch and see what technical solution we could come up with to get this implemented.
Edit 17 July: Assistant supports streaming responses since mid-June nextcloud/assistant#545, so this should be doable now. More research is needed
As discussed we should explore with the help of the integrations team how we could bridge the upstream AI plugin to use the model connected in Nextcloud. Problem was that there is no streaming API provided.
@chrip As discussed please get in touch and see what technical solution we could come up with to get this implemented.
Edit 17 July: Assistant supports streaming responses since mid-June nextcloud/assistant#545, so this should be doable now. More research is needed