Streaming crash

[pulkitjuneja]

LLM streaming sometime crashes with the following error

Model : qwen 3:8b

[1] 00:13:29.625 > [Conductor] Stopping due to tool calls detected
[1] 00:13:29.626 > [Conductor] Tool calls found: [{"function":{"name":"execute_blender_code","arguments":{"code":"import bpy\n\n# Remove existing cubes from the scene's collection\nfor obj in bpy.context.scene.collection.objects:\n    if obj.type == 'MESH':\n        bpy.context.scene.collection.objects.unlink(obj)\n\n# Add three new cubes\nfor i in range(3):\n    cube = bpy.data.meshes.new(name=f\"Cube_{i}\")\n    obj = bpy.data.objects.new(name=f\"Cube_{i}\", object_data=cube)\n    bpy.context.scene.collection.objects.link(obj)\n    obj.location = (i * 2, 0, 0)"}}}]
[1] 00:13:30.114 > [Conductor] Final content. Content:
[1] 00:13:30.115 > [Conductor] Phase 2 (4/50)
[1] 00:13:30.115 > [Conductor] Streaming until tool call or natural end - Starting with thinking state: {
[1]   isInThinkingBlock: false,
[1]   thinkingContent: '',
[1]   currentThinkingId: null,
[1]   thinkingStartTime: null
[1] }
[1] 00:31:54.152 > [Conductor] Unexpected error during streaming: TypeError: fetch failed
[1]     at node:internal/deps/undici/undici:13502:13
[1]     at async post (C:\Projects\tomobo-cobolt\dll\main.bundle.dev.js:195969:20)
[1]     at async Ollama.processStreamableRequest (C:\Projects\tomobo-cobolt\dll\main.bundle.dev.js:196086:25)
[1]     at async ConductorGenerator.streamWithStopCondition (C:\Projects\tomobo-cobolt\dll\main.bundle.dev.js:268868:30)
[1]     at async ConductorGenerator.streamAndStopOnToolCall (C:\Projects\tomobo-cobolt\dll\main.bundle.dev.js:268960:24)
[1]     at async ConductorGenerator.handleToolExecutionLoop (C:\Projects\tomobo-cobolt\dll\main.bundle.dev.js:268752:28)
[1]     at async ConductorGenerator.createConductorResponseGenerator (C:\Projects\tomobo-cobolt\dll\main.bundle.dev.js:268715:35)
[1]     at async processChunk (C:\Projects\tomobo-cobolt\dll\main.bundle.dev.js:271056:26)
[1]     at async C:\Projects\tomobo-cobolt\dll\main.bundle.dev.js:271171:9
[1]     at async WebContents.<anonymous> (node:electron/js2c/browser_init:2:89248)
[1] 00:31:54.198 > [Conductor] Error in tool execution loop: TypeError: fetch failed
[1]     at node:internal/deps/undici/undici:13502:13
[1]     at async post (C:\Projects\tomobo-cobolt\dll\main.bundle.dev.js:195969:20)
[1]     at async Ollama.processStreamableRequest (C:\Projects\tomobo-cobolt\dll\main.bundle.dev.js:196086:25)
[1]     at async ConductorGenerator.streamWithStopCondition (C:\Projects\tomobo-cobolt\dll\main.bundle.dev.js:268868:30)
[1]     at async ConductorGenerator.streamAndStopOnToolCall (C:\Projects\tomobo-cobolt\dll\main.bundle.dev.js:268960:24)
[1]     at async ConductorGenerator.handleToolExecutionLoop (C:\Projects\tomobo-cobolt\dll\main.bundle.dev.js:268752:28)
[1]     at async ConductorGenerator.createConductorResponseGenerator (C:\Projects\tomobo-cobolt\dll\main.bundle.dev.js:268715:35)
[1]     at async processChunk (C:\Projects\tomobo-cobolt\dll\main.bundle.dev.js:271056:26)
[1]     at async C:\Projects\tomobo-cobolt\dll\main.bundle.dev.js:271171:9
[1]     at async WebContents.<anonymous> (node:electron/js2c/browser_init:2:89248)
[1] 00:31:54.205 > [Conductor] CONDUCTOR ERROR: TypeError: fetch failed
[1]     at node:internal/deps/undici/undici:13502:13
[1]     at async post (C:\Projects\tomobo-cobolt\dll\main.bundle.dev.js:195969:20)
[1]     at async Ollama.processStreamableRequest (C:\Projects\tomobo-cobolt\dll\main.bundle.dev.js:196086:25)
[1]     at async ConductorGenerator.streamWithStopCondition (C:\Projects\tomobo-cobolt\dll\main.bundle.dev.js:268868:30)
[1]     at async ConductorGenerator.streamAndStopOnToolCall (C:\Projects\tomobo-cobolt\dll\main.bundle.dev.js:268960:24)
[1]     at async ConductorGenerator.handleToolExecutionLoop (C:\Projects\tomobo-cobolt\dll\main.bundle.dev.js:268752:28)
[1]     at async ConductorGenerator.createConductorResponseGenerator (C:\Projects\tomobo-cobolt\dll\main.bundle.dev.js:268715:35)
[1]     at async processChunk (C:\Projects\tomobo-cobolt\dll\main.bundle.dev.js:271056:26)
[1]     at async C:\Projects\tomobo-cobolt\dll\main.bundle.dev.js:271171:9
[1]     at async WebContents.<anonymous> (node:electron/js2c/browser_init:2:89248)
[1] 00:31:54.208 > [Conductor] ERROR STACK: TypeError: fetch failed
[1]     at node:internal/deps/undici/undici:13502:13
[1]     at async post (C:\Projects\tomobo-cobolt\dll\main.bundle.dev.js:195969:20)
[1]     at async Ollama.processStreamableRequest (C:\Projects\tomobo-cobolt\dll\main.bundle.dev.js:196086:25)
[1]     at async ConductorGenerator.streamWithStopCondition (C:\Projects\tomobo-cobolt\dll\main.bundle.dev.js:268868:30)
[1]     at async ConductorGenerator.streamAndStopOnToolCall (C:\Projects\tomobo-cobolt\dll\main.bundle.dev.js:268960:24)
[1]     at async ConductorGenerator.handleToolExecutionLoop (C:\Projects\tomobo-cobolt\dll\main.bundle.dev.js:268752:28)
[1]     at async ConductorGenerator.createConductorResponseGenerator (C:\Projects\tomobo-cobolt\dll\main.bundle.dev.js:268715:35)
[1]     at async processChunk (C:\Projects\tomobo-cobolt\dll\main.bundle.dev.js:271056:26)
[1]     at async C:\Projects\tomobo-cobolt\dll\main.bundle.dev.js:271171:9
[1]     at async WebContents.<anonymous> (node:electron/js2c/browser_init:2:89248)