Skip to content

[Bug]: device: "cpu" should not be affected by GPU dependencies #1823

Description

@devunion

🐛 Bug Description

The original problem was described here: #1755.

SDK was configured to use CPU:

        modelConfig: {
            device: "cpu",
            ctx_size: 1024,
        },

So, I assume that any problems with GPU drivers should not cause any problems if we use CPU mode.

🔄 Steps to Reproduce

  1. Ensure that you've obsolete Vulcan drivers (for ex, 1.2.3).
  2. Init SDK
    modelId = await loadModel({
        modelSrc: LLAMA_3_2_1B_INST_Q4_0,
        modelType: "llm",
        modelConfig: {
            device: "cpu",
            ctx_size: 1024,
        },
        onProgress: (progress) => {
            console.log(progress);
        },
    });

✅ Expected Behavior

SDK should work even with obsolete GPU drivers

❌ Actual Behavior

SDK fails with the exteption

📜 Stack Trace / Error Output

вќЊ Error: Error: The specified procedure could not be found.

    at Addon.load (bare:/bare.js:3488:32)
    at require.addon (bare:/bare.bundle/node_modules/bare-module/index.js:778:30)
    at file:///C:/work/vitya/my_progs/___SantaBrowser/qvac-sdk/qvac-examples/node_modules/@qvac/llm-llamacpp/binding.js:1:26
    at Module._evaluate (bare:/bare.bundle/node_modules/bare-module/index.js:210:7)
    at Module._transform (bare:/bare.bundle/node_modules/bare-module/index.js:122:12)
    at Module.load (bare:/bare.bundle/node_modules/bare-module/index.js:467:21)
    at require (bare:/bare.bundle/node_modules/bare-module/index.js:763:25)
    at file:///C:/work/vitya/my_progs/___SantaBrowser/qvac-sdk/qvac-examples/node_modules/@qvac/llm-llamacpp/addonLogging.js:1:17
    at Module._evaluate (bare:/bare.bundle/node_modules/bare-module/index.js:210:7)
    at Module._onevaluate (bare:/bare.bundle/node_modules/bare-module/index.js:291:12)
Uncaught ReferenceError: process is not defined
    at file:///C:/work/vitya/my_progs/___SantaBrowser/qvac-sdk/qvac-examples/quickstart.js:29:5

💻 Platform / OS

Windows (x64)

🖥️ OS Version

10

⚙️ Runtime Environment

Node.js

📦 Runtime Version

22.22

🏷️ SDK Version

0.9.1

📋 Relevant Dependencies

"dependencies": {
    "@qvac/sdk": "^0.9.1"
  },

🔁 Frequency

Always (100%)

🔥 Severity

Critical - Complete blocker, no workaround

🩹 Workaround

No response

📎 Additional Context

No response

✅ Checklist

  • I have searched existing issues for duplicates
  • I have included a minimal reproduction
  • I am using a supported SDK version

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions