Fix GLIBCXX_3.4.32 Missing Dynamic System Linkage on CUDA 12.8 Runtimes

[purvanshjoshi]

Technical Overview

When executing model loading using bitsandbytes quantization (8-bit/4-bit), the backend library attempts to compile or load its pre-compiled C++ GPU optimization binaries. In environments running newer CUDA 12.8 drivers, the runtime throws a system-level linkage crash because the host environment's default libstdc++.so.6 lacks the GLIBCXX_3.4.32 symbol definition.

Affected Modules

• Library: bitsandbytes (CUDA setup module loader)
• Runtime: Kaggle T4x2 environment (running Python 3.12, CUDA 12.8)

Detailed Traceback / Context

AttributeError: 'NoneType' object has no attribute 'cadb'
...
ImportError: /lib/x86_64-linux-gnu/libstdc++.so.6: version `GLIBCXX_3.4.32' not found

Acceptance Criteria

1. Dynamic Resolution: The system detects and upgrades the system-level C++ library in under 60 seconds during environment preparation.
2. Successful GPU Quantization: bitsandbytes successfully loads the model parameters in 8-bit precision, verified via:

   import bitsandbytes as bnb
   assert bnb.cuda_setup.main.get_cuda_lib_path() is not None

3. Idempotence: Running the setup command repeatedly does not degrade the host system configurations.

Proposed Implementation Approach

Integrate a system-level setup cell at the absolute beginning of cloud training notebooks. This patch updates the host toolchain to pull the modern dynamic libraries:

sudo add-apt-repository -y ppa:ubuntu-toolchain-r/test
sudo apt-get update
sudo apt-get install -y --only-upgrade libstdc++6

This is followed immediately by standard dependency mapping.

Severity & Priority

• Severity: Blocker (Completely halts training startup on T4x2 engines)
• Priority: P0

[Saksham-dev-del]

Hi @purvanshjoshi,

I would like to work on this issue. I will add a setup step at the start of the training environment initialization that upgrades libstdc++6 via the ubuntu-toolchain-r/test PPA, resolving the missing GLIBCXX_3.4.32 symbol.

I will verify the fix on a Kaggle T4x2 (Python 3.12, CUDA 12.8) environment by confirming bitsandbytes.cuda_setup.main.get_cuda_lib_path() resolves successfully, and check that repeated runs of the setup step don't degrade the environment.

Could you please assign this issue to me? I will submit a PR for review once complete.