-
Notifications
You must be signed in to change notification settings - Fork 1
build_acceleration
GitHub Actions edited this page Jan 2, 2026
·
1 revision
Stand: 5. Dezember 2025
Version: 1.0.0
Kategorie: Development
cmake -S . -B build
cmake --build build# Prerequisites: CUDA Toolkit 11.0+
cmake -S . -B build -DTHEMIS_ENABLE_CUDA=ON
cmake --build build# Prerequisites: Vulkan SDK
cmake -S . -B build -DTHEMIS_ENABLE_VULKAN=ON
cmake --build buildcmake -S . -B build \
-DTHEMIS_ENABLE_CUDA=ON \
-DTHEMIS_ENABLE_VULKAN=ON
cmake --build buildInstall CUDA Toolkit:
-
Linux: https://developer.nvidia.com/cuda-downloads
wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2204/x86_64/cuda-keyring_1.1-1_all.deb sudo dpkg -i cuda-keyring_1.1-1_all.deb sudo apt-get update sudo apt-get install cuda-toolkit-12-3
-
Windows: Download installer from NVIDIA
https://developer.nvidia.com/cuda-downloads
Verify Installation:
nvcc --version
nvidia-smiHardware Requirements:
- NVIDIA GPU with Compute Capability 7.0+
- 8GB+ VRAM recommended
- CUDA Driver 450.80.02+
Install Vulkan SDK:
-
Linux:
wget -qO- https://packages.lunarg.com/lunarg-signing-key-pub.asc | sudo tee /etc/apt/trusted.gpg.d/lunarg.asc sudo wget -qO /etc/apt/sources.list.d/lunarg-vulkan-jammy.list https://packages.lunarg.com/vulkan/lunarg-vulkan-jammy.list sudo apt update sudo apt install vulkan-sdk -
Windows: Download from LunarG
https://vulkan.lunarg.com/sdk/home#windows
Verify Installation:
vulkaninfo
glslangValidator --versionHardware Requirements:
- Vulkan 1.2+ capable GPU (NVIDIA/AMD/Intel)
- 4GB+ VRAM recommended
All hardware acceleration backends are optional and disabled by default.
# CUDA (NVIDIA GPUs)
-DTHEMIS_ENABLE_CUDA=ON
# Vulkan (Cross-platform)
-DTHEMIS_ENABLE_VULKAN=ON
# DirectX 12 (Windows only)
-DTHEMIS_ENABLE_DIRECTX=ON
# AMD HIP (AMD GPUs, future)
-DTHEMIS_ENABLE_HIP=ON
# AMD ZLUDA (CUDA compatibility on AMD, future)
-DTHEMIS_ENABLE_ZLUDA=ON
# Other backends (planned)
-DTHEMIS_ENABLE_METAL=ON # Apple Silicon
-DTHEMIS_ENABLE_ONEAPI=ON # Intel GPUs
-DTHEMIS_ENABLE_OPENCL=ON # Generic
-DTHEMIS_ENABLE_OPENGL=ON # Legacy# Specify CUDA Toolkit location
-DCUDAToolkit_ROOT=/usr/local/cuda-12.3
# Specify Vulkan SDK location
-DVULKAN_SDK=/path/to/vulkan/1.3.xxx
# Enable multiple backends
-DTHEMIS_ENABLE_CUDA=ON -DTHEMIS_ENABLE_VULKAN=ONcmake -S . -B build \
-DCMAKE_BUILD_TYPE=Debug \
-DTHEMIS_ENABLE_CUDA=ON \
-DTHEMIS_BUILD_TESTS=ON
cmake --build build
./build/themis_testscmake -S . -B build \
-DCMAKE_BUILD_TYPE=Release \
-DTHEMIS_ENABLE_CUDA=ON \
-DTHEMIS_ENABLE_VULKAN=ON \
-DTHEMIS_STRICT_BUILD=ON
cmake --build build --config Release# Build only the CUDA plugin as a separate DLL
cd plugins/cuda
cmake -S . -B build
cmake --build build./build/themis_server
# Look for output:
# CUDA Backend initialized successfully:
# Device: NVIDIA GeForce RTX 4090
# Compute Capability: 8.9
# Global Memory: 24 GB
# Multiprocessors: 128./build/themis_server
# Look for output:
# Vulkan Backend: Compute shaders available
# Vulkan Device: NVIDIA GeForce RTX 4090
# VRAM: 24 GBcd build
ctest --output-on-failure
# Or specific tests
./themis_tests --gtest_filter=AccelerationTest.*Error: CUDA toolkit not found
Solution:
# Set CUDA_ROOT
export CUDA_ROOT=/usr/local/cuda
cmake -S . -B build -DTHEMIS_ENABLE_CUDA=ONError: Could NOT find Vulkan
Solution:
# Set VULKAN_SDK
export VULKAN_SDK=/path/to/vulkan/sdk
cmake -S . -B build -DTHEMIS_ENABLE_VULKAN=ONWarning: No CUDA-capable device found
Check:
- Driver installed?
nvidia-smi - GPU visible?
nvidia-smi -L - CUDA initialized?
export CUDA_VISIBLE_DEVICES=0
CUDA Compute Capability Mismatch:
nvcc fatal: Unsupported gpu architecture 'compute_89'
Solution:
# In CMakeLists.txt, adjust CUDA architectures
set(CMAKE_CUDA_ARCHITECTURES 75 80 86 89) # Adjust for your GPUVulkan Shader Compilation Failed:
# Manually compile shaders
cd src/acceleration/vulkan/shaders
glslangValidator -V l2_distance.comp -o l2_distance.spv
glslangValidator -V cosine_distance.comp -o cosine_distance.spv# Release build with CUDA optimizations
-DCMAKE_BUILD_TYPE=Release
-DTHEMIS_ENABLE_AVX2=ON # CPU fallback optimizationRuntime:
# Use specific GPU
export CUDA_VISIBLE_DEVICES=0
# Limit VRAM usage
# (via config/acceleration.yaml)
cuda:
memory_limit_gb: 16# Optimize shaders
spirv-opt l2_distance.spv -O -o l2_distance_opt.spvFROM nvidia/cuda:12.3.0-devel-ubuntu22.04
RUN apt-get update && apt-get install -y \
cmake build-essential git
COPY . /themis
WORKDIR /themis
RUN cmake -S . -B build -DTHEMIS_ENABLE_CUDA=ON && \
cmake --build build
CMD ["./build/themis_server"]Run:
docker build -t themis-cuda .
docker run --gpus all themis-cudaFROM ubuntu:22.04
RUN apt-get update && apt-get install -y \
cmake build-essential git \
vulkan-sdk
# ... rest similar to CUDA- Use Visual Studio 2019+ with CUDA support
- Vulkan SDK installer handles environment variables
- DirectX 12 is native (no extra setup)
- CUDA: Requires proprietary NVIDIA drivers
- Vulkan: Works with Mesa drivers (AMD/Intel) or proprietary (NVIDIA)
- Best for multi-backend builds
- CUDA: Not supported (Apple deprecated CUDA)
- Vulkan: Via MoltenVK (Vulkan → Metal translation)
- Metal: Native, best performance on Apple Silicon
See Also:
Last Updated: 20. November 2025
Version: 1.0
- Architecture-ACCESS-MODEL-IMPLEMENTATION-SUMMARY
- Architecture-ADR-003-pg-dump-sql-parser
- Architecture-BASEENTITY-PRINCIPLE
- Architecture-CACHE-STORAGE-INTEGRATION
- Architecture-CMAKE-ARCHITECTURE
- Architecture-CMAKE-FLAGS-REFERENCE
- Architecture-CMAKE-MODULAR-ARCHITECTURE
- Architecture-CONCERNS-ARCHITECTURE-DIAGRAM
- Architecture-CONCERNS-IMPLEMENTATION-SUMMARY
- Architecture-CONTENT-MODEL
- Architecture-COPILOT-THEMISDB-GRAPH-RAG-BACKEND-ARCHITECTURE
- Architecture-CRYPTO-AND-KEYS
- Architecture-FEATURE-FLAGS-REFERENCE
- Architecture-GPU-ARCHITECTURE-REVIEW-TEMPLATE
- Architecture-HTTP-SHUTDOWN-HARDENING
- Architecture-MIGRATION-GUIDE-CONCERNS
- Architecture-MIGRATION-GUIDE-v13-v14
- Architecture-MODULARIZATION-GUIDE
- Architecture-MODULAR-ARCHITECTURE-ROADMAP
- Architecture-MODULE-ARCHITECTURE-INDEX
- Architecture-P1D01-ISSMPLUGIN-DESIGN-REVIEW
- Architecture-P1-D01-ISSMPLUGIN-DESIGN-REVIEW
- Architecture-P1-D08-MAMBA-GOVERNANCE-CONTRACT
- Architecture-P1-P2-IMPLEMENTATION-COMPLETION-INDEX
- Architecture-PHASE0-COMPLETION-ASSESSMENT
- Architecture-PHASE3-QUERYENGINE-DI-ARCHITECTURE
- Architecture-PHASE4-INDEX-MANAGER-DI
- Architecture-POSTGRESQL-WIRE-PROTOCOL
- Architecture-QUERYENGINE-IMPLEMENTATION-GUIDE
- Architecture-QUERY-SCHEDULING
- Architecture-RAFT-CONSENSUS-DESIGN
- Architecture-README
- Architecture-README-SSM-HYBRID-IMPLEMENTATION
- Architecture-REFACTORING-SUMMARY
- Architecture-RESOURCE-POOLING
- Architecture-SOURCE-DIRECTORY-GUIDE
- Architecture-THEMIS-CORE-GUIDE
- Architecture-UNIFIED-ACCESS-MODEL
- Architecture-WAL-GRPC-MTLS-CONFIGURATION
- Architecture-WIRE-PROTOCOL-RETRY
- Architecture-boltzmann-observability-draft
- Architecture-experimental-logarithmic-vector-storage
- Architecture-llm-wiki-mvp-adr
- Architecture-rewrite-engine-architecture
- Architecture-rope-api-architecture
- Architecture-ssm-gguf-mamba-status
- Architecture-ssm-hybrid-analysis
- Architecture-ssm-hybrid-rollout-plan
- Architecture-ssm-plugin-interface-design-review
- Architecture-transaction-coordinators
- Architecture-wiki-secondary-index
- Architecture-wire-protocol
- Governance-DISABLED-STUB-POLICY
- Governance-DOCS-PR-POLICY
- Governance-GA-PROMOTION-SIGN-OFF
- Governance-GITHUB-MILESTONES-SETUP
- Governance-MATURITY-CLAIM-VERIFICATION-CHECKLIST
- Governance-MATURITY-EVIDENCE-REGISTRY
- Governance-MERGE-GATE-BOT-CONFIG
- Governance-MERGE-GATE-STATUS-LIVE
- Governance-PHASE3-ENFORCEMENT-RUNBOOK
- Governance-PHASE-1-CLOSURE-REPORT
- Governance-PHASE-CLOSURE-POLICY
- Governance-PHASE-DEPENDENCY-GRAPH
- Governance-PLUGIN-SUBMODULE-ROLLBACK
- Governance-PRODUCTION-READY-2026-DELIVERY-PLAN
- Governance-PR-VERSION-TARGETING
- Governance-PR-VERSION-TARGETING-BACKFILL
- Governance-QUERY-MODULE-STATUS
- Governance-README
- Governance-RELEASE-PROMOTION-GATE-POLICY
- Governance-RELEASE-VALIDATION-CHECKLIST
- Governance-SECURITY-MODULE-5671-EVIDENCE-SUMMARY
- Governance-SHARDING-P6-RESIDUAL-RISK-ACCEPTANCE
- Governance-SOURCECODE-COMPLIANCE-GOVERNANCE
- Governance-UPDATES-DEVELOPMENT-STATUS-SIGN-OFF
- Governance-WAVE-C-IMPLEMENTATION-COMPLETE
- Module-acceleration-Roadmap
- Module-access-model-Roadmap
- Module-ai-Roadmap
- Module-analytics-Roadmap
- Module-api-Roadmap
- Module-aql-Roadmap
- Module-auth-Roadmap
- Module-base-Roadmap
- Module-cache-Roadmap
- Module-cdc-Roadmap
- Module-chaos-Roadmap
- Module-chimera-Roadmap
- Module-config-Roadmap
- Module-content-Roadmap
- Module-core-Roadmap
- Module-distributed-knowledge-Roadmap
- Module-distributed-tensor-Roadmap
- Module-document-Roadmap
- Module-ethics-ai-Roadmap
- Module-evaluation-Roadmap
- Module-execution-Roadmap
- Module-exporters-Roadmap
- Module-failover-Roadmap
- Module-geo-Roadmap
- Module-governance-Roadmap
- Module-gpu-Roadmap
- Module-graph-Roadmap
- Module-image-analysis-Roadmap
- Module-importers-Roadmap
- Module-index-Roadmap
- Module-ingestion-Roadmap
- Module-llama-cpp-Roadmap
- Module-llm-Roadmap
- Module-llm-streaming-Roadmap
- Module-llm-wiki-Roadmap
- Module-maintenance-Roadmap
- Module-metadata-Roadmap
- Module-network-Roadmap
- Module-observability-Roadmap
- Module-onnx-clip-Roadmap
- Module-performance-Roadmap
- Module-plugins-Roadmap
- Module-process-Roadmap
- Module-projects-Roadmap
- Module-prompt-engineering-Roadmap
- Module-query-Roadmap
- Module-rag-Roadmap
- Module-replication-Roadmap
- Module-retrieval-Roadmap
- Module-rpc-grpc-Roadmap
- Module-scheduler-Roadmap
- Module-scraper-Roadmap
- Module-search-Roadmap
- Module-security-Roadmap
- Module-server-Roadmap
- Module-sharding-Roadmap
- Module-stable-diffusion-Roadmap
- Module-storage-Roadmap
- Module-temporal-Roadmap
- Module-tensor-Roadmap
- Module-themis-Roadmap
- Module-timeseries-Roadmap
- Module-toolbox-Roadmap
- Module-training-Roadmap
- Module-transaction-Roadmap
- Module-updates-Roadmap
- Module-user-storage-encrypted-Roadmap
- Module-utils-Roadmap
- Module-vector-search-Roadmap
- Module-voice-Roadmap
- Module-whisper-Roadmap