-
Notifications
You must be signed in to change notification settings - Fork 1
PLUGIN_MIGRATION
GitHub Actions edited this page Jan 2, 2026
·
1 revision
Stand: 5. Dezember 2025
Version: 1.0.0
Kategorie: Plugins
Datum: 21. November 2025
Zweck: Zusammenführung bestehender DLL-Loader zu einem einheitlichen Plugin-System
Status: ✅ VOLLSTÄNDIG IMPLEMENTIERT
Features:
- Platform-agnostic DLL loading (Windows/Linux/macOS)
- Security verification (plugin_security.h integration)
- Plugin discovery from directory
- Signature verification (production)
- Hash-based integrity checks
- Audit logging
Interface:
class PluginLoader {
bool loadPlugin(const std::string& libraryPath);
size_t loadPluginsFromDirectory(const std::string& directoryPath);
BackendPlugin* getPlugin(const std::string& pluginName) const;
};Entry Point:
extern "C" THEMIS_PLUGIN_EXPORT BackendPlugin* CreateBackendPlugin();Verwendung:
- Compute backends (CUDA, OpenCL, Vulkan, DirectX, HIP, OneAPI)
- Prefix:
themis_accel_*.dll
Status: ✅ AD-HOC IMPLEMENTATION
Features:
- Dynamisches Laden von PKCS#11-Bibliotheken
- Windows: LoadLibraryA / GetProcAddress
- Linux: dlopen / dlsym
- Function pointer loading: C_GetFunctionList
Code:
// src/security/hsm_provider_pkcs11.cpp (Zeilen 32-52)
#ifdef _WIN32
lib_ = LoadLibraryA(path.c_str());
auto getFn = (CK_C_GetFunctionList)GetProcAddress((HMODULE)lib_, "C_GetFunctionList");
#else
lib_ = dlopen(path.c_str(), RTLD_NOW);
auto getFn = (CK_C_GetFunctionList)dlsym(lib_, "C_GetFunctionList");
#endifProblem:
- Keine Security-Verifikation
- Keine Hash-Checks
- Duplizierter Code für DLL-Loading
- Kein Plugin-Registry
Status: ✅ AD-HOC IMPLEMENTATION
Features:
- Dynamisches Laden von libcuda.so.zluda (ZLUDA = CUDA on AMD)
- Fallback zu libcuda.so
- Function pointer loading für CUDA API
Code:
// src/acceleration/zluda_backend.cpp (Zeilen 95-97)
zludaLib_ = dlopen("libcuda.so.zluda", RTLD_NOW);
if (!zludaLib_) {
zludaLib_ = dlopen("libcuda.so", RTLD_NOW);
}Problem:
- Hardcoded library names
- Keine Konfiguration
- Keine Fallback-Strategie
- Duplizierter DLL-Loading-Code
✅ Neue Komponenten:
-
include/plugins/plugin_interface.h- Unified interface -
include/plugins/plugin_manager.h- Erweitert acceleration/PluginLoader -
docs/plugins/PLUGIN_MIGRATION.md- Dieses Dokument
Key Design Decisions:
- ✅ Reuse acceleration/plugin_loader.cpp für Platform-Loading
- ✅ Reuse acceleration/plugin_security.h für Verification
- ✅ Extend mit Plugin Manifests (plugin.json)
- ✅ Extend mit Type-based Registry
Vorher:
// src/security/hsm_provider_pkcs11.cpp
void* lib_ = dlopen(path.c_str(), RTLD_NOW);
auto getFn = (CK_C_GetFunctionList)dlsym(lib_, "C_GetFunctionList");Nachher:
// src/security/hsm_provider_pkcs11.cpp
class PKCS11Plugin : public IThemisPlugin {
PluginType getType() const override { return PluginType::HSM_PROVIDER; }
void* getInstance() override { return &hsm_provider_; }
};
// Auto-load via PluginManager
auto plugin = PluginManager::instance().loadPlugin("pkcs11");
auto* provider = static_cast<HSMProvider*>(plugin->getInstance());Benefits:
- ✅ Security verification
- ✅ Unified loading
- ✅ Plugin registry
- ✅ Hot-reload support
Vorher:
// src/acceleration/zluda_backend.cpp
zludaLib_ = dlopen("libcuda.so.zluda", RTLD_NOW);Nachher:
// plugins/compute/zluda/themis_accel_zluda.cpp
class ZLUDAPlugin : public acceleration::BackendPlugin {
// Already uses BackendPlugin interface!
// Just move to separate DLL
};
// plugin.json
{
"name": "zluda",
"type": "compute_backend",
"binary": {
"linux": "themis_accel_zluda.so"
},
"auto_load": false // Load on-demand
}Benefits:
- ✅ ZLUDA nur laden wenn benötigt (nicht standardmäßig)
- ✅ Kleinere Core-Binary
- ✅ Einfacher zu testen (AMD-Hardware optional)
Structure:
plugins/
├── blob/
│ ├── filesystem/
│ │ ├── themis_blob_fs.dll
│ │ ├── plugin.json
│ │ └── CMakeLists.txt
│ ├── webdav/
│ │ ├── themis_blob_webdav.dll
│ │ ├── plugin.json
│ │ └── CMakeLists.txt
│ └── s3/
│ ├── themis_blob_s3.dll
│ ├── plugin.json
│ └── CMakeLists.txt
plugin.json (Filesystem):
{
"name": "filesystem",
"version": "1.0.0",
"type": "blob_storage",
"description": "Local filesystem blob storage",
"binary": {
"windows": "themis_blob_fs.dll",
"linux": "themis_blob_fs.so",
"macos": "themis_blob_fs.dylib"
},
"dependencies": [],
"capabilities": {
"streaming": false,
"batching": true,
"thread_safe": true
},
"config_schema": {
"base_path": {"type": "string", "default": "./data/blobs"}
},
"auto_load": true,
"load_priority": 10
}Structure:
plugins/
├── importers/
│ ├── postgres/
│ │ ├── themis_import_pg.dll
│ │ ├── plugin.json
│ │ └── CMakeLists.txt
│ └── csv/
│ ├── themis_import_csv.dll
│ ├── plugin.json
│ └── CMakeLists.txt
# Root CMakeLists.txt
option(BUILD_PLUGINS "Build plugins as separate DLLs" ON)
if(BUILD_PLUGINS)
add_subdirectory(plugins)
endif()
# plugins/CMakeLists.txt (NEW)
add_subdirectory(blob)
add_subdirectory(importers)
add_subdirectory(compute) # Existing acceleration plugins
# plugins/blob/filesystem/CMakeLists.txt (NEW)
add_library(themis_blob_fs SHARED
filesystem_plugin.cpp
../../../src/storage/blob_backend_filesystem.cpp
)
target_link_libraries(themis_blob_fs PRIVATE themis_core)
set_target_properties(themis_blob_fs PROPERTIES
LIBRARY_OUTPUT_DIRECTORY "${CMAKE_BINARY_DIR}/plugins/blob"
)// src/main_server.cpp
#include "plugins/plugin_manager.h"
int main() {
// Initialize plugin system
auto& pm = PluginManager::instance();
pm.scanPluginDirectory("./plugins");
pm.autoLoadPlugins();
// Existing code...
}// src/security/hsm_provider_pkcs11.cpp
// BEFORE: Direct dlopen
void* lib_ = dlopen(config_.library_path.c_str(), RTLD_NOW);
// AFTER: Use PluginManager
auto plugin = PluginManager::instance().loadPluginFromPath(
config_.library_path,
json{{"slot_id", config_.slot_id}}.dump()
);| Aspect | Before (3 separate loaders) | After (Unified) |
|---|---|---|
| Code Duplication | 3x DLL loading code | 1x shared code |
| Security | Only acceleration/ has it | All plugins verified |
| Discovery | Manual path specification | Auto-discovery |
| Hot-Reload | Not supported | Supported |
| Manifest | No metadata | plugin.json |
| Dependency Mgmt | Manual | Automatic |
| Type Safety | Generic void* | Type-based registry |
- Create unified plugin interface
- Create PluginManager (extends PluginLoader)
- Write migration documentation
- Test plan
- Refactor HSM Provider to use PluginManager
- Extract ZLUDA to separate plugin DLL
- Update build system
- Blob Storage plugins (Filesystem, WebDAV)
- Importer plugins (PostgreSQL, CSV)
- Integration tests
- Plugin Development Guide
- API Reference
- Example plugins
Step 1: Create Plugin Wrapper
// plugins/hsm/pkcs11/pkcs11_plugin.cpp
#include "plugins/plugin_interface.h"
#include "security/hsm_provider.h"
class PKCS11Plugin : public IThemisPlugin {
private:
std::unique_ptr<HSMProvider> provider_;
public:
const char* getName() const override { return "pkcs11"; }
const char* getVersion() const override { return "1.0.0"; }
PluginType getType() const override { return PluginType::HSM_PROVIDER; }
PluginCapabilities getCapabilities() const override {
PluginCapabilities caps;
caps.thread_safe = true;
return caps;
}
bool initialize(const char* config_json) override {
auto config = json::parse(config_json);
HSMConfig hsm_config;
hsm_config.library_path = config["library_path"];
hsm_config.slot_id = config["slot_id"];
hsm_config.pin = config["pin"];
provider_ = std::make_unique<HSMProvider>(hsm_config);
return provider_->initialize();
}
void shutdown() override {
if (provider_) provider_->finalize();
}
void* getInstance() override {
return provider_.get();
}
};
THEMIS_PLUGIN_IMPL(PKCS11Plugin)Step 2: Create Manifest
// plugins/hsm/pkcs11/plugin.json
{
"name": "pkcs11",
"version": "1.0.0",
"type": "hsm_provider",
"description": "PKCS#11 Hardware Security Module Provider",
"binary": {
"windows": "themis_hsm_pkcs11.dll",
"linux": "themis_hsm_pkcs11.so"
},
"dependencies": [
"pkcs11-library (runtime)"
],
"config_schema": {
"library_path": {"type": "string", "required": true},
"slot_id": {"type": "number", "default": 0},
"pin": {"type": "string", "required": true}
},
"auto_load": false
}Step 3: Update Usage
// OLD (src/security/some_service.cpp)
HSMConfig config;
config.library_path = "/usr/lib/softhsm/libsofthsm2.so";
config.slot_id = 0;
config.pin = "1234";
auto hsm = std::make_unique<HSMProvider>(config);
hsm->initialize();
// NEW
auto plugin = PluginManager::instance().loadPlugin("pkcs11");
auto* hsm = static_cast<HSMProvider*>(plugin->getInstance());Status: ✅ Design Complete, Ready for Implementation
Next: Implementation der PluginManager-Klasse
- Architecture-ACCESS-MODEL-IMPLEMENTATION-SUMMARY
- Architecture-ADR-003-pg-dump-sql-parser
- Architecture-BASEENTITY-PRINCIPLE
- Architecture-CACHE-STORAGE-INTEGRATION
- Architecture-CMAKE-ARCHITECTURE
- Architecture-CMAKE-FLAGS-REFERENCE
- Architecture-CMAKE-MODULAR-ARCHITECTURE
- Architecture-CONCERNS-ARCHITECTURE-DIAGRAM
- Architecture-CONCERNS-IMPLEMENTATION-SUMMARY
- Architecture-CONTENT-MODEL
- Architecture-COPILOT-THEMISDB-GRAPH-RAG-BACKEND-ARCHITECTURE
- Architecture-CRYPTO-AND-KEYS
- Architecture-FEATURE-FLAGS-REFERENCE
- Architecture-GPU-ARCHITECTURE-REVIEW-TEMPLATE
- Architecture-HTTP-SHUTDOWN-HARDENING
- Architecture-MIGRATION-GUIDE-CONCERNS
- Architecture-MIGRATION-GUIDE-v13-v14
- Architecture-MODULARIZATION-GUIDE
- Architecture-MODULAR-ARCHITECTURE-ROADMAP
- Architecture-MODULE-ARCHITECTURE-INDEX
- Architecture-P1D01-ISSMPLUGIN-DESIGN-REVIEW
- Architecture-P1-D01-ISSMPLUGIN-DESIGN-REVIEW
- Architecture-P1-D08-MAMBA-GOVERNANCE-CONTRACT
- Architecture-P1-P2-IMPLEMENTATION-COMPLETION-INDEX
- Architecture-PHASE0-COMPLETION-ASSESSMENT
- Architecture-PHASE3-QUERYENGINE-DI-ARCHITECTURE
- Architecture-PHASE4-INDEX-MANAGER-DI
- Architecture-POSTGRESQL-WIRE-PROTOCOL
- Architecture-QUERYENGINE-IMPLEMENTATION-GUIDE
- Architecture-QUERY-SCHEDULING
- Architecture-RAFT-CONSENSUS-DESIGN
- Architecture-README
- Architecture-README-SSM-HYBRID-IMPLEMENTATION
- Architecture-REFACTORING-SUMMARY
- Architecture-RESOURCE-POOLING
- Architecture-SOURCE-DIRECTORY-GUIDE
- Architecture-THEMIS-CORE-GUIDE
- Architecture-UNIFIED-ACCESS-MODEL
- Architecture-WAL-GRPC-MTLS-CONFIGURATION
- Architecture-WIRE-PROTOCOL-RETRY
- Architecture-boltzmann-observability-draft
- Architecture-experimental-logarithmic-vector-storage
- Architecture-llm-wiki-mvp-adr
- Architecture-rewrite-engine-architecture
- Architecture-rope-api-architecture
- Architecture-ssm-gguf-mamba-status
- Architecture-ssm-hybrid-analysis
- Architecture-ssm-hybrid-rollout-plan
- Architecture-ssm-plugin-interface-design-review
- Architecture-transaction-coordinators
- Architecture-wiki-secondary-index
- Architecture-wire-protocol
- Governance-DISABLED-STUB-POLICY
- Governance-DOCS-PR-POLICY
- Governance-GA-PROMOTION-SIGN-OFF
- Governance-GITHUB-MILESTONES-SETUP
- Governance-MATURITY-CLAIM-VERIFICATION-CHECKLIST
- Governance-MATURITY-EVIDENCE-REGISTRY
- Governance-MERGE-GATE-BOT-CONFIG
- Governance-MERGE-GATE-STATUS-LIVE
- Governance-PHASE3-ENFORCEMENT-RUNBOOK
- Governance-PHASE-1-CLOSURE-REPORT
- Governance-PHASE-CLOSURE-POLICY
- Governance-PHASE-DEPENDENCY-GRAPH
- Governance-PLUGIN-SUBMODULE-ROLLBACK
- Governance-PRODUCTION-READY-2026-DELIVERY-PLAN
- Governance-PR-VERSION-TARGETING
- Governance-PR-VERSION-TARGETING-BACKFILL
- Governance-QUERY-MODULE-STATUS
- Governance-README
- Governance-RELEASE-PROMOTION-GATE-POLICY
- Governance-RELEASE-VALIDATION-CHECKLIST
- Governance-SECURITY-MODULE-5671-EVIDENCE-SUMMARY
- Governance-SHARDING-P6-RESIDUAL-RISK-ACCEPTANCE
- Governance-SOURCECODE-COMPLIANCE-GOVERNANCE
- Governance-UPDATES-DEVELOPMENT-STATUS-SIGN-OFF
- Governance-WAVE-C-IMPLEMENTATION-COMPLETE
- Module-acceleration-Roadmap
- Module-access-model-Roadmap
- Module-ai-Roadmap
- Module-analytics-Roadmap
- Module-api-Roadmap
- Module-aql-Roadmap
- Module-auth-Roadmap
- Module-base-Roadmap
- Module-cache-Roadmap
- Module-cdc-Roadmap
- Module-chaos-Roadmap
- Module-chimera-Roadmap
- Module-config-Roadmap
- Module-content-Roadmap
- Module-core-Roadmap
- Module-distributed-knowledge-Roadmap
- Module-distributed-tensor-Roadmap
- Module-document-Roadmap
- Module-ethics-ai-Roadmap
- Module-evaluation-Roadmap
- Module-execution-Roadmap
- Module-exporters-Roadmap
- Module-failover-Roadmap
- Module-geo-Roadmap
- Module-governance-Roadmap
- Module-gpu-Roadmap
- Module-graph-Roadmap
- Module-image-analysis-Roadmap
- Module-importers-Roadmap
- Module-index-Roadmap
- Module-ingestion-Roadmap
- Module-llama-cpp-Roadmap
- Module-llm-Roadmap
- Module-llm-streaming-Roadmap
- Module-llm-wiki-Roadmap
- Module-maintenance-Roadmap
- Module-metadata-Roadmap
- Module-network-Roadmap
- Module-observability-Roadmap
- Module-onnx-clip-Roadmap
- Module-performance-Roadmap
- Module-plugins-Roadmap
- Module-process-Roadmap
- Module-projects-Roadmap
- Module-prompt-engineering-Roadmap
- Module-query-Roadmap
- Module-rag-Roadmap
- Module-replication-Roadmap
- Module-retrieval-Roadmap
- Module-rpc-grpc-Roadmap
- Module-scheduler-Roadmap
- Module-scraper-Roadmap
- Module-search-Roadmap
- Module-security-Roadmap
- Module-server-Roadmap
- Module-sharding-Roadmap
- Module-stable-diffusion-Roadmap
- Module-storage-Roadmap
- Module-temporal-Roadmap
- Module-tensor-Roadmap
- Module-themis-Roadmap
- Module-timeseries-Roadmap
- Module-toolbox-Roadmap
- Module-training-Roadmap
- Module-transaction-Roadmap
- Module-updates-Roadmap
- Module-user-storage-encrypted-Roadmap
- Module-utils-Roadmap
- Module-vector-search-Roadmap
- Module-voice-Roadmap
- Module-whisper-Roadmap