Skip to content

Latest commit

 

History

11 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Linguistic Engine

High-performance linguistic engine for ancient languages (Hebrew, Greek, Ge'ez) with multi-database support, WAL durability, and industrial benchmarks.

Performance

┌──────────────────────────┬─────────────────────────────────────┐
│  Search Latency P50      │  2.78 µs                            │
│  Search Latency P99      │  3.90 µs                            │
│  Search QPS              │  231,966 queries/sec                │
│  Bulk Insert             │  79,359 inserts/sec                 │
│  WAL Recovery            │  100% data integrity                │
│  Scaling                 │  SUBLINEAR (1000x → 1.7x)           │
│  vs Tantivy P50          │  Tied (2.7 µs vs 2.0 µs)            │
│  vs SQLite FTS5 P95      │  Beats (3.4 µs vs 50 µs)            │
└──────────────────────────┴─────────────────────────────────────┘

Quick Start

cargo build --release
cargo run --release -- --port 13399

Any SQL database — just change the URL:

cargo run --release -- --database "sqlite:data.db"
cargo run --release -- --database "postgresql://user:pass@localhost:5432/mydb"
cargo run --release -- --database "mysql://root:pass@localhost:3306/mydb"

Benchmarks

# All benchmarks
cargo run --release --bin bench_industrial -- full --scale 200000

# Individual benchmark
cargo run --release --bin bench_industrial -- search-latency --scale 200000

# In Docker (500MB RAM / 2 CPU)
docker compose -f benchmarks/docker-compose.bench.yml up --build

Full results with charts: docs/benchmarks.md

Tests

231 tests — ALL PASSING

cargo test --lib          # 184 unit tests
cargo test --test integration_tests  # 47 integration tests

Architecture

┌───────────────────────────────┬─────────────┬─────────────┬──────────────────┐
│   HEBREW                      │    GREEK    │    GE'EZ    │   API (Axum)     │
├───────────────────────────────┴─────────────┴─────────────┴──────────────────┤
│  ReverseIndex                 │    Trie     │  BK-Tree    │  Cache 5 layers  │
├───────────────────────────────┴─────────────┴─────────────┬──────────────────┤
│  SQLite / PostgreSQL / MySQL  │  WAL        │  Snapshots  │                  │
└───────────────────────────────┴─────────────┴─────────────┴──────────────────┘

Documentation

File Content
docs/benchmarks.md Industrial benchmarks with charts
docs/architecture.md System architecture
docs/api.md REST API documentation
docs/data-model.md Data model
docs/engine-internals.md Engine internals
docs/configuration.md Configuration
docs/installation.md Installation
docs/testing.md Testing guide
docs/roadmap.md Roadmap
docs/contributing.md Contributing
docs/translation.md Translation system

License

MIT OR Apache-2.0

About

High-performance multilingual linguistic engine built in Rust with advanced search, lexical graphs, morphology, versioning, snapshots, auditing, and pluggable storage.

Topics

Resources

Contributing

Stars

1 star

Watchers

1 watching

Forks

Releases

Packages

Contributors

Languages