Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
59 commits
Select commit Hold shift + click to select a range
aeefb6c
Unify data directory config and add Variant INSERT support
tonyalaribe Jan 31, 2026
c8eb41c
Add Variant SELECT rewriter and comprehensive architecture docs
tonyalaribe Feb 1, 2026
940b76f
Fix COUNT(*) and aggregation queries failing on empty projections
tonyalaribe Feb 2, 2026
bf29ef3
Add retry and timeout config to S3 object store
tonyalaribe Feb 2, 2026
f68ab0f
Fix correctness bugs and add performance optimizations
tonyalaribe Feb 16, 2026
81cf1ff
Switch WAL to Arrow IPC format, add flush compaction and configurable…
tonyalaribe Feb 16, 2026
be46a8f
Optimize read perf 70-89%, fix write regressions, add benchmarks
tonyalaribe Feb 16, 2026
057b262
x
tonyalaribe Feb 16, 2026
90a4eef
optimization attempt
tonyalaribe Feb 20, 2026
3fe349a
make fmt
tonyalaribe Feb 20, 2026
f37e05e
Fix Docker build failure due to missing bench file
tonyalaribe Feb 20, 2026
c618bd9
Migrate to delta-rs PR #4325 (variant type support) + dep upgrades
tonyalaribe May 13, 2026
d563fb2
Add tantivy sidecar, gRPC ingest, plan cache, stats table; skip Delta…
tonyalaribe May 18, 2026
f40626a
Tiered parquet compression with per-column bloom filters and daily re…
tonyalaribe May 26, 2026
f5216d8
Auto-tune host-aware sizing, OTel metrics, WAL corruption quarantine
tonyalaribe May 26, 2026
c160e4f
Transparent Tantivy: always-on indexing + predicate rewriter
tonyalaribe May 26, 2026
ab9da03
Tantivy n-gram tokenizer + LIKE/ILIKE substring acceleration
tonyalaribe May 26, 2026
21001b3
In-memory tantivy per MemBuffer bucket — close the indexing-lag gap
tonyalaribe May 26, 2026
cf3382c
Fix race in MemBuffer text-match prefilter
tonyalaribe May 26, 2026
51f8b9e
Production hardening: fail-secure auth, durable DML, quarantine perms…
tonyalaribe May 26, 2026
d16cffd
GA hardening: gRPC graceful shutdown, per-project metrics, LRU eviction
tonyalaribe May 26, 2026
c53d66c
Add RUNBOOK.md — production operations playbook
tonyalaribe May 26, 2026
33214b2
fix(grpc): constant-time bearer token comparison
tonyalaribe May 26, 2026
1693cc7
fix(wal): doc version mismatch, surface upgrade errors, typed shards …
tonyalaribe May 26, 2026
c2dff5d
perf+cleanup: cache indexed_tables, expect-on-guarded-downcasts, doc …
tonyalaribe May 26, 2026
819f82c
ci: install protoc, use nightly rustfmt, fix Dockerfile bench dummies
tonyalaribe May 26, 2026
347fb82
ci+review: green CI on PR #16 and address claude-review feedback
tonyalaribe May 26, 2026
b603450
ci(docker): bump builder rust to 1.91 (was 1.89, breaks on AWS SDK deps)
tonyalaribe May 26, 2026
8ea025b
test: bump test_concurrent_writes_same_project timeout 60s → 180s
tonyalaribe May 26, 2026
8dc6fa5
perf+review: TTL the storage_configs reload; drop cold-table update_s…
tonyalaribe May 26, 2026
ada096a
test: bump remaining Database+MinIO concurrency-test timeouts 60s → 180s
tonyalaribe May 26, 2026
5acbeab
review+ci: TOCTOU fix in dml, perf cleanups, skip CI-wedging concurre…
tonyalaribe May 27, 2026
8a3a794
fix+test: keep cold-table update_state refresh; ignore both-legs-writ…
tonyalaribe May 27, 2026
5d741ed
review: fix VariantSelectRewriter doc/code contradiction; document is…
tonyalaribe May 27, 2026
4659c7c
test: ignore delta_rs_api integration tests that wedge on shared Once…
tonyalaribe May 27, 2026
9aaebcd
fix: text_match UDF wildcard stripping; SLT cleanup + claude-review
tonyalaribe May 27, 2026
2b46739
test: ignore mixed_membuffer_and_delta_level_eq_returns_union
tonyalaribe May 27, 2026
ac11853
fix(wal): deterministic FNV-1a shard hashing; review cleanups
tonyalaribe May 27, 2026
48a2d2f
doctest: tag mem_index ASCII-art block as text fence
tonyalaribe May 27, 2026
44450be
review: union-arm note, project_id fallback warn!, ts-tz Result, refa…
tonyalaribe May 27, 2026
1269591
review: refresh on (None,Some); warn on insert_coerce skip; tighten p…
tonyalaribe May 27, 2026
dcf048e
review: warn-on-unwrapped Variant, parking_lot mutex, FNV golden test…
tonyalaribe May 27, 2026
44b4da1
review: actionability + intent comments
tonyalaribe May 27, 2026
fda60e5
review: tracing::warn (not log::warn), comment fixes, dml plan warn
tonyalaribe May 27, 2026
e56b242
review: warn at MAX_PEEL exhaustion; build_storage_options info→debug
tonyalaribe May 27, 2026
e639e7a
review: redact StorageConfig credentials; rename HARD_LIMIT divisor
tonyalaribe May 27, 2026
a543ab6
fix(variant): Postgres ->> text semantics; re-enable variant_function…
tonyalaribe May 27, 2026
06fdca4
fix(variant): peel through Filter; document plan_cache schema invariant
tonyalaribe May 27, 2026
caa7cf6
review: redact Serialize creds, log spam, cheaper plan-cache check, docs
tonyalaribe May 27, 2026
fe4684b
simplify: consolidate extract_project_id, tighten JsonToPgTextUdf, &'…
tonyalaribe May 27, 2026
421b343
fix(clippy): drop needless borrow after indexed_columns_for &'static …
tonyalaribe May 27, 2026
d5da777
fix(variant): hard-error on raw-binary-on-wire Union/Aggregate root
tonyalaribe May 27, 2026
de28fe5
fmt: nightly rustfmt rewrap on variant_select_rewriter test module
tonyalaribe May 27, 2026
c08ed59
test: ignore test_variant_column_round_trips_as_json pending extensio…
tonyalaribe May 27, 2026
a9892ac
fix(variant): branch-aware root wrap — add a Projection above un-peel…
tonyalaribe May 27, 2026
1ae4e37
address PR review: variant naming, dml laziness, fast-path docs
tonyalaribe May 27, 2026
1d7b84a
fix(variant-insert): hard-error unsupported INSERT shapes at plan time
tonyalaribe May 27, 2026
9a89628
fix(variant): re-stamp extension marker at UDF entry; recompute schem…
tonyalaribe May 27, 2026
b881d52
fmt: nightly rustfmt rewrap
tonyalaribe May 27, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions .env.example
Original file line number Diff line number Diff line change
Expand Up @@ -51,3 +51,6 @@ OTEL_EXPORTER_OTLP_PROTOCOL=grpc
OTEL_EXPORTER_OTLP_HEADERS=
# Optional: Enable/disable tracing (default: true)
OTEL_SDK_DISABLED=false

# Data Directory (WAL stored in {dir}/wal, cache in {dir}/cache)
TIMEFUSION_DATA_DIR=./data
2 changes: 1 addition & 1 deletion .env.minio
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ MAX_PG_CONNECTIONS=100
AWS_S3_LOCKING_PROVIDER=""

# WAL storage directory for walrus-rust
WALRUS_DATA_DIR=/tmp/walrus-wal
TIMEFUSION_DATA_DIR=./data/minio

# Foyer cache configuration for tests
TIMEFUSION_FOYER_MEMORY_MB=256
Expand Down
2 changes: 1 addition & 1 deletion .env.test
Original file line number Diff line number Diff line change
Expand Up @@ -39,7 +39,7 @@ TIMEFUSION_VACUUM_RETENTION_HOURS=1
TIMEFUSION_FOYER_MEMORY_MB=64
TIMEFUSION_FOYER_DISK_GB=1
TIMEFUSION_FOYER_TTL_SECONDS=60
TIMEFUSION_FOYER_CACHE_DIR=/tmp/timefusion_test_cache
TIMEFUSION_DATA_DIR=./data/test
TIMEFUSION_FOYER_SHARDS=4
TIMEFUSION_FOYER_FILE_SIZE_MB=8
TIMEFUSION_FOYER_STATS=true
Expand Down
16 changes: 14 additions & 2 deletions .github/workflows/ci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -16,10 +16,16 @@ jobs:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v4
- uses: dtolnay/rust-toolchain@stable
# rustfmt.toml uses nightly-only options (wrap_comments, imports_granularity,
# group_imports, format_code_in_doc_comments, normalize_doc_attributes,
# empty_item_single_line, struct_field_align_threshold). Stable fmt
# silently drops them and reformats differently → CI mismatch.
# rust-toolchain.toml pins to stable, so install nightly *and* invoke it
# explicitly with `+nightly` so cargo doesn't fall back to the pinned channel.
- uses: dtolnay/rust-toolchain@nightly
with:
components: rustfmt
- run: cargo fmt --all --check
- run: cargo +nightly fmt --all --check

clippy:
name: Clippy
Expand All @@ -29,6 +35,8 @@ jobs:
- uses: dtolnay/rust-toolchain@stable
with:
components: clippy
- name: Install protoc
run: sudo apt-get update && sudo apt-get install -y protobuf-compiler
- uses: Swatinem/rust-cache@v2
- run: cargo clippy --all-targets --all-features -- -D warnings

Expand All @@ -38,6 +46,8 @@ jobs:
steps:
- uses: actions/checkout@v4
- uses: dtolnay/rust-toolchain@stable
- name: Install protoc
run: sudo apt-get update && sudo apt-get install -y protobuf-compiler
- uses: Swatinem/rust-cache@v2
- run: cargo check --all-targets --all-features

Expand Down Expand Up @@ -88,6 +98,8 @@ jobs:
run: sudo rm -rf /usr/share/dotnet /usr/local/lib/android /opt/ghc /opt/hostedtoolcache/CodeQL
- uses: actions/checkout@v4
- uses: dtolnay/rust-toolchain@stable
- name: Install protoc
run: sudo apt-get install -y protobuf-compiler
- uses: Swatinem/rust-cache@v2

- name: Run all tests
Expand Down
Loading
Loading