catchup: into main from long_lived/initial_datalayer @ cf34dfd8cd7d01f1f3e49df4173506c5ebbd716b - #1194

Closed

altendky wants to merge 469 commits into

mainfrom

catchup/main_from_long_lived_initial_datalayer_cf34dfd8cd7d01f1f3e49df4173506c5ebbd716b

This pull request is big! We're only showing the most recent 250 commits

Commits on Jan 8, 2025

Merge pull request #850 from Chia-Network/catchup/long_lived_initial_datalayer_from_main_ed05836d73c6e707b2b7d571f96d3b6ed603a27b
altendky
authored
00acff9

Commits on Jan 9, 2025

Commits on Jan 10, 2025

create a macro for existing thiserror exceptions
altendky
committed
7bd6a6d
and add python exceptions
altendky
committed
011a54a
and the .pyi
altendky
committed
687670f
black
altendky
committed
767fdf0
ban python `*` imports from `chia_rs.datalayer`
altendky
committed
63ecb26
eof eol
altendky
committed
3f059c2

Commits on Jan 13, 2025

Commits on Jan 16, 2025

Commits on Jan 17, 2025

Commits on Jan 21, 2025

Commits on Jan 22, 2025

Merge pull request #883 from Chia-Network/more_datalayer_types_python_constructable
altendky
authored
a748a83
Merge pull request #884 from Chia-Network/add_merkle_blob_upsert_for_python
altendky
authored
7ea8b8f
Merge pull request #882 from Chia-Network/add_merkle_get_keys_values
altendky
authored
0e93318
Merge branch 'long_lived/initial_datalayer' into add_merkle_blob_get_key_index
altendky
committed
2085ab6
update
altendky
committed
3d7cb4a
adjust code form
altendky
committed
e1d90ba
bump datalayer to match as 0.18.0
altendky
committed
b036eb0
Merge pull request #885 from Chia-Network/add_merkle_blob_get_key_index
altendky
authored
f199852
make key and value ids distinct
altendky
committed
7a5fcac
move all `use` to the top in datalayer
altendky
committed
11fd8d9
Merge branch 'long_lived/initial_datalayer' into key_and_value_ids_as_distinct
altendky
committed
51b6540
catchup
altendky
committed
5b3b826
Merge pull request #892 from Chia-Network/datalayer_to_0_18_0_for_alignment
altendky
authored
e9e721f
Merge pull request #893 from Chia-Network/key_and_value_ids_as_distinct
altendky
authored
5b1f07d
Merge pull request #894 from Chia-Network/all_use_at_top
altendky
authored
dfe7af4

Commits on Jan 23, 2025

use `derive` for `IntoPyObject` on newtypes
altendky
committed
2224d38
make `Parent` a newtype
altendky
committed
a8619c7
make `Hash` a newtype for consistency
altendky
committed
e6fba5d
update expet
altendky
committed
406cbdf
Merge pull request #897 from Chia-Network/use_derive_for_into_py_object_on_newtypes
altendky
authored
c8f5de1
Merge pull request #898 from Chia-Network/make_parent_a_newtype
altendky
authored
0549b09
Merge branch 'long_lived/initial_datalayer' into make_hash_a_newtype
altendky
committed
e22784e
more expect, less panic
altendky
committed
e12deaa

Commits on Jan 24, 2025

Commits on Jan 27, 2025

expose key and value ids as classes for python
altendky
committed
f4966c6

Commits on Jan 28, 2025

eq/frozen/hash
altendky
committed
8e4ade4
more
altendky
committed
458f928
fixup
altendky
committed
c46c5c1
...
altendky
committed
99bcf91
update `PyStreamable` to provide `IntoPyObject()`
altendky
committed
9d8b2cb
better
altendky
committed
e5baa6d
black
altendky
committed
e0a10f3
hack it up
altendky
committed
830011d

Commits on Jan 29, 2025

a bit
altendky
committed
ff15f45
tidy
altendky
committed
3190329

Commits on Feb 3, 2025

Commits on Feb 5, 2025

Commits on Feb 6, 2025

Update crates/chia-datalayer/src/merkle.rs
altendky
authored
40f24e4
fmt
altendky
committed
5a72d66
Merge pull request #906 from Chia-Network/expand_key_value_id_for_python
altendky
authored
7ad929d

Commits on Feb 10, 2025

make more datalayer streamable
altendky
committed
f3db76d

Commits on Feb 14, 2025

Commits on Feb 17, 2025

debug
altendky
committed
2c8bf66
remove debug
altendky
committed
7a9debe
hinting tweaks
altendky
committed
9db7ce3
fixup
altendky
committed
aac8299
handle todos
altendky
committed
fba6351
name test
altendky
committed
ee9585d

Commits on Feb 18, 2025

tidy
altendky
committed
d5846c0
Merge pull request #902 from Chia-Network/add_datalayer_proof_of_inclusion
altendky
authored
cbbfa26

Commits on Feb 19, 2025

add a few missing datalayer helpers for python
altendky
committed
1097cd1
report `chia_rs.datalayer` as the module for errors, not `chia_rs.chia_rs.datalayer`
altendky
committed
ddc2345
allow unused for now
altendky
committed
33ddee9
update stub
altendky
committed
3238404
Merge pull request #937 from Chia-Network/datalayer_error_module_reporting
altendky
authored
cddd30a
match python serialization for internal and leaf nodes
altendky
committed
59ccf97
match python leaf selection
altendky
committed
885585a
update test references
altendky
committed
a59de37
update test references
altendky
committed
e8601c6
clippy
altendky
committed
e708e16
Apply suggestions from code review

altendky
and
AmineKhaldi
authored
6e9398e
pub not unused
altendky
committed
4568738
Merge pull request #936 from Chia-Network/datalayer_helpers_for_python
altendky
authored
8acbf89
Update test_datalayer.py
altendky
authored
7d6f7c3
Merge pull request #939 from Chia-Network/datalayer_match_python_leaf_selection
altendky
authored
80dda07
Merge pull request #938 from Chia-Network/datalayer_match_python_serialization
altendky
authored
326e673

Commits on Feb 20, 2025

make `ProofOfInclusion` and `ProofOfInclusionLayer` py streamable
altendky
committed
802f6c8
update hints
altendky
committed
986ea56
oops
altendky
committed
2a0ccdb
Merge pull request #940 from Chia-Network/datalayer_pystreamable_for_ProofOfInclusion
altendky
authored
534439d
add `MerkleBlob.from_node_list()`
altendky
committed
1e5a809
pub
altendky
committed
bd27481
typo
altendky
committed
a19a9cf

Commits on Feb 21, 2025

fixup
altendky
committed
24cee1f
Merge pull request #941 from Chia-Network/datalayer_from_node_list
altendky
authored
da91206

Commits on Feb 26, 2025

Commits on Feb 27, 2025

copy over datalayer merkle blob tests from python (#961)
altendky
authored
e741146

Commits on Feb 28, 2025

Commits on Mar 4, 2025

Commits on Mar 5, 2025

datalayer fix unwritten nonfree indexes (#965)
altendky
authored
dd853ee

Commits on Mar 7, 2025

simplify datalayer block writing and caching (#983)
altendky
authored
e07771d
quiet an overly noisy datalayer test (#984)
altendky
authored
9136c4f

Commits on Mar 10, 2025

Commits on Mar 11, 2025

extract merkle blob caches (#981)
altendky
authored
770c8ad
prune traversal for `.calculate_lazy_hash()` (#987)
altendky
authored
d5525ee

Commits on Apr 5, 2025

Merge commit 'd5b1a2026f1d5a388ff11e93def1e09e8256b37e' into catchup/long_lived_initial_datalayer_from_main_d5b1a2026f1d5a388ff11e93def1e09e8256b37e
altendky
committed
7be37d1

Commits on Apr 7, 2025

Merge pull request #1015 from Chia-Network/catchup/long_lived_initial_datalayer_from_main_d5b1a2026f1d5a388ff11e93def1e09e8256b37e
altendky
authored
d64599e

Commits on Apr 12, 2025

Merge commit '57b1bb38a1033be8ee1c4f338f88b17fa78f4f71' into catchup/long_lived_initial_datalayer_from_main_57b1bb38a1033be8ee1c4f338f88b17fa78f4f71
altendky
committed
e618b24

Commits on Apr 14, 2025

Merge pull request #1024 from Chia-Network/catchup/long_lived_initial_datalayer_from_main_57b1bb38a1033be8ee1c4f338f88b17fa78f4f71
altendky
authored
cc662d4

Commits on Apr 15, 2025

Commits on Apr 16, 2025

Commits on Apr 17, 2025

Merge pull request #1029 from Chia-Network/catchup/long_lived_initial_datalayer_from_main_4eb3cf0e31658e8831aece561b02099dafc2790b
altendky
authored
3439097

Commits on Apr 18, 2025

fix `MerkleBlob.to_path()`
altendky
committed
ea32a3d
Merge pull request #1032 from Chia-Network/fix_merkle_blob_to_path
altendky
authored
23a2179

Commits on Apr 21, 2025

python interface is str but at least let pyo3 give rust a path
altendky
committed
12e2601
maybe get the rust to convert
altendky
committed
3c3fda3
and the pyi for pathlike
altendky
committed
628ed88
reorder
altendky
committed
c005df1

Commits on Apr 22, 2025

and class
altendky
committed
fd342b7
Merge pull request #1033 from Chia-Network/datalayer_take_actual_paths_directly
altendky
authored
4fe774f

Commits on Apr 28, 2025

move to single nodes map
altendky
committed
750896e

Commits on Apr 29, 2025

add parallelism
altendky
committed
5807845
huh
altendky
committed
ac2ccdc
hints
altendky
committed
432c839

Commits on May 1, 2025

more
altendky
committed
0c80e6c
hints again
altendky
committed
e8746a0

Commits on May 2, 2025

less extra work
altendky
committed
aa75dd1
tweak
altendky
committed
a0b62c3
go fast diff
altendky
committed
e4db8fd

Commits on May 5, 2025

cleaner conditional insert
altendky
committed
43636e6
more destructuring and thus names
altendky
committed
ccf14b1
Minor simplifications.
AmineKhaldi
committed
a6eae09

Commits on May 6, 2025

Merge pull request #1036 from Chia-Network/delta_reader_concurrency
altendky
authored
14cd095

Commits on May 7, 2025

tidy for datalayer
altendky
committed
8551ef8

Commits on May 8, 2025

Merge pull request #1048 from Chia-Network/datalayer_tidy
altendky
authored
a0c29d1
issue link
altendky
committed
5bb2e6b
retain original error instead of converting to string
altendky
committed
2c176c2
consider trusted mode considered
altendky
committed
0c01182
more todo consideration
altendky
committed
15c591b
rename
altendky
committed
c10d746
specific exceptions
altendky
committed
4e547f7
hints
altendky
committed
855f7b8

Commits on May 9, 2025

Merge pull request #1050 from Chia-Network/cleanup
altendky
authored
6fab2e3

Commits on May 12, 2025

more slice less vec
altendky
committed
912a532

Commits on May 13, 2025

Merge pull request #1054 from Chia-Network/more_slice_less_vec
altendky
authored
67dd3c5

Commits on May 14, 2025

todo tidy (#1056)
altendky
authored
cdb5cd7
avoid dump to disk and load and translate (#1040)
altendky
authored
6c41054
disable integrity check on drop at runtime (#1057)
altendky
authored
ed99f6e

Commits on May 16, 2025

add some more tests for datalayer (#1063)
altendky
authored
a7ca3f8

Commits on May 21, 2025

testing continues (#1070)
altendky
authored
75059b3

Commits on May 22, 2025

Commits on May 23, 2025

datalayer remove hex-literal dependency (#1080)
altendky
authored
a6d8f7a
datalayer to 0.23.0 to match (#1079)
altendky
authored
b3f039a

Commits on May 27, 2025

Commits on May 28, 2025

more testing, and small fixes (#1078)
altendky
authored
fe8002f

Commits on May 29, 2025

always again with the tests and tidying (#1092)
altendky
authored
151269e

Commits on May 30, 2025

move python error creation into a derive macro (#1098)
altendky
authored
5702927

Commits on Jun 2, 2025

use the `type`s for `::new()`, not just hints (#1099)
altendky
authored
92c7c0e

Commits on Jun 3, 2025

tidy datalayer versions (#1100)
altendky
authored
346403b

Commits on Jun 7, 2025

Add DeltaFileCache. (#1075)

fchirica
and
altendky
authored
281ec64

Commits on Jun 13, 2025

add missing test return hint (#1115)
altendky
authored
4c8f994
make `TreeIndexType` and `TreeIndex.0` public (#1114)
altendky
authored
b751609
extract datalayer iterators to separate file (#1116)
altendky
authored
ae636d6

Commits on Jun 16, 2025

extract datalayer merkle blob serialization format to separate file (#1117)
altendky
authored
a826e1b

Commits on Jun 17, 2025

extract datalayer merkle blob proof of inclusion to separate file (#1118)
altendky
authored
87acefa

Commits on Jun 20, 2025

Commits on Jun 23, 2025

Merge commit 'fa00dfc0bf775daced289df339236795a6b8a5c2' into catchup/long_lived_initial_datalayer_from_0_25_0_ref_fa00dfc0bf775daced289df339236795a6b8a5c2
altendky
committed
f5061e9

Commits on Jun 26, 2025

Merge pull request #1128 from Chia-Network/catchup/long_lived_initial_datalayer_from_main_48cb10bb6d3c9eb4dc12208a78e28701635c17a8
altendky
authored
460df5d

Commits on Jun 27, 2025

move `chia_datalayer::merkle` code into `chia_datalayer::merkle::blob` (#1124)
altendky
authored
2b7c693

Commits on Jul 8, 2025

Commits on Jul 10, 2025

simplify `MerkleBlob::build_blob_from_node_list()` public interface (#1142)
altendky
authored
c417068

Commits on Jul 11, 2025

Merge commit '061bd6e192ceb90e3bb81ceff1fc69d674626eb7' into catchup/long_lived_initial_datalayer_from_main_061bd6e192ceb90e3bb81ceff1fc69d674626eb7
altendky
committed
b2a99ae

Commits on Jul 12, 2025

Merge pull request #1153 from Chia-Network/catchup/long_lived_initial_datalayer_from_main_061bd6e192ceb90e3bb81ceff1fc69d674626eb7
altendky
authored
0ded723

Commits on Jul 15, 2025

Check root hash in get_missing_hashes. (#1147)
fchirica
authored
ca58fd4

Commits on Jul 17, 2025

datalayer to 0.27.0 to match (#1155)
altendky
authored
db96245
add more fuzzing for datalayer (#1146)

altendky
and
arvidn
authored
2780b88

Commits on Jul 22, 2025

Commits on Jul 23, 2025

indexset (#1164)
altendky
authored
084bc1c
Update Cargo.toml (#1166)
altendky
authored
3a382de

Commits on Jul 25, 2025

Commits on Jul 28, 2025

Commits on Jul 29, 2025

datalayer to 0.28.1 to match (#1179)
altendky
authored
30518e2

Commits on Aug 3, 2025

Merge commit '7dd252c4cc3a0660bccdc9fdb1b92d7f43a32475' into catchup/long_lived_initial_datalayer_from_main_7dd252c4cc3a0660bccdc9fdb1b92d7f43a32475
altendky
committed
10748ca

Commits on Aug 5, 2025