Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

perf: make BTreeMap V2 2-4x more officient #118

Merged
merged 29 commits into from
Sep 5, 2023
Merged

perf: make BTreeMap V2 2-4x more officient #118

merged 29 commits into from
Sep 5, 2023

Conversation

ielashi
Copy link
Contributor

@ielashi ielashi commented Aug 30, 2023 •
edited
Loading

A number of optimizations are made to make BTreeMap V2 more efficient. The optimizations in this commit are focused on loading the BTree node faster, specifically:

  1. Rather than loading all the pages of a node into one large buffer on the heap, a NodeReader is introduced to read the data from stable memory directly, avoiding allocating large vectors on the heap.
  2. Values are loaded lazily as needed.

V2 is still quite a bit slower than V1, but more performance optimizations will be made in subsequent commits to narrow that gap.

Benchmark results:

Benchmarking btreemap_insert_blob_4_1024: Warming up for 1.0000 ms
2023-08-30 13:29:46.909777 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "280_652_463 (28%)",
    "node_save_v1": "378_779_478 (38%)",
}

btreemap_insert_blob_4_1024
                        time:   [990.56 M Instructions 990.56 M Instructions 990.56 M Instructions]
                        change: [+1.9882% +1.9882% +1.9882%] (p = 0.00 < 0.05)
                        Performance has regressed.

Benchmarking btreemap_insert_blob_4_1024_v2: Warming up for 1.0000 ms
2023-08-30 13:29:48.438599 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "481_365_503 (29%)",
    "node_save_v2": "791_766_971 (49%)",
}

btreemap_insert_blob_4_1024_v2
                        time:   [1614.0 M Instructions 1614.0 M Instructions 1614.0 M Instructions]
                        change: [-68.528% -68.528% -68.528%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_insert_blob_8_1024: Warming up for 1.0000 ms
2023-08-30 13:29:50.215987 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "321_869_274 (28%)",
    "node_save_v1": "403_084_516 (35%)",
}

btreemap_insert_blob_8_1024
                        time:   [1138.0 M Instructions 1138.0 M Instructions 1138.0 M Instructions]
                        change: [+1.8644% +1.8644% +1.8644%] (p = 0.00 < 0.05)
                        Performance has regressed.

Benchmarking btreemap_insert_blob_8_1024_v2: Warming up for 1.0000 ms
2023-08-30 13:29:51.688200 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "537_284_069 (29%)",
    "node_save_v2": "855_112_095 (47%)",
}

btreemap_insert_blob_8_1024_v2
                        time:   [1814.0 M Instructions 1814.0 M Instructions 1814.0 M Instructions]
                        change: [-67.519% -67.519% -67.519%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_insert_blob_16_1024: Warming up for 1.0000 ms
2023-08-30 13:29:53.364102 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "402_518_468 (32%)",
    "node_save_v1": "412_099_008 (33%)",
}

btreemap_insert_blob_16_1024
                        time:   [1234.1 M Instructions 1234.1 M Instructions 1234.1 M Instructions]
                        change: [+1.7602% +1.7602% +1.7602%] (p = 0.00 < 0.05)
                        Performance has regressed.

Benchmarking btreemap_insert_blob_16_1024_v2: Warming up for 1.0000 ms
2023-08-30 13:29:54.959311 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "637_871_422 (32%)",
    "node_save_v2": "888_925_546 (45%)",
}

btreemap_insert_blob_16_1024_v2
                        time:   [1956.2 M Instructions 1956.2 M Instructions 1956.2 M Instructions]
                        change: [-65.588% -65.588% -65.588%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_insert_blob_32_1024: Warming up for 1.0000 ms
2023-08-30 13:29:56.710154 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "424_603_999 (33%)",
    "node_save_v1": "424_724_582 (33%)",
}

btreemap_insert_blob_32_1024
                        time:   [1275.2 M Instructions 1275.2 M Instructions 1275.2 M Instructions]
                        change: [+1.7279% +1.7279% +1.7279%] (p = 0.00 < 0.05)
                        Performance has regressed.

Benchmarking btreemap_insert_blob_32_1024_v2: Warming up for 1.0000 ms
2023-08-30 13:29:58.173915 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "674_211_795 (33%)",
    "node_save_v2": "924_055_955 (45%)",
}

btreemap_insert_blob_32_1024_v2
                        time:   [2026.7 M Instructions 2026.7 M Instructions 2026.7 M Instructions]
                        change: [-65.556% -65.556% -65.556%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_insert_blob_64_1024: Warming up for 1.0000 ms
2023-08-30 13:29:59.850203 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "629_811_234 (41%)",
    "node_save_v1": "427_562_314 (28%)",
}

btreemap_insert_blob_64_1024
                        time:   [1515.3 M Instructions 1515.3 M Instructions 1515.3 M Instructions]
                        change: [+1.4626% +1.4626% +1.4626%] (p = 0.00 < 0.05)
                        Performance has regressed.

Benchmarking btreemap_insert_blob_64_1024_v2: Warming up for 1.0000 ms
2023-08-30 13:30:01.464917 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "902_108_118 (38%)",
    "node_save_v2": "945_427_084 (40%)",
}

btreemap_insert_blob_64_1024_v2
                        time:   [2319.5 M Instructions 2319.5 M Instructions 2319.5 M Instructions]
                        change: [-64.179% -64.179% -64.179%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_insert_blob_128_1024: Warming up for 1.0000 ms
2023-08-30 13:30:03.336015 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "854_194_111 (47%)",
    "node_save_v1": "433_551_383 (24%)",
}

btreemap_insert_blob_128_1024
                        time:   [1782.9 M Instructions 1782.9 M Instructions 1782.9 M Instructions]
                        change: [+1.2385% +1.2385% +1.2385%] (p = 0.00 < 0.05)
                        Performance has regressed.

Benchmarking btreemap_insert_blob_128_1024_v2: Warming up for 1.0000 ms
2023-08-30 13:30:04.979043 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "1_181_808_096 (43%)",
    "node_save_v2": "982_453_230 (36%)",
}

btreemap_insert_blob_128_1024_v2
                        time:   [2692.3 M Instructions 2692.3 M Instructions 2692.3 M Instructions]
                        change: [-61.894% -61.894% -61.894%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_insert_blob_256_1024: Warming up for 1.0000 ms
2023-08-30 13:30:06.986058 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "1_308_925_598 (56%)",
    "node_save_v1": "439_263_956 (19%)",
}

btreemap_insert_blob_256_1024
                        time:   [2311.2 M Instructions 2311.2 M Instructions 2311.2 M Instructions]
                        change: [+0.9550% +0.9550% +0.9550%] (p = 0.00 < 0.05)
                        Change within noise threshold.

Benchmarking btreemap_insert_blob_256_1024_v2: Warming up for 1.0000 ms
2023-08-30 13:30:08.887031 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "1_702_828_360 (50%)",
    "node_save_v2": "1_030_215_378 (30%)",
}

btreemap_insert_blob_256_1024_v2
                        time:   [3360.7 M Instructions 3360.7 M Instructions 3360.7 M Instructions]
                        change: [-56.725% -56.725% -56.725%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_insert_blob_512_1024: Warming up for 1.0000 ms
2023-08-30 13:30:10.913146 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "2_198_537_195 (65%)",
    "node_save_v1": "455_605_397 (13%)",
}

btreemap_insert_blob_512_1024
                        time:   [3362.4 M Instructions 3362.4 M Instructions 3362.4 M Instructions]
                        change: [+0.6560% +0.6560% +0.6560%] (p = 0.00 < 0.05)
                        Change within noise threshold.

Benchmarking btreemap_insert_blob_512_1024_v2: Warming up for 1.0000 ms
2023-08-30 13:30:12.802118 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "2_654_333_483 (58%)",
    "node_save_v2": "1_148_060_652 (25%)",
}

btreemap_insert_blob_512_1024_v2
                        time:   [4530.6 M Instructions 4530.6 M Instructions 4530.6 M Instructions]
                        change: [-53.664% -53.664% -53.664%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_insert_u64_u64: Warming up for 1.0000 ms
2023-08-30 13:30:14.988104 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "306_179_398 (35%)",
    "node_save_v1": "306_699_642 (35%)",
}

btreemap_insert_u64_u64 time:   [858.23 M Instructions 858.23 M Instructions 858.23 M Instructions]
                        change: [+2.6280% +2.6280% +2.6280%] (p = 0.00 < 0.05)
                        Performance has regressed.

Benchmarking btreemap_insert_u64_u64_v2: Warming up for 1.0000 ms
2023-08-30 13:30:16.220958 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "385_750_590 (39%)",
    "node_save_v2": "340_931_881 (35%)",
}

btreemap_insert_u64_u64_v2
                        time:   [967.61 M Instructions 967.61 M Instructions 967.61 M Instructions]
                        change: [-22.690% -22.690% -22.690%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_insert_u64_blob_8: Warming up for 1.0000 ms
2023-08-30 13:30:17.437455 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "308_458_700 (37%)",
    "node_save_v1": "293_871_277 (35%)",
}

btreemap_insert_u64_blob_8
                        time:   [831.41 M Instructions 831.41 M Instructions 831.41 M Instructions]
                        change: [+2.7028% +2.7028% +2.7028%] (p = 0.00 < 0.05)
                        Performance has regressed.

Benchmarking btreemap_insert_u64_blob_8_v2: Warming up for 1.0000 ms
2023-08-30 13:30:18.704157 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "384_546_931 (41%)",
    "node_save_v2": "313_996_501 (34%)",
}

btreemap_insert_u64_blob_8_v2
                        time:   [923.47 M Instructions 923.47 M Instructions 923.47 M Instructions]
                        change: [-22.231% -22.231% -22.231%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_insert_blob_8_u64: Warming up for 1.0000 ms
2023-08-30 13:30:19.847856 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "310_026_924 (41%)",
    "node_save_v1": "201_763_446 (27%)",
}

btreemap_insert_blob_8_u64
                        time:   [740.28 M Instructions 740.28 M Instructions 740.28 M Instructions]
                        change: [+2.8877% +2.8877% +2.8877%] (p = 0.00 < 0.05)
                        Performance has regressed.

Benchmarking btreemap_insert_blob_8_u64_v2: Warming up for 1.0000 ms
2023-08-30 13:30:21.137105 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "387_941_334 (45%)",
    "node_save_v2": "247_665_634 (28%)",
}

btreemap_insert_blob_8_u64_v2
                        time:   [860.71 M Instructions 860.71 M Instructions 860.71 M Instructions]
                        change: [-25.356% -25.356% -25.356%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_get_blob_4_1024: Warming up for 1.0000 ms
2023-08-30 13:30:22.382634 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "293_795_450 (66%)",
}

btreemap_get_blob_4_1024
                        time:   [442.36 M Instructions 442.36 M Instructions 442.36 M Instructions]
                        change: [+1.6646% +1.6646% +1.6646%] (p = 0.00 < 0.05)
                        Performance has regressed.

Benchmarking btreemap_get_blob_4_1024_v2: Warming up for 1.0000 ms
2023-08-30 13:30:24.092106 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "516_995_139 (74%)",
}

btreemap_get_blob_4_1024_v2
                        time:   [692.81 M Instructions 692.81 M Instructions 692.81 M Instructions]
                        change: [-86.187% -86.187% -86.187%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_get_blob_8_1024: Warming up for 1.0000 ms
2023-08-30 13:30:26.077776 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "344_728_885 (66%)",
}

btreemap_get_blob_8_1024
                        time:   [520.76 M Instructions 520.76 M Instructions 520.76 M Instructions]
                        change: [+1.6751% +1.6751% +1.6751%] (p = 0.00 < 0.05)
                        Performance has regressed.

Benchmarking btreemap_get_blob_8_1024_v2: Warming up for 1.0000 ms
2023-08-30 13:30:27.766904 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "547_592_745 (72%)",
}

btreemap_get_blob_8_1024_v2
                        time:   [751.56 M Instructions 751.56 M Instructions 751.56 M Instructions]
                        change: [-83.628% -83.628% -83.628%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_get_blob_16_1024: Warming up for 1.0000 ms
2023-08-30 13:30:29.675098 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "425_809_809 (70%)",
}

btreemap_get_blob_16_1024
                        time:   [602.40 M Instructions 602.40 M Instructions 602.40 M Instructions]
                        change: [+1.4532% +1.4532% +1.4532%] (p = 0.00 < 0.05)
                        Performance has regressed.

Benchmarking btreemap_get_blob_16_1024_v2: Warming up for 1.0000 ms
2023-08-30 13:30:31.443236 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "646_405_838 (76%)",
}

btreemap_get_blob_16_1024_v2
                        time:   [845.21 M Instructions 845.21 M Instructions 845.21 M Instructions]
                        change: [-81.786% -81.786% -81.786%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_get_blob_32_1024: Warming up for 1.0000 ms
2023-08-30 13:30:33.485992 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "444_926_271 (70%)",
}

btreemap_get_blob_32_1024
                        time:   [632.59 M Instructions 632.59 M Instructions 632.59 M Instructions]
                        change: [+1.3882% +1.3882% +1.3882%] (p = 0.00 < 0.05)
                        Performance has regressed.

Benchmarking btreemap_get_blob_32_1024_v2: Warming up for 1.0000 ms
2023-08-30 13:30:35.328321 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "683_036_393 (76%)",
}

btreemap_get_blob_32_1024_v2
                        time:   [893.12 M Instructions 893.12 M Instructions 893.12 M Instructions]
                        change: [-82.432% -82.432% -82.432%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_get_blob_64_1024: Warming up for 1.0000 ms
2023-08-30 13:30:37.364 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "663_035_945 (77%)",
}

btreemap_get_blob_64_1024
                        time:   [856.36 M Instructions 856.36 M Instructions 856.36 M Instructions]
                        change: [+1.0251% +1.0251% +1.0251%] (p = 0.00 < 0.05)
                        Performance has regressed.

Benchmarking btreemap_get_blob_64_1024_v2: Warming up for 1.0000 ms
2023-08-30 13:30:39.182974 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "906_869_057 (80%)",
}

btreemap_get_blob_64_1024_v2
                        time:   [1127.3 M Instructions 1127.3 M Instructions 1127.3 M Instructions]
                        change: [-79.477% -79.477% -79.477%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_get_blob_128_1024: Warming up for 1.0000 ms
2023-08-30 13:30:41.276889 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "875_716_723 (81%)",
}

btreemap_get_blob_128_1024
                        time:   [1078.9 M Instructions 1078.9 M Instructions 1078.9 M Instructions]
                        change: [+0.8112% +0.8112% +0.8112%] (p = 0.00 < 0.05)
                        Change within noise threshold.

Benchmarking btreemap_get_blob_128_1024_v2: Warming up for 1.0000 ms
2023-08-30 13:30:43.159713 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "1_199_414_614 (83%)",
}

btreemap_get_blob_128_1024_v2
                        time:   [1434.3 M Instructions 1434.3 M Instructions 1434.3 M Instructions]
                        change: [-76.011% -76.011% -76.011%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_get_u64_u64: Warming up for 1.0000 ms
2023-08-30 13:30:45.459040 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "323_182_267 (71%)",
}

btreemap_get_u64_u64    time:   [450.17 M Instructions 450.17 M Instructions 450.17 M Instructions]
                        change: [+2.0779% +2.0779% +2.0779%] (p = 0.00 < 0.05)
                        Performance has regressed.

Benchmarking btreemap_get_u64_u64_v2: Warming up for 1.0000 ms
2023-08-30 13:30:46.922949 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "403_618_361 (75%)",
}

btreemap_get_u64_u64_v2 time:   [536.77 M Instructions 536.77 M Instructions 536.77 M Instructions]
                        change: [-41.792% -41.792% -41.792%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_get_u64_blob_8: Warming up for 1.0000 ms
2023-08-30 13:30:48.352277 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "324_661_032 (72%)",
}

btreemap_get_u64_blob_8 time:   [446.62 M Instructions 446.62 M Instructions 446.62 M Instructions]
                        change: [+2.0957% +2.0957% +2.0957%] (p = 0.00 < 0.05)
                        Performance has regressed.

Benchmarking btreemap_get_u64_blob_8_v2: Warming up for 1.0000 ms
2023-08-30 13:30:49.904282 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "405_206_697 (76%)",
}

btreemap_get_u64_blob_8_v2
                        time:   [531.93 M Instructions 531.93 M Instructions 531.93 M Instructions]
                        change: [-39.188% -39.188% -39.188%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_get_blob_8_u64: Warming up for 1.0000 ms
2023-08-30 13:30:51.503835 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "327_829_305 (70%)",
}

btreemap_get_blob_8_u64 time:   [464.82 M Instructions 464.82 M Instructions 464.82 M Instructions]
                        change: [+1.8812% +1.8812% +1.8812%] (p = 0.00 < 0.05)
                        Performance has regressed.

Benchmarking btreemap_get_blob_8_u64_v2: Warming up for 1.0000 ms
2023-08-30 13:30:52.976112 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "405_354_044 (74%)",
}

btreemap_get_blob_8_u64_v2
                        time:   [547.72 M Instructions 547.72 M Instructions 547.72 M Instructions]
                        change: [-44.544% -44.544% -44.544%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_get_blob_256_1024: Warming up for 1.0000 ms
2023-08-30 13:30:54.527343 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "1_339_890_114 (85%)",
}

btreemap_get_blob_256_1024
                        time:   [1568.1 M Instructions 1568.1 M Instructions 1568.1 M Instructions]
                        change: [+0.5572% +0.5572% +0.5572%] (p = 0.00 < 0.05)
                        Change within noise threshold.

Benchmarking btreemap_get_blob_256_1024_v2: Warming up for 1.0000 ms
2023-08-30 13:30:56.610064 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "1_724_578_760 (86%)",
}

btreemap_get_blob_256_1024_v2
                        time:   [1986.7 M Instructions 1986.7 M Instructions 1986.7 M Instructions]
                        change: [-70.236% -70.236% -70.236%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_get_blob_512_1024: Warming up for 1.0000 ms
2023-08-30 13:30:59.349144 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "2_257_152_362 (89%)",
}

btreemap_get_blob_512_1024
                        time:   [2533.8 M Instructions 2533.8 M Instructions 2533.8 M Instructions]
                        change: [+0.3442% +0.3442% +0.3442%] (p = 0.00 < 0.05)
                        Change within noise threshold.

Benchmarking btreemap_get_blob_512_1024_v2: Warming up for 1.0000 ms
2023-08-30 13:31:01.885678 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "2_704_747_759 (89%)",
}

btreemap_get_blob_512_1024_v2
                        time:   [3015.4 M Instructions 3015.4 M Instructions 3015.4 M Instructions]
                        change: [-63.826% -63.826% -63.826%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_remove_blob_4_1024: Warming up for 1.0000 ms
2023-08-30 13:31:04.819011 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "307_574_353 (28%)",
    "node_save_v1": "429_262_724 (39%)",
}

btreemap_remove_blob_4_1024
                        time:   [1078.5 M Instructions 1078.5 M Instructions 1078.5 M Instructions]
                        change: [+2.1824% +2.1824% +2.1824%] (p = 0.00 < 0.05)
                        Performance has regressed.

Benchmarking btreemap_remove_blob_4_1024_v2: Warming up for 1.0000 ms
2023-08-30 13:31:06.686165 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "525_286_266 (29%)",
    "node_save_v2": "919_507_893 (51%)",
}

btreemap_remove_blob_4_1024_v2
                        time:   [1801.4 M Instructions 1801.4 M Instructions 1801.4 M Instructions]
                        change: [+70.677% +70.677% +70.677%] (p = 0.00 < 0.05)
                        Performance has regressed.

Benchmarking btreemap_remove_blob_8_1024: Warming up for 1.0000 ms
2023-08-30 13:31:08.892916 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "367_298_948 (26%)",
    "node_save_v1": "571_957_965 (41%)",
}

btreemap_remove_blob_8_1024
                        time:   [1381.6 M Instructions 1381.6 M Instructions 1381.6 M Instructions]
                        change: [+2.1607% +2.1607% +2.1607%] (p = 0.00 < 0.05)
                        Performance has regressed.

Benchmarking btreemap_remove_blob_8_1024_v2: Warming up for 1.0000 ms
2023-08-30 13:31:10.856298 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "592_297_067 (25%)",
    "node_save_v2": "1_246_294_503 (54%)",
}

btreemap_remove_blob_8_1024_v2
                        time:   [2295.8 M Instructions 2295.8 M Instructions 2295.8 M Instructions]
                        change: [+69.760% +69.760% +69.760%] (p = 0.00 < 0.05)
                        Performance has regressed.

Benchmarking btreemap_remove_blob_16_1024: Warming up for 1.0000 ms
2023-08-30 13:31:13.179670 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "465_498_356 (28%)",
    "node_save_v1": "665_431_027 (40%)",
}

btreemap_remove_blob_16_1024
                        time:   [1635.0 M Instructions 1635.0 M Instructions 1635.0 M Instructions]
                        change: [+2.0421% +2.0421% +2.0421%] (p = 0.00 < 0.05)
                        Performance has regressed.

Benchmarking btreemap_remove_blob_16_1024_v2: Warming up for 1.0000 ms
2023-08-30 13:31:15.202687 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "731_192_668 (26%)",
    "node_save_v2": "1_479_786_407 (54%)",
}

btreemap_remove_blob_16_1024_v2
                        time:   [2730.8 M Instructions 2730.8 M Instructions 2730.8 M Instructions]
                        change: [-61.379% -61.379% -61.379%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_remove_blob_32_1024: Warming up for 1.0000 ms
2023-08-30 13:31:17.763538 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "483_509_883 (28%)",
    "node_save_v1": "692_337_702 (40%)",
}

btreemap_remove_blob_32_1024
                        time:   [1709.2 M Instructions 1709.2 M Instructions 1709.2 M Instructions]
                        change: [+2.0117% +2.0117% +2.0117%] (p = 0.00 < 0.05)
                        Performance has regressed.

Benchmarking btreemap_remove_blob_32_1024_v2: Warming up for 1.0000 ms
2023-08-30 13:31:19.793330 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "771_502_103 (26%)",
    "node_save_v2": "1_542_745_873 (53%)",
}

btreemap_remove_blob_32_1024_v2
                        time:   [2863.0 M Instructions 2863.0 M Instructions 2863.0 M Instructions]
                        change: [-61.242% -61.242% -61.242%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_remove_blob_64_1024: Warming up for 1.0000 ms
2023-08-30 13:31:22.346099 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "713_539_284 (35%)",
    "node_save_v1": "711_906_437 (35%)",
}

btreemap_remove_blob_64_1024
                        time:   [2002.9 M Instructions 2002.9 M Instructions 2002.9 M Instructions]
                        change: [+1.7442% +1.7442% +1.7442%] (p = 0.00 < 0.05)
                        Performance has regressed.

Benchmarking btreemap_remove_blob_64_1024_v2: Warming up for 1.0000 ms
2023-08-30 13:31:24.525138 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "1_005_955_971 (31%)",
    "node_save_v2": "1_604_661_935 (50%)",
}

btreemap_remove_blob_64_1024_v2
                        time:   [3207.4 M Instructions 3207.4 M Instructions 3207.4 M Instructions]
                        change: [-58.543% -58.543% -58.543%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_remove_blob_128_1024: Warming up for 1.0000 ms
2023-08-30 13:31:27.171892 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "961_751_320 (41%)",
    "node_save_v1": "728_296_269 (31%)",
}

btreemap_remove_blob_128_1024
                        time:   [2326.9 M Instructions 2326.9 M Instructions 2326.9 M Instructions]
                        change: [+1.5188% +1.5188% +1.5188%] (p = 0.00 < 0.05)
                        Performance has regressed.

Benchmarking btreemap_remove_blob_128_1024_v2: Warming up for 1.0000 ms
2023-08-30 13:31:29.473263 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "1_317_606_284 (35%)",
    "node_save_v2": "1_684_252_759 (46%)",
}

btreemap_remove_blob_128_1024_v2
                        time:   [3661.0 M Instructions 3661.0 M Instructions 3661.0 M Instructions]
                        change: [-55.819% -55.819% -55.819%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_remove_blob_256_1024: Warming up for 1.0000 ms
2023-08-30 13:31:32.261676 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "1_463_074_911 (49%)",
    "node_save_v1": "733_401_574 (24%)",
}

btreemap_remove_blob_256_1024
                        time:   [2936.6 M Instructions 2936.6 M Instructions 2936.6 M Instructions]
                        change: [+1.1822% +1.1822% +1.1822%] (p = 0.00 < 0.05)
                        Performance has regressed.

Benchmarking btreemap_remove_blob_256_1024_v2: Warming up for 1.0000 ms
2023-08-30 13:31:34.625539 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "1_912_032_462 (43%)",
    "node_save_v2": "1_765_320_493 (39%)",
}

btreemap_remove_blob_256_1024_v2
                        time:   [4445.9 M Instructions 4445.9 M Instructions 4445.9 M Instructions]
                        change: [-53.658% -53.658% -53.658%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_remove_blob_512_1024: Warming up for 1.0000 ms
2023-08-30 13:31:37.692671 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "2_483_999_494 (58%)",
    "node_save_v1": "774_958_020 (18%)",
}

btreemap_remove_blob_512_1024
                        time:   [4235.4 M Instructions 4235.4 M Instructions 4235.4 M Instructions]
                        change: [+0.8365% +0.8365% +0.8365%] (p = 0.00 < 0.05)
                        Change within noise threshold.

Benchmarking btreemap_remove_blob_512_1024_v2: Warming up for 1.0000 ms
2023-08-30 13:31:40.372300 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "2_997_562_773 (49%)",
    "node_save_v2": "2_000_668_239 (33%)",
}

btreemap_remove_blob_512_1024_v2
                        time:   [6007.8 M Instructions 6007.8 M Instructions 6007.8 M Instructions]
                        change: [-48.537% -48.537% -48.537%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_remove_u64_u64: Warming up for 1.0000 ms
2023-08-30 13:31:44.243827 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "348_586_038 (28%)",
    "node_save_v1": "531_727_461 (43%)",
}

btreemap_remove_u64_u64 time:   [1214.9 M Instructions 1214.9 M Instructions 1214.9 M Instructions]
                        change: [+2.9883% +2.9883% +2.9883%] (p = 0.00 < 0.05)
                        Performance has regressed.

Benchmarking btreemap_remove_u64_u64_v2: Warming up for 1.0000 ms
2023-08-30 13:31:46.034729 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "431_636_337 (32%)",
    "node_save_v2": "558_282_435 (42%)",
}

btreemap_remove_u64_u64_v2
                        time:   [1323.5 M Instructions 1323.5 M Instructions 1323.5 M Instructions]
                        change: [-15.942% -15.942% -15.942%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_remove_u64_blob_8: Warming up for 1.0000 ms
2023-08-30 13:31:47.706368 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "348_727_728 (29%)",
    "node_save_v1": "503_799_202 (42%)",
}

btreemap_remove_u64_blob_8
                        time:   [1174.6 M Instructions 1174.6 M Instructions 1174.6 M Instructions]
                        change: [+3.0731% +3.0731% +3.0731%] (p = 0.00 < 0.05)
                        Performance has regressed.

Benchmarking btreemap_remove_u64_blob_8_v2: Warming up for 1.0000 ms
2023-08-30 13:31:49.496095 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "429_769_109 (34%)",
    "node_save_v2": "512_312_460 (40%)",
}

btreemap_remove_u64_blob_8_v2
                        time:   [1263.0 M Instructions 1263.0 M Instructions 1263.0 M Instructions]
                        change: [-15.780% -15.780% -15.780%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_remove_blob_8_u64: Warming up for 1.0000 ms
2023-08-30 13:31:51.208054 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "353_086_064 (35%)",
    "node_save_v1": "315_283_721 (32%)",
}

btreemap_remove_blob_8_u64
                        time:   [981.11 M Instructions 981.11 M Instructions 981.11 M Instructions]
                        change: [+3.1771% +3.1771% +3.1771%] (p = 0.00 < 0.05)
                        Performance has regressed.

Benchmarking btreemap_remove_blob_8_u64_v2: Warming up for 1.0000 ms
2023-08-30 13:31:52.832257 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "428_189_803 (38%)",
    "node_save_v2": "380_733_306 (34%)",
}

btreemap_remove_blob_8_u64_v2
                        time:   [1118.2 M Instructions 1118.2 M Instructions 1118.2 M Instructions]
                        change: [-21.650% -21.650% -21.650%] (p = 0.00 < 0.05)
                        Performance has improved.

@ielashi
feat: BTreeMap v2 beta
fc214cd
@ielashi
update tests
022eaa0
@ielashi
docs
12e300b
@ielashi
.
5af65b2
@ielashi
.
8620b4f
@ielashi
feat: add basic profiling to benchmarks
d45b6f5
@ielashi
.
2eb6d86
@ielashi
.
1d480f1
@ielashi
Removed unnecessary vec allocations while reading the node (~10% redu…
da72582 
…ction in instructions)

```
Benchmarking btreemap_insert_blob_4_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:46:10.681469 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "3_636_501_975 (78%)",
    "node_save_v2": "621_725_540 (13%)",
}

btreemap_insert_blob_4_1024_v2
                        time:   [4614.6 M Instructions 4614.6 M Instructions 4614.6 M Instructions]
                        change: [-10.016% -10.016% -10.016%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_insert_blob_8_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:46:12.381113 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "3_888_128_011 (77%)",
    "node_save_v2": "675_563_074 (13%)",
}

btreemap_insert_blob_8_1024_v2
                        time:   [5002.9 M Instructions 5002.9 M Instructions 5002.9 M Instructions]
                        change: [-10.421% -10.421% -10.421%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_insert_blob_16_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:46:14.230071 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "3_958_532_867 (77%)",
    "node_save_v2": "709_136_673 (13%)",
}

btreemap_insert_blob_16_1024_v2
                        time:   [5115.5 M Instructions 5115.5 M Instructions 5115.5 M Instructions]
                        change: [-10.015% -10.015% -10.015%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_insert_blob_32_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:46:16.079308 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "4_095_959_285 (77%)",
    "node_save_v2": "745_609_525 (14%)",
}

btreemap_insert_blob_32_1024_v2
                        time:   [5304.5 M Instructions 5304.5 M Instructions 5304.5 M Instructions]
                        change: [-9.8505% -9.8505% -9.8505%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_insert_blob_64_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:46:17.950616 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "4_528_292_556 (77%)",
    "node_save_v2": "791_326_122 (13%)",
}

btreemap_insert_blob_64_1024_v2
                        time:   [5824.6 M Instructions 5824.6 M Instructions 5824.6 M Instructions]
                        change: [-10.047% -10.047% -10.047%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_insert_blob_128_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:46:19.897701 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "4_965_928_945 (78%)",
    "node_save_v2": "838_234_275 (13%)",
}

btreemap_insert_blob_128_1024_v2
                        time:   [6358.7 M Instructions 6358.7 M Instructions 6358.7 M Instructions]
                        change: [-9.9985% -9.9985% -9.9985%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_insert_blob_256_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:46:21.960733 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "5_411_658_559 (77%)",
    "node_save_v2": "901_162_509 (12%)",
}

btreemap_insert_blob_256_1024_v2
                        time:   [6975.5 M Instructions 6975.5 M Instructions 6975.5 M Instructions]
                        change: [-10.178% -10.178% -10.178%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_insert_blob_512_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:46:24.150752 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "6_876_355_007 (78%)",
    "node_save_v2": "1_058_462_789 (12%)",
}

btreemap_insert_blob_512_1024_v2
                        time:   [8798.0 M Instructions 8798.0 M Instructions 8798.0 M Instructions]
                        change: [-10.020% -10.020% -10.020%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_insert_u64_u64_v2: Warming up for 1.0000 ms
2023-08-23 08:46:26.530747 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "728_775_816 (58%)",
    "node_save_v2": "258_596_339 (20%)",
}

btreemap_insert_u64_u64_v2
                        time:   [1251.5 M Instructions 1251.5 M Instructions 1251.5 M Instructions]
                        change: [-0.0037% -0.0037% -0.0037%] (p = 0.00 < 0.05)
                        Change within noise threshold.

Benchmarking btreemap_insert_u64_blob_8_v2: Warming up for 1.0000 ms
2023-08-23 08:46:27.652437 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "696_823_942 (58%)",
    "node_save_v2": "247_026_223 (20%)",
}

btreemap_insert_u64_blob_8_v2
                        time:   [1187.4 M Instructions 1187.4 M Instructions 1187.4 M Instructions]
                        change: [-0.0038% -0.0038% -0.0038%] (p = 0.00 < 0.05)
                        Change within noise threshold.

Benchmarking btreemap_insert_blob_8_u64_v2: Warming up for 1.0000 ms
2023-08-23 08:46:28.750840 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "758_879_496 (65%)",
    "node_save_v2": "145_886_287 (12%)",
}

btreemap_insert_blob_8_u64_v2
                        time:   [1153.0 M Instructions 1153.0 M Instructions 1153.0 M Instructions]
                        change: [-0.0037% -0.0037% -0.0037%] (p = 0.00 < 0.05)
                        Change within noise threshold.

Benchmarking btreemap_get_blob_4_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:46:29.831699 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "4_219_207_858 (95%)",
}

btreemap_get_blob_4_1024_v2
                        time:   [4436.9 M Instructions 4436.9 M Instructions 4436.9 M Instructions]
                        change: [-11.542% -11.542% -11.542%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_get_blob_8_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:46:32.173729 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "3_815_979_475 (94%)",
}

btreemap_get_blob_8_1024_v2
                        time:   [4044.2 M Instructions 4044.2 M Instructions 4044.2 M Instructions]
                        change: [-11.899% -11.899% -11.899%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_get_blob_16_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:46:34.595119 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "3_851_724_650 (94%)",
}

btreemap_get_blob_16_1024_v2
                        time:   [4081.1 M Instructions 4081.1 M Instructions 4081.1 M Instructions]
                        change: [-12.053% -12.053% -12.053%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_get_blob_32_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:46:37.017190 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "4_253_072_804 (94%)",
}

btreemap_get_blob_32_1024_v2
                        time:   [4495.5 M Instructions 4495.5 M Instructions 4495.5 M Instructions]
                        change: [-11.570% -11.570% -11.570%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_get_blob_64_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:46:39.708213 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "4_589_519_380 (94%)",
}

btreemap_get_blob_64_1024_v2
                        time:   [4849.5 M Instructions 4849.5 M Instructions 4849.5 M Instructions]
                        change: [-11.711% -11.711% -11.711%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_get_blob_128_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:46:42.364900 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "5_006_841_787 (94%)",
}

btreemap_get_blob_128_1024_v2
                        time:   [5272.4 M Instructions 5272.4 M Instructions 5272.4 M Instructions]
                        change: [-11.815% -11.815% -11.815%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_get_u64_u64_v2: Warming up for 1.0000 ms
2023-08-23 08:46:45.151204 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "768_123_966 (83%)",
}

btreemap_get_u64_u64_v2 time:   [922.10 M Instructions 922.10 M Instructions 922.10 M Instructions]
                        change: [-0.0053% -0.0053% -0.0053%] (p = 0.00 < 0.05)
                        Change within noise threshold.

Benchmarking btreemap_get_u64_blob_8_v2: Warming up for 1.0000 ms
2023-08-23 08:46:46.385316 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "729_106_800 (83%)",
}

btreemap_get_u64_blob_8_v2
                        time:   [874.65 M Instructions 874.65 M Instructions 874.65 M Instructions]
                        change: [-0.0056% -0.0056% -0.0056%] (p = 0.00 < 0.05)
                        Change within noise threshold.

Benchmarking btreemap_get_blob_8_u64_v2: Warming up for 1.0000 ms
2023-08-23 08:46:47.594299 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "811_967_401 (82%)",
}

btreemap_get_blob_8_u64_v2
                        time:   [987.62 M Instructions 987.62 M Instructions 987.62 M Instructions]
                        change: [-0.0049% -0.0049% -0.0049%] (p = 0.00 < 0.05)
                        Change within noise threshold.

Benchmarking btreemap_get_blob_256_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:46:48.774213 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "5_512_886_751 (94%)",
}

btreemap_get_blob_256_1024_v2
                        time:   [5807.4 M Instructions 5807.4 M Instructions 5807.4 M Instructions]
                        change: [-12.998% -12.998% -12.998%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_get_blob_512_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:46:51.686246 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "6_988_975_712 (95%)",
}

btreemap_get_blob_512_1024_v2
                        time:   [7330.7 M Instructions 7330.7 M Instructions 7330.7 M Instructions]
                        change: [-12.057% -12.057% -12.057%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_remove_blob_4_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:46:55.065067 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "306_221_077 (29%)",
    "node_save_v1": "416_552_416 (39%)",
}

btreemap_remove_blob_4_1024_v2
                        time:   [1055.5 M Instructions 1055.5 M Instructions 1055.5 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_remove_blob_8_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:46:56.830780 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v1": "365_697_986 (27%)",
    "node_save_v1": "555_195_279 (41%)",
}

btreemap_remove_blob_8_1024_v2
                        time:   [1352.3 M Instructions 1352.3 M Instructions 1352.3 M Instructions]
                        change: [+0.0000% +0.0000% +0.0000%] (p = NaN > 0.05)
                        No change in performance detected.

Benchmarking btreemap_remove_blob_16_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:46:58.660166 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "4_691_318_570 (73%)",
    "node_save_v2": "1_237_620_989 (19%)",
}

btreemap_remove_blob_16_1024_v2
                        time:   [6415.9 M Instructions 6415.9 M Instructions 6415.9 M Instructions]
                        change: [-9.2624% -9.2624% -9.2624%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_remove_blob_32_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:47:01.495518 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "4_889_831_082 (72%)",
    "node_save_v2": "1_311_529_745 (19%)",
}

btreemap_remove_blob_32_1024_v2
                        time:   [6715.3 M Instructions 6715.3 M Instructions 6715.3 M Instructions]
                        change: [-9.0911% -9.0911% -9.0911%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_remove_blob_64_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:47:04.425799 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "5_090_099_125 (72%)",
    "node_save_v2": "1_381_087_495 (19%)",
}

btreemap_remove_blob_64_1024_v2
                        time:   [7031.6 M Instructions 7031.6 M Instructions 7031.6 M Instructions]
                        change: [-9.1148% -9.1148% -9.1148%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_remove_blob_128_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:47:07.509173 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "5_468_360_953 (72%)",
    "node_save_v2": "1_467_914_004 (19%)",
}

btreemap_remove_blob_128_1024_v2
                        time:   [7553.3 M Instructions 7553.3 M Instructions 7553.3 M Instructions]
                        change: [-8.8462% -8.8462% -8.8462%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_remove_blob_256_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:47:10.739864 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "6_380_810_655 (73%)",
    "node_save_v2": "1_601_556_578 (18%)",
}

btreemap_remove_blob_256_1024_v2
                        time:   [8714.6 M Instructions 8714.6 M Instructions 8714.6 M Instructions]
                        change: [-9.1626% -9.1626% -9.1626%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_remove_blob_512_1024_v2: Warming up for 1.0000 ms
2023-08-23 08:47:14.235772 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "7_716_480_801 (72%)",
    "node_save_v2": "1_920_254_272 (18%)",
}

btreemap_remove_blob_512_1024_v2
                        time:   [10.603 B Instructions 10.603 B Instructions 10.603 B Instructions]
                        change: [-9.1730% -9.1730% -9.1730%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking btreemap_remove_u64_u64_v2: Warming up for 1.0000 ms
2023-08-23 08:47:18.341386 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "834_031_761 (52%)",
    "node_save_v2": "427_006_161 (27%)",
}

btreemap_remove_u64_u64_v2
                        time:   [1574.5 M Instructions 1574.5 M Instructions 1574.5 M Instructions]
                        change: [-0.0034% -0.0034% -0.0034%] (p = 0.00 < 0.05)
                        Change within noise threshold.

Benchmarking btreemap_remove_u64_blob_8_v2: Warming up for 1.0000 ms
2023-08-23 08:47:19.699772 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "793_821_373 (52%)",
    "node_save_v2": "404_946_198 (27%)",
}

btreemap_remove_u64_blob_8_v2
                        time:   [1499.6 M Instructions 1499.6 M Instructions 1499.6 M Instructions]
                        change: [-0.0036% -0.0036% -0.0036%] (p = 0.00 < 0.05)
                        Change within noise threshold.

Benchmarking btreemap_remove_blob_8_u64_v2: Warming up for 1.0000 ms
2023-08-23 08:47:21.052537 UTC: [Canister rwlgt-iiaaa-aaaaa-aaaaa-cai] {
    "node_load_v2": "866_070_202 (60%)",
    "node_save_v2": "258_699_270 (18%)",
}

btreemap_remove_blob_8_u64_v2
                        time:   [1427.1 M Instructions 1427.1 M Instructions 1427.1 M Instructions]
                        change: [-0.0036% -0.0036% -0.0036%] (p = 0.00 < 0.05)
                        Change within noise threshold.
```
@ielashi
update page size to match v1, add more profiling metrics
f22d30d
@ielashi
WIP: lazy loading of values
746b516
@ielashi
Load node without putting all the data into a buffer.
3d37706
@ielashi
.
789a8b5
@ielashi
.
167b9f6
@ielashi
.
eb70aac
@ielashi
.
6dcc86c
@ielashi
use segments with page idx
4e221ac
@ielashi
.
614695a
@ielashi
.
eddfaab
@ielashi
verify overflow magic
3fcce86
@ielashi
cleanup + docs
dd59a84
@ielashi ielashi requested review from roman-kashitsyn and a team as code owners August 30, 2023 13:36
@ielashi ielashi changed the title optimize: make BTreeMap vs 2-4x more officient optimize: make BTreeMap v2 2-4x more officient Aug 30, 2023
@ielashi ielashi changed the title optimize: make BTreeMap v2 2-4x more officient perf: make BTreeMap v2 2-4x more officient Aug 30, 2023
@ielashi ielashi changed the title perf: make BTreeMap v2 2-4x more officient perf: make BTreeMap V2 2-4x more officient Aug 30, 2023
Base automatically changed from ielashi/profiler to main September 5, 2023 08:59
dsarlis
dsarlis reviewed Sep 5, 2023
View reviewed changes
Copy link
Member

@dsarlis dsarlis left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I suppose we have tests already that should make sure that reading nodes via the new node reader works as expected, right?

A more general comment: it seems we do a lot of integer arithmetic to figure out addresses and offsets. I didn't comment all over the place but I'd consider whether we're ok with that or we should be a bit more careful with potential overflows and such. It's also ok if we make the code more robust in follow up, i.e. this is not a blocking comment.

src/btreemap/node/reader.rs Outdated Show resolved Hide resolved
src/btreemap/node/reader.rs Show resolved Hide resolved
src/btreemap/node/reader.rs Show resolved Hide resolved
src/btreemap/node/reader.rs Outdated Show resolved Hide resolved
src/btreemap/node/v2.rs Show resolved Hide resolved
@ielashi ielashi merged commit 1f0b468 into main Sep 5, 2023
3 checks passed
@ielashi ielashi deleted the ielashi/v2_lazy_value_loading branch September 5, 2023 10:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@dsarlis dsarlis dsarlis approved these changes

@roman-kashitsyn roman-kashitsyn Awaiting requested review from roman-kashitsyn

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@ielashi @dsarlis