Workload
sustained-ingest
Inserts records with unique sequential IDs into an empty database using closed-loop clients, then flushes the accepted writes.
Application operations
| API | total | avg/s | p0.1/s | p1/s | p50/s | p99/s | p99.9/s | min/s | max/s |
|---|---|---|---|---|---|---|---|---|---|
| 188.16M | 153.66K | 0 | 0 | 168.26K | 339.14K | 346.3K | 0 | 346.44K | |
Loading chart… | |||||||||
| 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | |
Loading chart… | |||||||||
Application throughput
| API | total GiB | avg MiB/s | p0.1 | p1 | p50 | p99 | p99.9 | min | max |
|---|---|---|---|---|---|---|---|---|---|
| 73.6 | 61.55 | 0 | 0 | 67.4 | 135.84 | 138.71 | 0 | 138.76 | |
Loading chart… | |||||||||
Application latency
| API | avg ms | p0.1 | p1 | p50 | p99 | p99.9 | min | max |
|---|---|---|---|---|---|---|---|---|
| 0.41 | 0.14 | 0.16 | 0.2 | 0.39 | 0.78 | 0 | 13,541.38 | |
Loading chart… | ||||||||
| 24,567.81 | 24,576 | 24,576 | 24,576 | 24,576 | 24,576 | 24,559.62 | 24,576 | |
Loading chart… | ||||||||
Time from when a write returns until SlateDB first reports its sequence durable. | 29,387.33 | 1,893.38 | 4,661.25 | 30,490.62 | 40,075.26 | 42,074.11 | 1,268.74 | 48,005.12 |
Loading chart… | ||||||||
Object-store operations
| Method | total | avg/s | p0.1/s | p1/s | p50/s | p99/s | p99.9/s | min/s | max/s | $ | $/month |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 151.12K | 123.4 | 1 | 3 | 122.05 | 404 | 451.99 | 0 | 466 | $0.0604 | $127.94 | |
Loading chart… | |||||||||||
| 18 | 0.01 | 0 | 0 | 0 | 0 | 1 | 0 | 2 | $0.000090 | $0.1905 | |
Loading chart… | |||||||||||
| 38.32K | 31.29 | 0 | 0 | 29.97 | 87 | 96 | 0 | 103 | $0.1916 | $405.57 | |
Loading chart… | |||||||||||
| 76 | 0.06 | 0 | 0 | 0 | 1 | 2 | 0 | 3 | $0.000030 | $0.0643 | |
Loading chart… | |||||||||||
| 1.34K | 1.1 | 0 | 0 | 0 | 0 | 122.03 | 0 | 147.95 | $0.00 | $0.00 | |
Loading chart… | |||||||||||
| 5.41K | 4.42 | 0 | 0 | 4 | 15 | 20 | 0 | 20 | $0.0271 | $57.28 | |
Loading chart… | |||||||||||
Object-store throughput
| Method | total GiB | avg MiB/s | p0.1 | p1 | p50 | p99 | p99.9 | min | max |
|---|---|---|---|---|---|---|---|---|---|
| 270.1 | 225.86 | 0 | 0 | 221.95 | 756.72 | 878.78 | 0 | 941.26 | |
Loading chart… | |||||||||
| 0 | 0 | 0 | 0 | 0 | 0 | 0.13 | 0 | 0.37 | |
Loading chart… | |||||||||
| 346 | 289.33 | 0 | 0 | 265.17 | 828.13 | 894.95 | 0 | 905 | |
Loading chart… | |||||||||
| 0 | 0 | 0 | 0 | 0 | 0 | 0.05 | 0 | 0.06 | |
Loading chart… | |||||||||
| 0 | 0 | 0 | 0 | 0 | 0.02 | 0.02 | 0 | 0.02 | |
Loading chart… | |||||||||
Process statistics
| Metric | avg | p0.1 | p1 | p50 | p99 | p99.9 | min | max |
|---|---|---|---|---|---|---|---|---|
| 4.34 | 0 | 0 | 4.18 | 11.17 | 12.79 | 0 | 13.38 | |
Loading chart… | ||||||||
| 25.15 | 0.92 | 5.5 | 27.31 | 30.44 | 30.46 | 0.42 | 30.48 | |
Loading chart… | ||||||||
Machine statistics
| Metric | avg | p0.1 | p1 | p50 | p99 | p99.9 | min | max |
|---|---|---|---|---|---|---|---|---|
| 13.5 | 0.06 | 0.09 | 12.97 | 34.61 | 40.06 | 0.06 | 41.87 | |
Loading chart… | ||||||||
| 27.2 | 2.66 | 7.28 | 29.34 | 32.58 | 32.65 | 2.21 | 32.83 | |
Loading chart… | ||||||||
| 235.21 | 0 | 0 | 234.69 | 786.71 | 915.95 | 0 | 981.78 | |
Loading chart… | ||||||||
| 304.48 | 0 | 0 | 282.87 | 878.08 | 898.57 | 0 | 900.37 | |
Loading chart… | ||||||||
| 0 | 0 | 0 | 0 | 0.12 | 0.45 | 0 | 0.6 | |
Loading chart… | ||||||||
| 0.18 | 0 | 0 | 0 | 1 | 3.32 | 0 | 176.38 | |
Loading chart… | ||||||||
| 0.15 | 0 | 0 | 0 | 1 | 9.99 | 0 | 115.97 | |
Loading chart… | ||||||||
| 1.62 | 0 | 0 | 0 | 15 | 180 | 0 | 944.47 | |
Loading chart… | ||||||||
Benchmark configuration
| Key | Value |
|---|---|
| scale | 1 |
| dataset / record count | 300,000,000 |
| dataset / key bytes | 20 B |
| dataset / value bytes | 400 B |
| dataset / value compression ratio | 1 |
| caches / block bytes | 8 GiB |
| caches / metadata bytes | 4 GiB |
| task / task | sustained-ingest |
| task / clients | 64 |
| task / warmup ms | 0 ms |
| task / measurement ms | 1,200,000 ms |
| task / initial state | empty |
| task / key selection | unique-sequential |
| task / operation mix / put | 1 |
| task / scan limit | — |
| task / transaction hot keys | — |
| task / transaction reads | — |
| task / transaction updates | — |
| build profile | release |
| enabled features | aws, foyer, wal_disable, zstd |
SlateDB configuration
| Key | Value |
|---|---|
| flush interval | 100ms |
| WAL enabled | No |
| manifest poll interval | 1s |
| manifest update timeout | 300s |
| min filter keys | 1,000 |
| L0 SST size bytes | 64 MiB |
| max WAL flushes before L0 flush | 4,096 |
| L0 max ssts | 32 |
| L0 max ssts per key | 32 |
| L0 flush parallelism | 4 |
| max unflushed bytes | 2 GiB |
| compactor options / poll interval | 5s |
| compactor options / manifest update timeout | 300s |
| compactor options / max concurrent compactions | 4 |
| compactor options / enable trivial move | No |
| compactor options / scheduler options / max compaction sources | 16 |
| compactor options / worker / max concurrent compactions | 4 |
| compactor options / worker / compactions poll interval | 5s |
| compactor options / worker / heartbeat interval | 10s |
| compactor options / worker / max SST size | 268,435,456 |
| compactor options / worker / max fetch tasks | 4 |
| compactor options / worker / bytes to fetch | 2,097,152 |
| compactor options / worker / max subcompactions | 8 |
| compactor options / worker / min filter keys | 1,000 |
| compactor options / worker / compression codec | — |
| compactor options / worker / metric level | — |
| compactor options / metric level | — |
| compactor options / commit compacted interval | 1s |
| compactor options / worker heartbeat timeout | 30s |
| compactor options / object store max retries | — |
| compression codec | — |
| object store cache options / root folder | — |
| object store cache options / max cache size bytes | — |
| object store cache options / part size bytes | 4 MiB |
| object store cache options / cache on flush | No |
| object store cache options / cache on compaction | No |
| object store cache options / preload disk cache on startup | — |
| object store cache options / scan interval | 3600s |
| object store cache options / max open file handles | 1,000 |
| garbage collector options / manifest options / interval | 600s |
| garbage collector options / manifest options / min age | 300s |
| garbage collector options / manifest options / dry run | No |
| garbage collector options / WAL options / interval | 600s |
| garbage collector options / WAL options / min age | 300s |
| garbage collector options / WAL options / dry run | No |
| garbage collector options / WAL fence options / interval | 600s |
| garbage collector options / WAL fence options / min age | 300s |
| garbage collector options / WAL fence options / dry run | Yes |
| garbage collector options / compacted options / interval | 600s |
| garbage collector options / compacted options / min age | 300s |
| garbage collector options / compacted options / dry run | No |
| garbage collector options / compactions options / interval | 600s |
| garbage collector options / compactions options / min age | 300s |
| garbage collector options / compactions options / dry run | No |
| garbage collector options / detach options / interval | 600s |
| garbage collector options / metric level | — |
| garbage collector options / boundary files enabled | Yes |
| garbage collector options / object store max retries | — |
| metric level | Info |
| default ttl millis | — |
| object store max retries | — |