Roman Zeyde
fce7bd15b0
Add simple transaction ID prefix collision length calculator
2018-10-01 21:15:12 +03:00
Roman Zeyde
3f51458fee
Optimize for low-memory systems by using different RocksDB settings
...
- Keep less open files (to preserve memory)
- Don't use compaction readahead
- Use smaller SSTable block size
2018-09-16 09:55:42 +03:00
Roman Zeyde
fff0d0632a
Remove obsolete bulk loading example
2018-09-01 08:26:19 +03:00
Roman Zeyde
2fad1fb8c9
Refactor P2P notification handling
2018-08-15 17:40:56 +03:00
Roman Zeyde
604f7680df
Notify only about new blocks from P2P layer
2018-08-15 17:05:12 +03:00
Roman Zeyde
d45dba2681
Move p2p listener logic into notify module
2018-08-15 11:08:52 +03:00
Roman Zeyde
fd5db9b2fd
Add simple P2P listener example
2018-08-15 10:32:13 +03:00
Roman Zeyde
ac819af52e
Allow setting index batch size from command-line
...
Should allow running on low-memory systems.
2018-08-06 18:44:18 +03:00
Roman Zeyde
f66e5e48cc
Add a simple tool for full compaction benchmarking
2018-08-05 13:18:04 +03:00
Roman Zeyde
85687f18dd
Add short description to example/ binaries
2018-08-01 15:00:18 +03:00
Roman Zeyde
b9c778f02d
Respond to SIGINT while waiting for re-connections
2018-07-29 09:48:49 +03:00
Roman Zeyde
1d59449677
Abstract cookie handling to a trait object
...
This would allow re-loading JSONRPC cookie after bitcoind restart
2018-07-28 14:57:09 +03:00
Roman Zeyde
2d74d6d4f0
Rename a few Config members following #19
...
rpc_addr -> electrum_rpc_addr
daemon_rpc_url -> daemon_rpc_addr
2018-07-15 22:39:19 +03:00
Lawrence Nahum
408372cba4
make listen port and bitcoin rpc configurable
2018-07-15 19:08:15 +02:00
Roman Zeyde
253e244a86
Fix cargo fmt for Travis
...
Stable Rust doesn't support `cargo fmt --check` (yet).
2018-07-14 13:02:28 +03:00
Roman Zeyde
2852020c58
Fix leftovers at examples/load.rs
2018-07-13 22:24:14 +03:00
Roman Zeyde
48cd929a99
Remove StoreOptions and enable manual compactions explicitly
2018-07-13 14:23:10 +03:00
Roman Zeyde
b9a4cb4318
Move bulk reader and indexer to separate module
2018-07-12 16:47:39 +03:00
Roman Zeyde
4c7413db9d
Increase open files limit explicitly
...
Otherwise, full compaction may fail.
2018-07-12 14:44:10 +03:00
Roman Zeyde
62a78f18ad
Put "finish" marker after compaction is over
2018-07-12 10:46:33 +03:00
Roman Zeyde
f92dfc808d
Log indexed blk*.dat file path
2018-07-12 09:25:17 +03:00
Roman Zeyde
7b5679db70
Panic if DB exists before running bulk load benchmark
2018-07-11 21:26:12 +03:00
Roman Zeyde
b32e503db2
Rename regular indexing benchmark
2018-07-11 21:26:12 +03:00
Roman Zeyde
dd70a1cc8a
Persist last indexed block marker
2018-07-11 21:26:12 +03:00
Roman Zeyde
10919035bd
Rename bulk load benchmark
2018-07-11 20:44:05 +03:00
Roman Zeyde
4da521b3cd
Refactor bulk load benchmark
...
- bulk writes take ~1h (reading blk*.dat files at ~48MB/s)
- full compaction takes ~45m (writing 37GB of SSTables)
2018-07-11 20:42:57 +03:00
Roman Zeyde
e69686f988
Use multiple bulk index workers
2018-07-10 23:52:26 +03:00
Roman Zeyde
fb372b2915
Split reading from indexing blk*.dat files
...
Also, use a single Vec<Row> for write operation
2018-07-10 15:37:56 +03:00
Roman Zeyde
4c182a0650
Fix formatting
2018-07-09 17:10:24 +03:00
Roman Zeyde
da570a9182
Fix benchmarks
2018-07-08 23:23:36 +03:00
Roman Zeyde
e4a3581da1
Use Path::join() for DB directory
2018-07-06 11:49:25 +03:00
Roman Zeyde
130ced9ae0
Format using nightly rustfmt
2018-07-03 11:46:36 +03:00
Roman Zeyde
82c2caa3af
Fix Daemon usage by benchmarks
2018-07-03 10:52:09 +03:00
Roman Zeyde
7581fd7d1a
Move bulk load helper back to electrs
2018-06-28 23:08:34 +03:00
Roman Zeyde
fd16082925
Don't start bulk loader if already done
2018-06-28 13:41:46 +03:00
Roman Zeyde
70743c9a10
Integrate bulk parser into main server binary
2018-06-28 11:15:30 +03:00
Roman Zeyde
0cceb790b9
Rename parse into bulk
2018-06-28 00:20:24 +03:00
Roman Zeyde
fe03b121f1
Update multiple use formatting
2018-06-27 00:28:50 +03:00
Roman Zeyde
1c70addede
Fix travis
2018-06-26 09:32:35 +03:00
Roman Zeyde
f631bf26af
Dedup FakeStore definition
2018-06-25 23:06:24 +03:00
Roman Zeyde
0de580a300
Perform compaction after blk*.dat parsing is over
2018-06-25 22:16:46 +03:00
Roman Zeyde
8e0a719cee
Replace eprintln!() by error!()
2018-06-25 22:16:22 +03:00
Roman Zeyde
9a5f746cc0
Refactor blk*.dat parser
2018-06-25 14:06:07 +03:00
Roman Zeyde
712c86d405
Fix small typo in bench_index
2018-06-25 10:52:44 +03:00
Roman Zeyde
4200648c8d
Refactor blk*.dat parser
2018-06-25 10:46:30 +03:00
Roman Zeyde
6f3424f734
Move block indexing into parse module
2018-06-24 13:20:09 +03:00
Roman Zeyde
8b0b4323e0
Store indexed rows into a DB
2018-06-24 09:51:18 +03:00
Roman Zeyde
b2b799c4ce
Fix logging during parsing
2018-06-23 23:36:06 +03:00
Roman Zeyde
8785f2747d
Add metrics to parse module
2018-06-23 23:25:32 +03:00
Roman Zeyde
75b3fc969d
Allow closing Channel's internal sender
...
Otherwise, we may get stuck in a deadlock (e.g. parse module):
- the channel's receiver waits for messages
- but the last channel's sender is kept alive (at the channel)
2018-06-23 23:25:32 +03:00
