Blob storage designed for huge amounts of random reads and small objects with constant latency
Blob storage designed for huge amounts of random reads and small objects with constant latency
Extremely fast object storage, performing at raw device speeds. Achieves constant sub-millisecond latency random partial reads over objects regardless of size.
Read the blog post for an accessible deep dive.
blobd requires Linux 6.11+, a NVMe SSD with support for atomic writes of 512-byte blocks, and direct access to the raw block device. Install the server by using cargo:
cargo install blobdThen set up the configuration file:
device:
path: /dev/my-nvme-device
offset: 0
len:
token_secret_base64: abcdef1234567890abcdef1234567890
interface: 127.0.0.1
port: 8080Now you can format the device and start the server:
blobd --config my-config.yaml --format
blobd --config my-config.yamlThe server can now be accessed over HTTP. Clients are available for Node.js and Rust.
This project used to be called Turbostore and was written entirely in C; you can still see the code here.
No open issues yet, or sync has not completed.