百科.dev
全部条目在线工具AI 编程趋势榜开源项目技术资讯提交条目
登录
< 返回工具列表
M

minikv

> 编程语言
开源

在 Rust 中提供分布式、多租户的键值和对象存储,采用 Raft 共识、WAL 持久性和面向生产的操作。

397 stars0 点赞1 次浏览
访问官网GitHub

工具介绍

在 Rust 中提供分布式、多租户的键值和对象存储,采用 Raft 共识、WAL 持久性和面向生产的操作。

minikv

Distributed, multi-tenant key-value and object store in Rust, with Raft consensus, WAL durability, and production-oriented operations.

v1.0.0

v1.0.0 is the GA line focused on data/ML workflows and operational reliability.

  • Time-series API handlers are production-backed (/ts/write, /ts/query).
  • Vector search endpoints are available and persisted on coordinator disk.
  • Python SDK preview supports notebook workflows (pandas/polars/pyarrow helpers).
  • Observability bundle now includes Grafana dashboard provisioning and Prometheus alerts.
  • Helm chart is available with dev/staging/prod values profiles.
  • Release engineering includes preflight checks and runbooks.

Table of Contents

  • What is minikv
  • Quick Start
  • Python SDK
  • Core Features
  • Operations and Release Engineering
  • Roadmap
  • Development
  • Contributing

What is minikv

minikv is a distributed systems reference implementation and an extensible data platform.

  • Strong consistency: Raft for metadata and 2PC patterns for distributed writes.
  • Durability: WAL and pluggable storage backends.
  • Multi-tenancy and security: RBAC, API keys/JWT, encryption at rest.
  • Real-time and analytics pathways: watch/SSE and time-series APIs.

Quick Start

Build and run local cluster:

bash
git clone https://github.com/whispem/minikv.git
cd minikv
make build
make serve

Basic checks:

bash
curl -s http://127.0.0.1:5000/health/live
curl -s http://127.0.0.1:5000/health/ready
curl -s http://127.0.0.1:5000/metrics
curl -s http://127.0.0.1:5000/admin/status

Python SDK

Notebook-first SDK (preview) for data scientists and engineers:

  • Time-series write/query helpers
  • Vector upsert/query helpers
  • SSE change-stream consumption
  • Dataframe conversions (pandas, polars, pyarrow)

Install and run example:

bash
pip install -r sdk/python/requirements.txt
python examples/data_science_quickstart.py

Files:

  • sdk/python/minikv_client.py
  • sdk/python/README.md
  • examples/data_science_quickstart.py

Core Features

Distribution and consistency:

  • Raft consensus (leader election, log replication)
  • 256 virtual shards and placement management
  • Multi-key operations and transaction endpoints
  • Cross-DC replication primitives and conflict policies

Storage and query paths:

  • Pluggable backends: RocksDB, Sled, in-memory
  • WAL, compaction, and integrity tooling
  • Time-series engine with aggregation and downsampling
  • Vector similarity endpoints with cosine top-k search

Security and tenancy:

  • API keys (Argon2), JWT, RBAC
  • AES-256-GCM encryption at rest
  • Tenant quotas and request rate limiting
  • Audit logging

APIs:

  • HTTP REST and S3-compatible endpoints
  • WebSocket/SSE watch endpoints
  • gRPC internal communication

Operations and Release Engineering

Observability:

  • Prometheus and OpenTelemetry integration
  • Grafana dashboard provisioning
  • Alert rules in opentelemetry/prometheus-alerts.yml

Kubernetes:

  • Operator manifests under k8s/
  • Helm chart under k8s/helm/minikv/

Runbooks:

  • Backup/restore: docs/ops-backup-restore.md
  • Release process: docs/release-engineering-v1.0.0.md

Preflight commands:

bash
make release-preflight
make release-preflight-full

Roadmap

v1.1.0:

  • Kafka Connect sink/source templates for CDC
  • Read replicas for analytical traffic
  • Vector index acceleration (HNSW/PQ)
  • Better analytics query ergonomics

v1.2.0:

  • Distributed transactions scope expansion
  • Multi-region active-passive with explicit failover
  • Point-in-time recovery (PITR)
  • Policy-driven data lifecycle automation

Future:

  • Multi-region active-active
  • WebAssembly UDF sandbox
  • Global secondary indexes
  • Expanded SQL layer

Development

bash
make build
make test
make fmt
make clippy
make verify

Project layout:

src/
  bin/          # minikv, minikv-coord, minikv-volume
  common/       # auth, backup, cdc, metrics, replication, timeseries, ...
  coordinator/  # coordinator server and HTTP/gRPC APIs
  volume/       # volume node storage and APIs
  ops/          # integrity, compact, repair tooling
k8s/            # operator manifests and Helm chart
opentelemetry/  # Prometheus/Grafana/Jaeger stack
sdk/python/     # notebook-first Python client preview
docs/           # runbooks and release engineering docs

Contributing

Contributions are welcome. See CONTRIBUTING.md for coding, testing, and PR workflow.

License

MIT. See LICENSE.

Issues· 1 开放

查看全部 Issues在 GitHub 打开

暂无开放 Issues,或尚未同步最近议题。

> 标签

Rust

暂无评论,来聊聊你的看法吧

> 工具信息

发布日期2026年8月1日
最后更新2026年9月17日
分类编程语言
定价开源

> 相关工具

T
TypeScript
JavaScript 的超集,为前端与全栈提供静态类型
P
Python
通用编程语言,广泛用于 Web、数据与 AI
G
Go
Google 推出的简洁高效系统语言