cai.zhang 04c306e63f fix: Fix clustering compaction task leak (#36800) 5 天之前
..
allocator 82b2edc4bd Replace manual composed grpc call with Broker methods (#27676) 1 年之前
channel 290ceb4e84 enhance: Add more info in logs (#36731) 1 周之前
compaction 04c306e63f fix: Fix clustering compaction task leak (#36800) 5 天之前
importv2 82c5cf2fa2 feat: add bulk insert support for Functions (#36715) 1 周之前
iterators 962a5446f8 enhance: Add ctx in `SyncTask.Run` to be cancellable (#34042) 3 月之前
util a4439cc911 enhance: Implement flusher in streamingNode (#34942) 2 月之前
OWNERS 12f50cb22c [skip ci]Update OWNERS files (#11898) 2 年之前
README.md 9ceb1c73db [skip ci]Change uppercase of MinIO (#9539) 3 年之前
data_node.go b172ea1093 fix: Remove enableLevelZeroSegment config (#36535) 5 天之前
data_node_test.go a4439cc911 enhance: Implement flusher in streamingNode (#34942) 2 月之前
metrics_info.go a4439cc911 enhance: Implement flusher in streamingNode (#34942) 2 月之前
services.go 1413ffe9b1 enhance: Rename preAllocatedSegments (#35871) 1 月之前
services_test.go 139787371e feat: support embedding bm25 sparse vector and flush bm25 stats log (#36036) 1 月之前

README.md

Data Node

DataNode is the component to write insert and delete messages into persistent blob storage, for example MinIO or S3.

Dependency

  • KV store: a kv store that persists messages into blob storage.
  • Message stream: receive messages and publish imformation
  • Root Coordinator: get the latest unique IDs.
  • Data Coordinator: get the flush information and which message stream to subscribe.