Structsยง
- Fragment
Write ๐ - Lance
DbCommon - Lance
DbConfig - Lance
DbPre ๐Commit Metadata - Lance
DbSink - Lance
DbSink Committer - The coordinator collects lightweight
Fragmentmetadata from all writers and commits them atomically viaCommitBuilder. No data payload flows through the coordinator โ only file-level metadata. - Lance
DbSink Writer - The writer writes data files directly to the Lance dataset storage using the
low-level
FileFragment::create_fragments()API. On checkpoint, it returns lightweightFragmentmetadata instead of the actual data payload. A fragment is a logical row segment that references one or more files containing columns for those rows. The coordinator then commits these fragments atomically.
Constantsยง
- LANCEDB_
SINK - RW_
EPOCH_ ๐TRANSACTION_ PROPERTY - RW_
SINK_ ๐ID_ TRANSACTION_ PROPERTY - WRITE_
CHANNEL_ ๐CAPACITY