Struct ZerobusSink 

pub struct ZerobusSink { /* private fields */ }

A Databricks Zerobus sink for one target table.

Implementations

impl ZerobusSink

pub async fn start( id: impl Into<String>, table: TableRef, schema: Arc<Schema>, config: ZerobusConfig, deps: ZerobusSinkDeps, peak_mb_per_s: f64, ) -> Result<Self, ZerobusSinkError>

Provision the table and open the stream pool.

peak_mb_per_s sizes the pool (§3.3). Provisioning is delegated to the catalog (create/evolve, register, vend); the primary-raw preconditions are checked against the freshly-described live table.

Errors

ZerobusSinkError if provisioning, the precondition check, or opening the pool fails.

pub fn metrics(&self) -> &Arc<Metrics>

A snapshot of the sink’s metrics (for observability wiring / tests).

pub async fn close(self)

Drain to durability and close the pool (graceful shutdown). Consumes the sink so no further writes are possible.

Trait Implementations

impl BatchSink for ZerobusSink

fn push<'life0, 'life1, 'life2, 'async_trait>( &'life0 mut self, batch: &'life1 RecordBatch, span: &'life2 OffsetSpan, ) -> Pin<Box<dyn Future<Output = Result<(), SinkError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait,

Submit batch (covering source positions span) fire-and-forget.

fn finish<'life0, 'async_trait>( &'life0 mut self, ) -> Pin<Box<dyn Future<Output = Result<(CommitInfo, OffsetSpan), SinkError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Close the current batching window; return what was submitted and the submitted high-water span. Does not block on durability.

impl Debug for ZerobusSink

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Sink for ZerobusSink

fn send<'life0, 'async_trait>( &'life0 mut self, batch: RecordBatch, span: OffsetSpan, ) -> Pin<Box<dyn Future<Output = Result<Receipt, SinkError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Accept batch covering source positions span, returning as soon as the transport accepts it. Must not block on durable acknowledgement.

fn flush<'life0, 'async_trait>( &'life0 mut self, ) -> Pin<Box<dyn Future<Output = Result<(), SinkError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Drain to durability: await outstanding acknowledgements. Used at shutdown and at explicit checkpoint boundaries, not on the hot path.