Data IO (Sources & Sinks)

Overview

Data IO classes define how data flows into and out of pipelines:

• DataSource / PayloadSource: bring data into the pipeline

• DataSink / PayloadSink: output data from the pipeline

When wrapped as nodes in a pipeline, these classes are automatically converted to DataOperation processors with explicit parameter signatures.

Important: All IO method parameters must be explicitly declared. **kwargs is not allowed for reliable provenance tracking and parameter validation.

Public API Surface

• semantiva.data_io.data_io.DataSource

• semantiva.data_io.data_io.PayloadSource

• semantiva.data_io.data_io.DataSink

Autodoc

class semantiva.data_io.data_io.DataSink(logger=None)

Bases: _SemantivaComponent, Generic[T]

abstract classmethod input_data_type()

classmethod send_data(data, *args, **kwargs)

class semantiva.data_io.data_io.DataSource(logger=None)

Bases: _SemantivaComponent

classmethod get_data(*args, **kwargs)

abstract classmethod output_data_type()

class semantiva.data_io.data_io.PayloadSink(logger=None)

Bases: _SemantivaComponent, Generic[T]

abstract classmethod input_data_type()

classmethod send_payload(payload, *args, **kwargs)

class semantiva.data_io.data_io.PayloadSource(logger=None)

Bases: _SemantivaComponent

classmethod get_payload(*args, **kwargs)

classmethod injected_context_keys()

abstract classmethod output_data_type()