Module markers 

Data marker sidecar capture, schema types, canonical content hashes, and writer lane.

The sidecar records the observed order of streaming data at the message-bus boundary as compact cursor snapshots, joinable back to catalog rows. No market-data payload is persisted.

Structs

CursorState

In-memory per-stream cursor state for data marker capture.

DataCursorSnapshot

A snapshot of the cursor positions for all active market-data streams at a marker point.

DataMarkerCapture

Engine-thread component that captures data marker cursors at the bus boundary.

DataMarkerConfig

Opt-in data-marker sidecar settings for an event-store run.

DataMarkerExtractorRegistry

Registry of marker extractors keyed by concrete message TypeId.

HiFiMarker

A high-fidelity per-record marker capturing per-record identity within a stream slot.

JoinedStream

Catalog rows joined to one folded marker stream cursor.

MarkerGap

A gap in the sidecar marker sequence.

MarkerManifest

Per-run manifest for a data marker sidecar file.

MarkerReader

Read-side scanner for a single data marker sidecar.

MarkerVerifier

Verifier for a single marker sidecar backend.

MarkerVerifyReport

Structured report produced by MarkerVerifier.

MarkerWriter

Dedicated marker writer thread.

MarkerWriterConfig

Configuration knobs for the data marker writer.

MemoryMarkerBackend

In-memory implementation of MarkerBackend.

RedbMarkerBackend

On-disk MarkerBackend backed by a per-run [redb] marker sidecar file.

StoredMarkerRecord

A durable marker record returned with the integrity hash stored beside it.

StreamCursor

The cursor position within a single market-data stream slot.

StreamDictEntry

A registry entry mapping a stream slot to its data class and instrument identifier.

Enums

DataClass

The class of market-data stream being tracked by a sidecar slot.

MarkerCountKind

Marker manifest count field used in count-mismatch findings.

MarkerFinding

One non-fatal integrity finding from a marker verification scan.

MarkerGapReason

The reason a gap exists in the sidecar marker sequence.

MarkerMsg

A message sent to the data marker writer.

MarkerRecordKind

Durable marker table kind used in hash findings.

Constants

DEFAULT_MARKER_CHANNEL_CAPACITY

Default channel capacity for markers pending the writer thread.

DEFAULT_MARKER_MAX_BATCH

Default maximum number of markers collected before forcing a flush.

DEFAULT_MARKER_MAX_LATENCY

Default maximum time a marker batch may accumulate before forcing a flush.

Traits

DataMarkerExtractor

Extracts marker sidecar fields from a concrete market-data message.

MarkerBackend

A durable backend for the data marker sidecar.

Functions

compute_dict_hash

Computes the canonical BLAKE3 hash of a StreamDictEntry.

compute_gap_hash

Computes the canonical BLAKE3 hash of a MarkerGap.

compute_hifi_hash

Computes the canonical BLAKE3 hash of a HiFiMarker.

compute_marker_hash

Computes the canonical BLAKE3 hash of a DataCursorSnapshot.

join_at_entry

Joins folded marker cursors at event_seq_before to replayable catalog rows.

Type Aliases

StreamSlot

A slot index identifying a registered market-data stream.