#data-streaming

[ follow ]
fromHackernoon
1 year ago
DevOps

Apache Kafka's New Tiered Storage: What Developers Need to Know | HackerNoon

Apache Kafka's Tiered Storage eliminates the trade-off between high storage costs and data retention.
Scala
fromMedium
1 month ago

Building Composable AI Systems for Better Testability and Maintainability

AI systems can be made more reliable by treating components as discrete versioned parts.
#data-integrity
fromInfoQ
5 months ago
Business intelligence

Stream All the Things: Patterns of Effective Data Stream Processing Explored by Adi Polak at QCon SF

Data streaming challenges persist despite advancements, leading organizations to seek effective solutions for scalable pipelines.
Achieving exactly-once semantics is vital for reliability in data processing systems, especially with modern architectures.
fromMedium
3 months ago
Scala

Spark Stateful Stream Deduplication

Implementing a deduplication mechanism is essential for maintaining data pipeline integrity in IoT data streams to manage duplicate events effectively.
fromInfoQ
5 months ago
Business intelligence

Stream All the Things: Patterns of Effective Data Stream Processing Explored by Adi Polak at QCon SF

Data streaming challenges persist despite advancements, leading organizations to seek effective solutions for scalable pipelines.
Achieving exactly-once semantics is vital for reliability in data processing systems, especially with modern architectures.
fromMedium
3 months ago
Scala

Spark Stateful Stream Deduplication

Implementing a deduplication mechanism is essential for maintaining data pipeline integrity in IoT data streams to manage duplicate events effectively.
more#data-integrity
fromMedium
8 months ago
Science

Enhancing Flink's AWS Integration: Custom SQS Source in Scala

Create custom source functions in Flink to integrate with AWS SQS and enhance streaming data processing.
[ Load more ]