#apache-kafka

[ follow ]
InfoQ
3 weeks ago
JavaScript

Allegro Reduces Kafka Producer Latency Outliers by 82% After Switching to XFS

Allegro improved Apache Kafka producer tail latency by experimenting with performance optimization options and switching to XFS filesystem. [ more ]
InfoQ
1 month ago
DevOps

CNCF Incubates Strimzi to Simplify Kafka on Kubernetes

Strimzi simplifies Apache Kafka deployment on Kubernetes with Kubernetes-native operators.
Strimzi's approval by CNCF highlights its technical viability and enhances Kafka management on Kubernetes. [ more ]
TechCrunch
2 months ago
DevOps

WarpStream is building a cheaper, cloud-native streaming service | TechCrunch

WarpStream built a cloud-native streaming solution based on Apache Kafka protocol by leveraging cloud object storage like Amazon S3 for cost reduction and operational efficiency.
The approach of separating compute from storage in a cloud environment allows WarpStream to minimize inter-zone networking costs, enhancing the scalability and affordability of large-scale Kafka workloads. [ more ]
newrelic.com
6 months ago
DevOps

Monitoring Apache Kafka for cloud cost reduction

Apache Kafka is a popular tool for moving large amounts of data in cloud architectures.
Monitoring and optimizing Apache Kafka can help reduce cloud costs.
New Relic Flex is a useful tool for collecting and analyzing Kafka cost data. [ more ]
Medium
3 months ago
Data science

11 Open-Source Data Engineering Tools Every Pro Should Use

Apache Spark is a leading framework for large-scale data processing, offering versatile functionalities like batch processing and stream processing.
Apache Kafka is an open-source streaming platform that is ideal for handling real-time data and high-throughput data feeds.
Snowflake, Amazon Redshift, and Google BigQuery are popular cloud data warehouses, each with unique features that data engineers should understand in order to choose the best fit for their projects. [ more ]
AgileConnection
6 months ago
Scala

What Makes Apache Kafka Suitable for Agile Development

Apache Kafka is suitable for Agile software development due to its simplicity and support for responding to change.
Kafka's simple data flow model and support for events make it easy to produce and consume messages for Agile development. [ more ]
[ Load more ]