A monthly overview of things you need to know as an architect or aspiring architect. Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with ...

A monthly overview of things you need to know as an architect or aspiring architect. Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with ...

Streaming is hot. The demand for real-time data processing is rising, and streaming vendors are proliferating and competing. Apache Kafka is a key component in many data pipeline architectures, mostly ...

In this section, we will examine the architectural components and related terminology in Kafka. Basically, Kafka consists of the following components: Kafka Cluster—a collection of one or more servers ...

These days, massively scalable pub/sub messaging is virtually synonymous with Apache Kafka. Apache Kafka continues to be the rock-solid, open-source, go-to choice for distributed streaming ...

Life happens as a continuous flow of events (a stream). Ted Dunning and Ellen Friedman describe new designs for streaming data architecture that help you get real-time insights and greatly improve the ...

The latest trends and issues around the use of open source software in the enterprise. This is a guest post for the Computer Weekly Open Source Inside blog written by by Ben Slater in his role as ...

Drowning in data is not the same as big data. Here's the true definition of big data and a powerful example of how it's being used to power digital transformation. Pulsar is a highly scalable, ...