Blog | kafka

Get the latest updates and articles on industry trends

Back to main blog

All posts

15 October 2021

How are your microservices talking?

Find out about the challenges of implementing a microservice architecture, in light of different communication types between microservices, and see how pub-sub message transmission can mitigate or even eliminate these challenges.

13 October 2021|By

Manage Apache Kafka Connect connectors with kcctl

06 October 2021|By

5 reasons why you should be using MirrorMaker 2.0 for data replication

20 September 2021

Announcing Aiven for Apache Kafka cluster configuration backup

Is there a need for backing up your Apache Kafka cluster? Well, yes and no. Find out what we mean by that, and how our backups work.

18 August 2021

Introduction to event-driven architecture

Goodbye request-response, roll out the red carpet for producers and consumers! Read our article on what event-driven architecture is and why it's a great alternative for building microservice applications.

15 July 2021

Time series or event data? Get less confused

What is time series data? Or in reverse, how can you be sure what kind of data you have? Read on to find out how to tell the difference between time series and event data.

10 June 2021

Apache Kafka and the great database debate

Is Kafka a database? Can I throw out my Postgres and use Kafka instead? Is Kafka the new Swiss Army Knife of data? Find out what the debate is about.

10 May 2021

Teach yourself Apache Kafka and Python with a Jupyter Notebook

Learn the basics of Apache Kafka Producers and Consumers by building an interactive notebook in Python.

28 April 2021

Tips for designing payloads

Event-Driven systems are increasingly our future and that's one reason why so many developers are adding Apache Kafka to their tech stacks. In this post, Lorna Mitchell gives tips for designing payloads for your Kafka to achieve a solid data structure.

27 April 2021

Aiven supports Apache Kafka 2.8

Aiven is keeping up with the times and now supports the newly released Apache Kafka version 2.8, announced on April 19, 2021. Read on to find out what the new version means for you!

25 March 2021

Using Kafka Connect JDBC Source: a PostgreSQL example

How to update an old app-to-database design to include Kafka? Find out how to use Kafka Connect to integrate to an existing system and use up-to-date tech tools without disrupting the original solution.

17 March 2021

Data and disaster recovery

We humans don’t like to think about disasters, but that doesn’t stop them from happening. Read to find out how you should prepare your data for the worst, even while hoping for the best.

& Chris
10 February 2021

Create your own data stream for Apache Kafka with Python and Faker

How can you test an empty data pipeline? Well, you can't, really. Read on and let Aiven's Developer Advocate Francesco Tisiot walk you through creating pretend streaming data using Python and Faker.

10 February 2021

Broker communication in Apache Kafka 2.7 and beyond

Apache Kafka is moving away from ZooKeeper, slowly but surely. How does this impact broker communication in the latest version of Apache Kafka? How is Aiven preparing for the future? Read on to find out.

01 February 2021

Kafka v. RabbitMQ - a comparison

Today's post is all about queues and how to choose a solution that fits your application's requirements. We'll go over the key design features of RabbitMQ and Apache Kafka and outline how they process queues differently. Read on, and we'll help you decide which is a better match for you!

21 January 2021

Aiven supports Apache Kafka 2.7

Aiven for Apache Kafka moves to version 2.7. To find out what the key improvements in the new version are and how you can get in on the action, read on!

17 December 2020

5 Benefits of a Kafka-centric microservice architecture

Microservices, rather than one monolithic setup, is the most flexible way to provide an online service today. In this post, we discuss why Apache Kafka is a good choice when microservices are on the line.

11 November 2020

Alef reaches over 120,000 students with Aiven [Case Study]

Read how Aiven for Apache Kafka enabled Alef Education to scale their blended learning platform from 10 schools to over 400, and improved the reliability of the platform at the same time.

26 August 2020

Near Real-Time ELT with Apache Kafka & Snowflake

Find out how Convoy built a modern ELT pipeline to reduce their latency from hours to under 5 minutes with Kafka and Snowflake in this guest post.

25 August 2020

Load testing your Apache Kafka cluster and consumer applications

David Esposito, our Solutions Architect, explores load testing in Kafka Office Hours, a recurring forum for Apache Kafka thoughtshare hosted by our partner

24 August 2020

The future of IoT: How Comcast is shaping IoT with Aiven [Webinar]

Join us on September 16, 2020, at 6 pm CET / 12 pm EDT for our webinar on the future of IoT, hosted by David Esposito and Comcast's Andrew Gerhold.

19 August 2020

Aiven supports Apache Kafka 2.6

Apache Kafka 2.6 is now available as a managed service on Aiven. Read this article to find out about the more significant improvements and how to upgrade your Kafka clusters with no downtime.

11 August 2020

3 considerations for building an enterprise IoT solution

Our partners at Sierra Wireless are the world's leading IoT solutions provider. With their help, we outline 3 considerations to cover in order to build a successful IoT solution.

05 August 2020

The top requirements for building performant real-time applications

Olivier de Garrigues from outlines a few things that engineering teams should consider when building and launching real-time apps — particularly in our world of fierce, fast innovation.

08 July 2020

Aiven launches Karapace for Kafka Schema and cluster management

Karapace is the only open-source, drop-in alternative to Schema Registry and Kafka REST. Available starting today, find out more about our latest open-source contribution in this post.

24 June 2020

Aiven now offers Kafka MirrorMaker 2.0 as a service

Aiven now supports MirrorMaker 2.0 as a service. We'll outline some of the advantages that MirrorMaker 2.0 has over the original MirrorMaker. Spoiler: The difference is night and day.

11 June 2020

Apache Kafka 101: The why, what, and how [Webinar]

Join us on June 17th at 3 p.m. CEST/9 a.m. EDT for our webinar where we cover all things Kafka. Hosted by our very own John Hammink and Chris Gwilliams.

05 May 2020

Apache Kafka 2.5 now available on Aiven

The latest edition of Apache Kafka, 2.5, is now available on Aiven as a managed service. Find out what they are and how to get it.

28 April 2020

You can now view Apache Kafka messages live in the Aiven Console

Viewing Apache Kafka messages live from the Aiven Console provides a host of benefits. Find out what they are and how to set it up in this post.

10 March 2020

Aiven is now available in AWS Marketplace

To simplify our customers' procurement and accounting processes, we decided to offer Aiven services in AWS Marketplace. Find out which service we started with and how to get started in this post.

23 December 2019

Managed Apache Kafka 2.4 now available on Aiven

You can now get Apache Kafka 2.4 as a managed service on Aiven. Find out what the latest features are and how to get it in this post.

02 December 2019

DBAs shouldn't be afraid of managed services

DBAs have raised a lot of objections about moving from on-prem (or self-hosted) to using managed services. In this post, we address each in turn.

11 September 2019

Aiven now provides Kafka Connect as separate service

With Kafka Connect as a Service, you can remove resource competition from your primary clusters, find out how.

24 June 2019

Aiven Kafka now supports SASL authentication

Aiven Kafka users can now enable SASL authentication between their applications and Aiven Kafka; find out more about it in this post.

07 May 2019

Data streaming made easy with Apache Kafka

In this post, we briefly go over the pub / sub model and provide a simple example of setting up a Kafka stream with an ibeacon.

21 April 2019

Aiven open sources Google Cloud Storage Kafka connector

Aiven's latest open source connector allows you stream Kafka data to GCS, read this post to learn more about it.

15 April 2019

Kafka 2.2 now available on Aiven

Kafka's latest version is now available on Aiven; find out a little more about it in our latest post.

20 March 2019

Benchmarking Kafka write throughput performance [2019 UPDATE]

It's been a long time coming, but we've now have updated write throughput kafka benchmark numbers and a few extras surprises.

23 January 2019

An introduction to Apache Kafka

Apache Kafka is a great way to implement an event-driven architecture for your microservices. In this blog post we discuss earlier messaging attempts and demystify Apache Kafka by introducing its concepts and use cases.

18 December 2018

Aiven statement on license changes for the Confluent Platform

Aiven is committed to an open source platform, users not affected by recent license changes by other vendors.

04 December 2018

Get Apache Kafka 2.1 on Aiven

Apache Kafka 2.1 is now available on Aiven with even more performance thanks to some key updates. Find out what they are here.

03 August 2018

Aiven Kafka users can now choose preferred major version

With the release of Kafka 1.1.1 and 2.0.0, we've updated our platform to give Aiven Kafka SaaS users the ability to select their preferred version. Learn more in our latest post.

07 June 2018

Gain visibility with Aiven Kafka dashboards (Part II)

We recently added a consumer group-level graph to our Kafka dashboards; find out which one and why it's important in this post.

11 May 2018

Zalando joins Aiven at latest Kafka meetup

Aiven's fourth Kafka meetup was co-hosted at Zalando's Helsinki office. Find out what we discussed and get the slide decks in this latest article.

15 March 2018

Gain visibility with Aiven Kafka dashboards

Visualizing and alerting for your Apache Kafka and system resource data are essential for smooth operations. Luckily, Aiven has an inhouse solution; learn more.

14 March 2018

Introducing improved Aiven Kafka topic management

From options for creating topics automatically to a new ACL permission level, Aiven Kafka users now have greater control over topic management; learn more.

16 February 2018

Rovio talks Kafka with Aiven

For our third Kafka meetup, we decided to stop by Rovio HQ and talk shop with their Director of Data Engineering. Find out the details here.

19 December 2017

Aiven Kafka 1.0 Is Now Ready

Kafka 1.0 is now available on the Aiven platform. Read our latest post to learn what’s new and why we waited a little while to release it.

19 October 2017

Aiven talks shop with Paf at second Apache Kafka meetup

Our second Kafka meetup included Paf’s Niklas Nylund discussing how they used Apache Kafka to reduce the spaghetti. Read to find out the specifics.

23 August 2017

Kafka users and access control

Aiven for Apache Kafka now provides user and topic-level control. Find out how this feature will help you manage users and access more effectively.

20 June 2017

Kafka Connect Preview

Kafka Connect is now available in preview from Aiven. Find out which connectors we’re starting with and how to set them up.

31 May 2017

Larger Aiven for PostgreSQL and Aiven for Apache Kafka plans in Azure

Microsoft Azure continues to grow and so does the demand of Aiven services there, which is why we’ve added larger PostgreSQL and Apache Kafka plans; learn more.

20 April 2017

Aiven for Apache Kafka 0.10.2 now available

With improved stability and enhancements, Kafka 0.10.2 adds incredible functionality for Aiven for Apache Kafka users. Read about the specific improvements and how to get it.

30 March 2017

Benchmarking Kafka Performance Part 1: Write Throughput

Read our popular post that reviews Apache Kafka's raw write throughput performance in AWS, Azure, Google, and UpCloud.

16 March 2017

Bigger Aiven for Apache Kafka plans and introducing Amazon VPC peering

VPC peering in AWS and larger Kafka plans are only a couple improvements made to the Aiven platform. Get the details and find out what else we’ve done.

20 December 2016

New amazing features added to Apache Kafka & PostgreSQL

Our region count is now 51 and we’re celebrating by adding new features to Aiven for Apache Kafka and Aiven for PostgreSQL. Find out what features we added.

30 November 2016

Aiven in Google Tokyo & other updates

Aiven is now active in Google Tokyo and we’re planning some feature additions to our Kafka and PostgreSQL services. Find out more.

18 August 2016

Getting started with Aiven for Apache Kafka

Apache Kafka is powerful, but complicated to run alone. Find out how Aiven for Apache Kafka makes it easy for Aiven users to set up and run Kafka instances here.

13 July 2016

Aiven Kafka now publicly available!

Want open-source, vendor-neutral Apache Kafka? Look no further, Aiven Kafka is now available across 4 clouds. Find out the specifics here.


Let‘s connect

Aiven for Apache Kafka, Aiven for Apache Kafka Connect, Aiven for Apache Kafka MirrorMaker 2, Aiven for M3, Aiven for M3 Aggregator, Aiven for Apache Cassandra, Aiven for OpenSearch, Aiven for PostgreSQL, Aiven for MySQL, Aiven for Redis, Aiven for InfluxDB, Aiven for Grafana are trademarks and property of their respective owners. All product and service names used in this website are for identification purposes only and do not imply endorsement.