Blog | kafka

Get the latest updates and articles on industry trends

Back to main blog

All posts

15 October 2021

How are your microservices talking?

Find out about the challenges of implementing a microservice architecture, in light of different communication types between microservices, and see how pub-sub message transmission can mitigate or even eliminate these challenges.

Auri
13 October 2021|By

Manage Apache Kafka Connect connectors with kcctl

06 October 2021|By

5 reasons why you should be using MirrorMaker 2.0 for data replication

20 September 2021

Announcing Aiven for Apache Kafka cluster configuration backup

Is there a need for backing up your Apache Kafka cluster? Well, yes and no. Find out what we mean by that, and how our backups work.

Auri
18 August 2021

Introduction to event-driven architecture

Goodbye request-response, roll out the red carpet for producers and consumers! Read our article on what event-driven architecture is and why it's a great alternative for building microservice applications.

15 July 2021

Time series or event data? Get less confused

What is time series data? Or in reverse, how can you be sure what kind of data you have? Read on to find out how to tell the difference between time series and event data.

Lorna
10 June 2021

Apache Kafka and the great database debate

Is Kafka a database? Can I throw out my Postgres and use Kafka instead? Is Kafka the new Swiss Army Knife of data? Find out what the debate is about.

Auri
10 May 2021

Teach yourself Apache Kafka and Python with a Jupyter Notebook

Learn the basics of Apache Kafka Producers and Consumers by building an interactive notebook in Python.

Francesco
28 April 2021

Tips for designing payloads

Event-Driven systems are increasingly our future and that's one reason why so many developers are adding Apache Kafka to their tech stacks. In this post, Lorna Mitchell gives tips for designing payloads for your Kafka to achieve a solid data structure.

Lorna
27 April 2021

Aiven supports Apache Kafka 2.8

Aiven is keeping up with the times and now supports the newly released Apache Kafka version 2.8, announced on April 19, 2021. Read on to find out what the new version means for you!

25 March 2021

Using Kafka Connect JDBC Source: a PostgreSQL example

How to update an old app-to-database design to include Kafka? Find out how to use Kafka Connect to integrate to an existing system and use up-to-date tech tools without disrupting the original solution.

Francesco
17 March 2021

Data and disaster recovery

We humans don’t like to think about disasters, but that doesn’t stop them from happening. Read to find out how you should prepare your data for the worst, even while hoping for the best.

James
& Chris
10 February 2021

Create your own data stream for Apache Kafka with Python and Faker

How can you test an empty data pipeline? Well, you can't, really. Read on and let Aiven's Developer Advocate Francesco Tisiot walk you through creating pretend streaming data using Python and Faker.

Francesco
10 February 2021

Broker communication in Apache Kafka 2.7 and beyond

Apache Kafka is moving away from ZooKeeper, slowly but surely. How does this impact broker communication in the latest version of Apache Kafka? How is Aiven preparing for the future? Read on to find out.

Auri
01 February 2021

Kafka v. RabbitMQ - a comparison

Today's post is all about queues and how to choose a solution that fits your application's requirements. We'll go over the key design features of RabbitMQ and Apache Kafka and outline how they process queues differently. Read on, and we'll help you decide which is a better match for you!

Lorna
21 January 2021

Aiven supports Apache Kafka 2.7

Aiven for Apache Kafka moves to version 2.7. To find out what the key improvements in the new version are and how you can get in on the action, read on!

Auri
17 December 2020

5 Benefits of a Kafka-centric microservice architecture

Microservices, rather than one monolithic setup, is the most flexible way to provide an online service today. In this post, we discuss why Apache Kafka is a good choice when microservices are on the line.

Auri
11 November 2020

Alef reaches over 120,000 students with Aiven [Case Study]

Read how Aiven for Apache Kafka enabled Alef Education to scale their blended learning platform from 10 schools to over 400, and improved the reliability of the platform at the same time.

Auri
26 August 2020

Near Real-Time ELT with Apache Kafka & Snowflake

Find out how Convoy built a modern ELT pipeline to reduce their latency from hours to under 5 minutes with Kafka and Snowflake in this guest post.

Adrian
25 August 2020

Load testing your Apache Kafka cluster and consumer applications

David Esposito, our Solutions Architect, explores load testing in Kafka Office Hours, a recurring forum for Apache Kafka thoughtshare hosted by our partner Lenses.io.

Kyle
24 August 2020

The future of IoT: How Comcast is shaping IoT with Aiven [Webinar]

Join us on September 16, 2020, at 6 pm CET / 12 pm EDT for our webinar on the future of IoT, hosted by David Esposito and Comcast's Andrew Gerhold.

Laura
19 August 2020

Aiven supports Apache Kafka 2.6

Apache Kafka 2.6 is now available as a managed service on Aiven. Read this article to find out about the more significant improvements and how to upgrade your Kafka clusters with no downtime.

Kyle
11 August 2020

3 considerations for building an enterprise IoT solution

Our partners at Sierra Wireless are the world's leading IoT solutions provider. With their help, we outline 3 considerations to cover in order to build a successful IoT solution.

Jan
05 August 2020

The top requirements for building performant real-time applications

Olivier de Garrigues from Lenses.io outlines a few things that engineering teams should consider when building and launching real-time apps — particularly in our world of fierce, fast innovation.

Olivier
08 July 2020

Aiven launches Karapace for Kafka Schema and cluster management

Karapace is the only open-source, drop-in alternative to Schema Registry and Kafka REST. Available starting today, find out more about our latest open-source contribution in this post.

John
24 June 2020

Aiven now offers Kafka MirrorMaker 2.0 as a service

Aiven now supports MirrorMaker 2.0 as a service. We'll outline some of the advantages that MirrorMaker 2.0 has over the original MirrorMaker. Spoiler: The difference is night and day.

John
11 June 2020

Apache Kafka 101: The why, what, and how [Webinar]

Join us on June 17th at 3 p.m. CEST/9 a.m. EDT for our webinar where we cover all things Kafka. Hosted by our very own John Hammink and Chris Gwilliams.

John
05 May 2020

Apache Kafka 2.5 now available on Aiven

The latest edition of Apache Kafka, 2.5, is now available on Aiven as a managed service. Find out what they are and how to get it.

John
28 April 2020

You can now view Apache Kafka messages live in the Aiven Console

Viewing Apache Kafka messages live from the Aiven Console provides a host of benefits. Find out what they are and how to set it up in this post.

John
10 March 2020

Aiven is now available in AWS Marketplace

To simplify our customers' procurement and accounting processes, we decided to offer Aiven services in AWS Marketplace. Find out which service we started with and how to get started in this post.

Kyle
23 December 2019

Managed Apache Kafka 2.4 now available on Aiven

You can now get Apache Kafka 2.4 as a managed service on Aiven. Find out what the latest features are and how to get it in this post.

John
02 December 2019

DBAs shouldn't be afraid of managed services

DBAs have raised a lot of objections about moving from on-prem (or self-hosted) to using managed services. In this post, we address each in turn.

John
11 September 2019

Aiven now provides Kafka Connect as separate service

With Kafka Connect as a Service, you can remove resource competition from your primary clusters, find out how.

John
24 June 2019

Aiven Kafka now supports SASL authentication

Aiven Kafka users can now enable SASL authentication between their applications and Aiven Kafka; find out more about it in this post.

John
07 May 2019

Data streaming made easy with Apache Kafka

In this post, we briefly go over the pub / sub model and provide a simple example of setting up a Kafka stream with an ibeacon.

John
21 April 2019

Aiven open sources Google Cloud Storage Kafka connector

Aiven's latest open source connector allows you stream Kafka data to GCS, read this post to learn more about it.

Kyle
15 April 2019

Kafka 2.2 now available on Aiven

Kafka's latest version is now available on Aiven; find out a little more about it in our latest post.

Kyle
20 March 2019

Benchmarking Kafka write throughput performance [2019 UPDATE]

It's been a long time coming, but we've now have updated write throughput kafka benchmark numbers and a few extras surprises.

Heikki
23 January 2019

An introduction to Apache Kafka

Apache Kafka is a great way to implement an event-driven architecture for your microservices. In this blog post we discuss earlier messaging attempts and demystify Apache Kafka by introducing its concepts and use cases.

John
18 December 2018

Aiven statement on license changes for the Confluent Platform

Aiven is committed to an open source platform, users not affected by recent license changes by other vendors.

Heikki
04 December 2018

Get Apache Kafka 2.1 on Aiven

Apache Kafka 2.1 is now available on Aiven with even more performance thanks to some key updates. Find out what they are here.

Kyle
03 August 2018

Aiven Kafka users can now choose preferred major version

With the release of Kafka 1.1.1 and 2.0.0, we've updated our platform to give Aiven Kafka SaaS users the ability to select their preferred version. Learn more in our latest post.

Hannu
07 June 2018

Gain visibility with Aiven Kafka dashboards (Part II)

We recently added a consumer group-level graph to our Kafka dashboards; find out which one and why it's important in this post.

Prem
11 May 2018

Zalando joins Aiven at latest Kafka meetup

Aiven's fourth Kafka meetup was co-hosted at Zalando's Helsinki office. Find out what we discussed and get the slide decks in this latest article.

Kyle
15 March 2018

Gain visibility with Aiven Kafka dashboards

Visualizing and alerting for your Apache Kafka and system resource data are essential for smooth operations. Luckily, Aiven has an inhouse solution; learn more.

Prem
14 March 2018

Introducing improved Aiven Kafka topic management

From options for creating topics automatically to a new ACL permission level, Aiven Kafka users now have greater control over topic management; learn more.

Heikki
16 February 2018

Rovio talks Kafka with Aiven

For our third Kafka meetup, we decided to stop by Rovio HQ and talk shop with their Director of Data Engineering. Find out the details here.

Kyle
19 December 2017

Aiven Kafka 1.0 Is Now Ready

Kafka 1.0 is now available on the Aiven platform. Read our latest post to learn what’s new and why we waited a little while to release it.

Kyle
19 October 2017

Aiven talks shop with Paf at second Apache Kafka meetup

Our second Kafka meetup included Paf’s Niklas Nylund discussing how they used Apache Kafka to reduce the spaghetti. Read to find out the specifics.

Kyle
23 August 2017

Kafka users and access control

Aiven for Apache Kafka now provides user and topic-level control. Find out how this feature will help you manage users and access more effectively.

Heikki
20 June 2017

Kafka Connect Preview

Kafka Connect is now available in preview from Aiven. Find out which connectors we’re starting with and how to set them up.

Heikki
31 May 2017

Larger Aiven for PostgreSQL and Aiven for Apache Kafka plans in Azure

Microsoft Azure continues to grow and so does the demand of Aiven services there, which is why we’ve added larger PostgreSQL and Apache Kafka plans; learn more.

Heikki
20 April 2017

Aiven for Apache Kafka 0.10.2 now available

With improved stability and enhancements, Kafka 0.10.2 adds incredible functionality for Aiven for Apache Kafka users. Read about the specific improvements and how to get it.

Hannu
30 March 2017

Benchmarking Kafka Performance Part 1: Write Throughput

Read our popular post that reviews Apache Kafka's raw write throughput performance in AWS, Azure, Google, and UpCloud.

Heikki
16 March 2017

Bigger Aiven for Apache Kafka plans and introducing Amazon VPC peering

VPC peering in AWS and larger Kafka plans are only a couple improvements made to the Aiven platform. Get the details and find out what else we’ve done.

Hannu
20 December 2016

New amazing features added to Apache Kafka & PostgreSQL

Our region count is now 51 and we’re celebrating by adding new features to Aiven for Apache Kafka and Aiven for PostgreSQL. Find out what features we added.

Oskari
30 November 2016

Aiven in Google Tokyo & other updates

Aiven is now active in Google Tokyo and we’re planning some feature additions to our Kafka and PostgreSQL services. Find out more.

Oskari
18 August 2016

Getting started with Aiven for Apache Kafka

Apache Kafka is powerful, but complicated to run alone. Find out how Aiven for Apache Kafka makes it easy for Aiven users to set up and run Kafka instances here.

Heikki
13 July 2016

Aiven Kafka now publicly available!

Want open-source, vendor-neutral Apache Kafka? Look no further, Aiven Kafka is now available across 4 clouds. Find out the specifics here.

Hannu

Let‘s connect

Aiven for Apache Kafka, Aiven for Apache Kafka Connect, Aiven for Apache Kafka MirrorMaker 2, Aiven for M3, Aiven for M3 Aggregator, Aiven for Apache Cassandra, Aiven for OpenSearch, Aiven for PostgreSQL, Aiven for MySQL, Aiven for Redis, Aiven for InfluxDB, Aiven for Grafana are trademarks and property of their respective owners. All product and service names used in this website are for identification purposes only and do not imply endorsement.