In this article, I will be walking you through the process of installing Apache Kafka successfully on Windows. Let's dive into it.
Apache Kafka is an open-source distributed event streaming platform used by thousands of companies for high-performance data pipelines, streaming analytics, data integration, and mission-critical applications. You can use Kafka for real-time data streaming, big data collection, and real-time data analysis. It can be used with in-memory microservices ensuring durability. It will allow you to feed events to complex event streaming systems. It is one of the most commonly used fault-tolerant messaging systems.
- Download and Install the Java Runtime Environment (JRE8).
This can be done in two different ways which are by:
- Download from the Oracle Java Official Downloads Page here
- Install using Chocolatey by pasting this script on your windows command line.
choco install jdk8
After installing, confirm your Java installation
- Download and Install Apache Zookeeper
Apache Zookeeper helps keeps track of the status of the Kafka cluster nodes and it also keeps track of Kafka topics, partitions.
For the installation process, please follow the steps given below:
- Download the latest stable release of Apache Kafka Binaries - https://kafka.apache.org/downloads
- Visit your downloads folder
- Extract the downloaded file and move it to any folder of your choice. For this tutorial, I recommend moving to the
After moving to the
C:/ folder ;
- Create a
datafolder in the Kafka directory
zookeeperdirectories inside the
C:/kafka, open the config folder in a text editor and update the
zookeeper.propertiesfile. Change the
dataDirvariable to the path where your zookeeper snapshots will be stored as shown in the image below.
- In the same config folder, update the
server.propertiesfile. Update the
log.dirsvariable to the path where your Kafka logs will be stored.
- Start Apache zookeeper,
Open windows command prompt, change your directory to
c:/and run the following scripts
- Start Apache Kafka, open up a new command prompt
Run the following command from
Apache Kafka should start running successfully on your machine 🎉🎉🎉🎉
Apache Kafka is now successfully installed on your machine, you can start making use of Kafka for event and data streaming. Learn more about Kafka Use cases and applications.
If you have any questions, don't hesitate to reach out me on Twitter: @adeileri