loading...

Streaming data from Kafka to Elasticsearch - video walkthrough

rmoff profile image Robin Moffatt ・1 min read

Kafka Connect examples (6 Part Series)

1) Streaming data from Kafka to S3 - video walkthrough 2) Streaming data from Kafka to a Database - video walkthrough 3 ... 4 3) Kafka Connect JDBC Sink: tips & tricks - video walkthrough 4) Kafka Connect JDBC connector: installing a JDBC driver 5) Streaming data from Kafka to Elasticsearch - video walkthrough 6) Loading CSV data into Kafka - video walkthrough

Getting data from Kafka into Elasticsearch is easy with the Kafka Connect sink connector.

Alt Text

Check out this video tutorial on how to use the connector and a walk through some of the common requirements when using it including

  • Updating and deleting documents in Elasticsearch
  • Handling schemas and field mappings, including Timestamp fields
  • Changing the name of the target index
  • Error handling

πŸŽ₯ Watch it here: https://rmoff.dev/kafka-elasticsearch-video

πŸ‘Ύ You can also try it all out for yourself and follow along with the code using Docker at https://rmoff.dev/kafka-elasticsearch

Discussion

markdown guide