loading...

Explore Enterprise Apache Flink with Cloudera Streaming Analytics - CSA 1.2

tspannhw profile image Timothy Spann Originally published at datainmotion.dev on ・2 min read



Explore Enterprise Apache Flink with Cloudera Streaming Analytics - CSA 1.2

What's New in Cloudera Streaming Analytics

https://docs.cloudera.com/csa/1.2.0/release-notes/topics/csa-what-new.html

https://docs.cloudera.com/csa/1.2.0/index.html

Try out the tutorials now: https://github.com/cloudera/flink-tutorials

So let's get our Apache Flink on, as part of my FLaNK Stack series I'll show you some fun things we can do with Apache Flink + Apache Kafka + Apache NiFi.

We will look at some of updates in Apache Flink 1.10 including the SQL Client and API.

We are working with Apache Flink 1.10, Apache NiFi 1.11.4 and Apache Kafka 2.4.1.

The SQL features are strong and we will take a look at what we can do.

https://docs.cloudera.com/csa/1.2.0/release-notes/topics/csa-supported-sql.html

Table connectors

  • Kafka
  • Kudu
  • Hive (through catalog)

Data formats (Kafka)

  • JSON
  • Avro
  • CSV

Using Hive Catalog with Flink SQL: https://docs.cloudera.com/csa/1.2.0/flink-sql-table-api/topics/csa-hive-catalog.html

Use Kudu Catalog with Flink SQL: https://docs.cloudera.com/csa/1.2.0/flink-sql-table-api/topics/csa-kudu-catalog.html

Building a DataStream Application in Flink

https://docs.cloudera.com/csa/1.2.0/flink-sql-table-api/topics/csa-sql-table-api.html

Build A Flink Project

mvn archetype:generate \ -DarchetypeGroupId=org.apache.flink \ -DarchetypeArtifactId=flink-quickstart-java \ -DarchetypeVersion=1.10.0

References :

Posted on by:

tspannhw profile

Timothy Spann

@tspannhw

I am a Principal Field Engineer for Data in Motion at Cloudera. I work with Apache NiFi, Apache Kafka, Apache Spark, Apache Flink, IoT, MXNet, DLJ.AI, Deep Learning, Machine Learning, Streaming...

Discussion

markdown guide