It is a service for complex event processing and analysis of stream data.
It is used to ingest data from input
Process data using query
Write results to output
Filters data after capturing it and send results to downstream process.
Can use spark on azure
- Azure synapse analytics
- Azure databricks
- Azure HDInsight
It is used for streaming data on azure
Spark stream library provides API for ingesting, processing and output results. It is built over dataframe. This API reads data from real time data source such as Kafka hub, file store.
Open source storage layer, support for transactional consistency, schema enforcement
Thanks for reading <3