End to End Spark Structured Streaming for Kafka Topics
![End to End Spark Structured Streaming for Kafka Topics](/content/images/size/w600/2023/06/spark-minio-kafka.jpg)
Apache Kafka and Apache Spark are two leading technologies used to build the streaming data pipelines that feed data lakes and lake houses. At a really high level, Kafka streams messages to Spark where they are transformed into a format that can be read in by applications and saved to storage.
Read more...