objectKafkaStreamingDemo extends Assertions with Logging
Simple Kafka Spark Streaming demo which
1. Starts an embedded ZooKeeper server
2. Starts an embedded Kafka server
3. Creates a new topic in the Kafka broker
4. Generates messages and publishes to the Kafka broker
5. Creates a Spark Streaming Kafka input stream which
pulls messages from a Kafka Broker,
runs basic Spark computations on the streaming data,
and writes results to Cassandra
6. Asserts expectations are met
7. Shuts down Spark, Kafka and ZooKeeper
Simple Kafka Spark Streaming demo which 1. Starts an embedded ZooKeeper server 2. Starts an embedded Kafka server 3. Creates a new topic in the Kafka broker 4. Generates messages and publishes to the Kafka broker 5. Creates a Spark Streaming Kafka input stream which pulls messages from a Kafka Broker, runs basic Spark computations on the streaming data, and writes results to Cassandra 6. Asserts expectations are met 7. Shuts down Spark, Kafka and ZooKeeper