Skip to content

Latest commit

 

History

History
5 lines (4 loc) · 362 Bytes

File metadata and controls

5 lines (4 loc) · 362 Bytes

twitter-spark-processor

Twitter Spark Processor Application cosnumes messages from multiple kafka topic and thier partition
It serailizes and stores only the specific attributes from tweet JSON, serialzes and writes it to AVRO.

When Shutdown Hook is called, It gracefully shuts downs the SparkSession and flushes the Avro to a file in local system.