Unlocking Sub-Second Latency with Databricks
This is a video about Unlocking Sub-Second Latency with Databricks 00:00 Unlocking Sub-Second Latency with Databricks 00:21 Understanding Spark Streaming Modes 00:37 Today's Scenario: Ethereum Blockchain with Kafka 00:46 Pitch old blog 01:59 MicroBatch Mode Pitch 03:40 Story Time 06:31 Demo start 07:16 Deep Dive into Spark Code and Execution 07:19 Notebook Demo 12:16 DEMO SPARK UI 14:01 Conclusion and Further Resources 14:35 Log4j Analysis 16:27 High Level Difference
Suggested videos
A Deep Dive into Spark Stream Static Joins: Live Demo, Caveats and Tips
Canadian Data Guy · 12:59
Harnessing Spark Streaming: Introduction to the ForEachBatch Function
Canadian Data Guy · 3:39
FutureProof Your Data Engineering Skills: Your Spark Streaming Journey Starts Here
Canadian Data Guy · 1:02:05
Spark Streaming Master Class: Ingest data from Kafka to Delta with Spark Streaming
Canadian Data Guy · 41:05
Spark Streaming Master Class: Ingest data from Kafka to Delta with Spark Streaming
Canadian Data Guy · 1:08
How Spark Structured Streaming Recovers After Failures
Canadian Data Guy · 6:19
How Many Spark Streaming Jobs Can You REALLY Run on One Cluster?
Canadian Data Guy · 11:34
How to generate synthetic data at scale
Canadian Data Guy · 8:35