Data Engineering · Advanced

Spark Structured Streaming

Design fault-tolerant streaming pipelines with event time, windows, watermarks, and checkpoints.

  • 26 hoursself-paced
  • 3 units9 lessons
  • 3 labs0 projects
  • 4 hrs/weeksuggested pace
Community

Preview “Batch versus stream processing” before enrolling

Make a confident choice

Course overview

Build on Spark fundamentals to process unbounded data safely. Handle late events, state, recovery, observability, and production deployment constraints.

Who this is for

You already build with this technology and want deeper engineering, verification, and portfolio evidence.

Prerequisites

No previous OSEKOO ACADEMY course is required. Use the optional diagnostic to confirm your starting point.

Syllabus

Each unit combines explanation, guided practice, a checkpoint, and practical evidence. Open a unit to review the exact sequence.

1. Streaming Fundamentals3 lessons

Lesson sequence

  1. Batch versus stream processing · Free preview
  2. Sources, sinks, and triggers
  3. Event time and processing time
2. Stateful Processing3 lessons

Lesson sequence

  1. Windows and aggregations
  2. Watermarks and late data
  3. State management and deduplication
3. Production Streaming3 lessons

Lesson sequence

  1. Checkpointing and recovery
  2. Monitoring streaming queries
  3. Capstone: real-time metrics pipeline
How mastery is verified

Assessment model

Progress is more than watching lessons. You practise, receive checkpoint feedback, and submit evidence that can be reviewed.

  1. Check your starting pointTake the optional, unscored diagnostic.
  2. Practise and check understandingComplete labs and unit checkpoints as you learn.
  3. Prove the skillComplete every lesson and required lab, score 80% on the technical exam, and earn 70% on the reviewed project.
Verified learner reviews

Learner feedback

No published reviews yet. Enrolled learners can submit the first review.