ChaptersStream Processing

Stream Processing

How do you process data continuously, as events happen, and keep derived views in sync?

4 lessons · 24 concepts · ≈ 1 h 40 min

Not started

  1. Lesson 1 · ≈ 25 min

    Message Brokers & Logs

    Put a durable buffer between the service that says something happened and the services that care. Queues hand out work and forget it; logs remember everything in order, and every reader keeps its own place.

  2. Lesson 2 · ≈ 25 min

    Stream Processing

    A computation that never finishes, over data that never stops and arrives out of order. How stream processors decide what time it is, when an answer is ready, and how they survive crashes without counting anything twice.

  3. Lesson 3 · ≈ 25 min

    Change Data Capture & Event Sourcing

    Your database already writes down every change, in order. Turn that log into a stream and every other system can follow it, or make the log of events the database itself.

  4. Lesson 4 · ≈ 25 min

    Streaming Systems as Architecture

    Put an ordered, replayable log at the centre, and treat every database, index and cache as a view of it. What that buys you, what it costs, and how to stay correct without distributed transactions.