BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//sf26-agenda//EN
CALSCALE:GREGORIAN
METHOD:PUBLISH
BEGIN:VEVENT
UID:SESS-68@sf26-agenda
DTSTAMP:20261020T151709Z
DTSTART:20261104T210000Z
DTEND:20261104T214500Z
SUMMARY:State of Grace: Transactional State Stores and the End of EOS Recov
 ery Pain in Kafka Streams
LOCATION:Room 2002
DESCRIPTION:Bill Bejeck\n\nFor years\, exactly-once Kafka Streams applicati
 ons have carried a hidden tax: when a task crashes or a transaction times 
 out\, Streams can't trust its local state\, so it wipes every state store 
 and rebuilds it from the changelog topic. For large stores\, that "wipe-an
 d-rebuild" can take hours — or even days — turning a momentary blip in
 to a prolonged outage. This talk explains how two KIPs working in tandem e
 liminate that tax. KIP-1035 moves changelog offsets out of the fragile ext
 ernal .checkpoint file and into the state store itself\, persisting them a
 tomically alongside the data in a dedicated RocksDB column family. KIP-892
  builds on that foundation\, buffering writes and committing data and offs
 ets in a single atomic operation. On failure\, the uncommitted buffer is s
 imply discarded — the on-disk state already matches the last committed o
 ffset\, so there is nothing to rebuild. We'll go under the hood: discussin
 g new APIs\, atomic flush\, read-your-writes isolation levels\, new config
 urations for memory-pressure control\, and what all this means for custom 
 state store implementations. The payoff is concrete and operational. You'l
 l learn how recovery time drops from hours to seconds and how atomic offse
 t+data writes close long-standing EOS correctness gaps. We'll connect each
  change to real production pain — rebalancing storms\, restoration waits
 \, and corrupted checkpoints. You'll leave knowing what changes in your ap
 plication\, which configurations to reach for\, what custom stores must im
 plement\, and which versions deliver these improvements — so you can tur
 n EOS from an expensive guarantee into a fast\, dependable default.
URL:https://sf26.rmoff.net/s/state-of-grace-transactional-state-stores-and-
 the-end-of-eos-68
END:VEVENT
END:VCALENDAR