01 The retry is a delivery, not another event
“at-least-once delivery with best-effort de-duplication, not exactly-once.” (opens the source)
Count event identities through late recovery and a second run.
Data engineering interview prep: get the records right
Preserve meaning. Recover late data. Run it twice.
Start with the replayLumen · authored packet
6 expected.
6 stored.
Expected
- v1
- v2
- v3
- v4
- v5
- v6
Stored
- v1
- v3
- v4
- v6
- v5
- v3
v2 missing · v3 counted twice
Inspect the recordsPractice interviews
02 The new field has the same type. Does it mean the same thing?
An AI-written mapping needs a stated unit and the consumer’s test.
03 Fresh data can still be incomplete
“a contract is only valuable if its promises are verifiable and enforceable.” (opens the source)
A green latest partition does not supply the missing older partition.
04 An old update must not undo a newer deletion
Arrival order is not source version order.
05 Two matching pipelines still need one publishing owner
Shadow comparison and traffic allocation solve different problems.
Sources
- Yogesh Nagarur, Author, at the time. Netflix TechBlog, “Behind the Scenes: Evolving Netflix’s Ads Event Pipeline for Live — Part II”, Aug 17, 2026. Open the source. Checked against the published text.
- Devon Edwards Joseph, Senior Engineer, at the time. Spotify Engineering, “Background Coding Agents: Supercharging Downstream Consumer Dataset Migrations (Honk, Part 4)”, Apr 22, 2026. Open the source. Checked against the published text.
- Aezo Teo, Harvey Li, Houren Chen and Feng Cheng, Co-authors, Grab Tech, at the time. Grab Tech, “Data Mesh at Grab (Part II): The foundational tools behind certification”, Apr 30, 2026. Open the source. Checked against the published text.
- Antonia Badarau, Irina Mugford and Massimo Frangiamore, Lead Analytics Engineer; Lead Analytics Engineer; Senior Analytics Engineer, at the time. Monzo Blog, “A “meshy” approach to Data: Enabling 100+ teams to build Data Models”, Apr 22, 2026. Open the source. Checked against the published text.
Last reviewed Nov 10, 2026