Signals and Threads Solving Puzzles in Production with Liora Friedberg
22 snips
Oct 7, 2024 Liora Friedberg, a Production Engineer at Jane Street with expertise in economics and computer science, discusses the unique blend of puzzle-solving and software engineering in high-stakes environments. She shares insights on training methods, including tabletop simulations and hands-on exercises, to prepare engineers for the complexities of live system support. Liora also highlights the importance of fostering a blame-free culture, effective monitoring systems, and the art of postmortems to encourage learning and improve operational support.
AI Snips
Chapters
Transcript
Episode notes
Example System and Common Issues
- Liora's team handles trade processing applications. A common issue is new, unconfigured trading activity entering the system, requiring collaboration with the operations team.
Incident Example: Malformed Trades
- An incident involved manually modified trade identifiers causing system crashes. Liora's team resolved it using a tool to remove malformed trades and then reflected on the incident.
Production Engineers as Super-Users
- Production engineers at Jane Street often act as super-users, driving tool development. Liora added a snooze feature to their monitoring software based on her team's needs.