Designing A Data-Intensive Future: Expert Talk • Martin Kleppmann & Jesse Anderson • GOTO 2023
This interview was recorded at GOTO Amsterdam for GOTO Unscripted. #GOTOcon #GOTOunscripted #GOTOams
http://gotopia.tech
Read the full transcription of this interview here:
https://gotopia.tech/articles/284
Martin Kleppmann – Researcher at the Technical University of Munich & Author of “Designing Data-Intensive Applications” @kleppmann
Jesse Anderson – Managing Director of Big Data Institute, Host of The Data Dream Team Podcast @jessetanderson
RESOURCES
Jesse Anderson: https://youtu.be/cWSCI1LpoGY
Martin Kleppmann: https://youtu.be/esMjP-7jlRE
Prag. Dave Thomas: https://youtu.be/ug8XX2MpzEw
Kafka in Action: https://youtu.be/2l-JsB10WaI
Kasun Indrasiri: https://youtu.be/lDT2DBaNRC4
Kevlin & Sander: https://youtu.be/JAl3QFae_dE
Eli & Mark: https://youtu.be/Gs1exPFXnQ8
Robert Metzger: https://youtu.be/DkNeyCW-eH0
Laura & Marueen: https://youtu.be/iMx8otu3rFg
https://automerge.org
Martin
https://martin.kleppmann.com
Tweets by martinkl
https://nondeterministic.computer/@martin
https://linkedin.com/in/martinkleppmann
Jesse
Tweets by jessetanderson
https://sodapodcast.libsyn.com/site
https://linkedin.com/in/jessetanderson
https://www.jesse-anderson.com/category/blog
DESCRIPTION
Jesse Anderson, director at Big Data Institute, and Martin Kleppmann, author of “Designing Data-Intensive Applications” explore together the evolving data landscape. They start with the origins of Martin’s book, emphasizing the crucial art of asking the right questions. Martin unveils industry shifts since 2017, spotlighting the transformative rise of cloud services.
The conversation then takes a twist as Martin delves into academia, sharing insights on local-first collaboration software and the fascinating world of Automerge. Aspiring software engineers are treated with some advice on how to navigate the delicate balance between simplicity and adaptability.
The interview concludes with a glimpse into diverse career paths in the dynamic realm of data engineering, making it a must-watch for professionals at every stage of their journey.
TIMECODES
00:00 Intro
02:01 Evolution of data systems
12:18 Embracing change & timeless principles in startups
14:28 Local-first collaboration software
16:46 Reflections on academia
25:29 Advice for aspiring data engineers
27:29 Outro
RECOMMENDED BOOKS
Martin Kleppmann • Designing Data-Intensive Applications • https://amzn.to/3mk2Roj
Martin Kleppmann • Secret Colors: A Gentle Introduction to Cryptography • https://amzn.to/3PgAcyj
Jesse Anderson • Data Teams • https://amzn.to/3N0c2H7
Jesse Anderson • Data Engineering Teams • https://www.bigdatainstitute.io/data-engineering-teams-book
Jesse Anderson • The Ultimate Guide to Switching Careers to Big Data • https://www.jesse-anderson.com/books
Viktor Gamov, Dylan Scott & Dave Klein • Kafka in Action • https://amzn.to/3CrB8KU
Fabian Hueske & Vasiliki Kalavri • Stream Processing with Apache Flink • https://amzn.to/41fNsss
Tweets by GOTOcon
https://www.linkedin.com/company/goto-
https://www.facebook.com/GOTOConferences
#Privacy #CRDTs #Data #LocalFirst #Automerge #ApacheKafka #ApacheFlink #StatefulStream #WebApp #CloudvsLocalFirst #Peritext #Data #DataProject #DataTeams #DataEngineeringTeams #SoftwareEngineering #Programming #DataEngineering #JesseAnderson #MartinKleppmann
Looking for a unique learning experience?
Attend the next GOTO conference near you! Get your ticket at https://gotopia.tech
Sign up for updates and specials at https://gotopia.tech/newsletter
SUBSCRIBE TO OUR CHANNEL – new videos posted almost daily.
https://www.youtube.com/user/GotoConferences/?sub_confirmation=1
by GOTO Conferences
simple network management protocol
Good advice around asking the right questions especially when it comes to consultancies. I worked at a startup come scale up and they brought in ThoughtWorks and I can honestly say they made my job as a data engineer, and in my opinion, the company's entire data direction, considerably worse from a wide variety of angles. Mainly because we didn't really ask the right questions 😢 (but also because of a single approach to everything which no matter what was always the "right way" and we couldn't question it)
Martin, when you gonna publish a new book? Can't wait anymore😇