Data.world

What is the state of Data engineering today and where is it going (or should it be going)?&nbsp; Who better to talk about Data Engineering than the authors of the recent O’Reilly book “Fundamentals of Data Engineering”, Joe Reis and Matt Housley from Ternary Data.&nbsp;&nbsp; Join Tim, Juan, Joe and Matt to discuss the state of data engineering. Conversation highlights: <ul><li>[00:44] Introduction to Joe Reis and Matt Housley</li><li>[03:24] Warm up: what have you engineered or built that has gone terribly wrong?</li><li>[08:28] Data engineering tools and magpie syndrome</li><li>[13:15] How often and where do you see data teams stumbling to get the value out of the technology they have?</li><li>[17:08] Thoughts on diving deep into technologies where there is a skills gap</li><li>[19:39] The curse of familiarity in the context of tools</li><li>[23:55] Learning outside the context of an enterprise, and continously educating yourself on data</li><li>[27:23] Data modeling and where to start learning</li><li>[30:48] Data modeling = business concepts and definitions to relations among data</li><li>[32:05] The human aspect and technical side of data modeling</li><li>[36:19] Business literacy for data engineers</li><li>[38:39] The lifecycle of data</li><li>[43:02] Analytics engineering, the knowledge scientists</li><li>[46:09] Roles within data engineering and bifurcation</li><li>[48:26 The future of data engineering and tabular data</li><li>[52:12] Auto Machine Learning and Tabular Data</li><li>[55:00] Lightning round</li><li>[01:01:01] Tim and Juan's takeaways</li><li>[01:06:18] Three questions about data, life, resources and the show's next guest</li></ul>

A fellow “Recovering Data Scientist,” Matt is also a “Reformed Academic,” holding a PhD in Math and dual Masters degrees in both Math and Physics. It was only natural that he began his career in Academia as a Professor of Mathematics, before joining one of the largest e-commerce companies as a data scientist. 

His STEM background in combination with his knack for teaching makes him a mastermind at overhauling processes, improving teamwork, and incorporating engineering best practices so that real value is delivered to companies. While making the journey from data scientist to data engineer, Matt began to focus more on data & cloud engineering, working extensively with Amazon Web Services, Google Cloud Platform, Containers, Apache Airflow and GPUs, among other technologies. 

Matt Housley

Co-Founder and CTO at Ternary Data

Joe Reis is a “recovering data scientist,” CEO of Ternary Data, and a business-minded data nerd who’s worked in the data industry for 20 years. His responsibilities have ranged from statistical modeling, forecasting, machine learning, data engineering, data architecture, and everything else in between. 

He hosts the popular data show and podcast, the Monday Morning Data Chat, interviews the top thought leaders in data on The Data Nerd Herd, and runs several multi-thousand member meetups, including The Utah Data Engineering Meetup and SLC Python. Joe also teaches at the University of Utah and is the co-author of the O’Reilly book, Fundamentals of Data Engineering. 

When he’s not busy running a company, teaching, or creating content, Joe often finds himself DJing/making music, rock climbing, or trail running in the mountains around Salt Lake City, Utah.

Joe Reis

Co-Founder and CEO at Ternary Data

What is the state of Data engineering today and where is it going (or should it be going)? Who better to talk about Data Engineering than the authors of the recent O’Reilly book “Fundamentals of Data Engineering”, Joe Reis and Matt Housley from Ternary Data.  



Data Engineering: where are we and where are we going? w/ Joe Reis and Matt Housley of Ternary Data

What is the state of Data engineering today and where is it going (or should it be going)? Who better to talk about Data Engineering than the authors of the recent O’Reilly book “Fundamentals of Data Engineering”, Joe Reis and Matt Housley from Ternary Data.  


data.world

Catalog and Cocktails is an honest, no-BS, non-sales-y conversation about data and analytics. This is your unfiltered chat about everything interesting in data and metadata management, DataOps, architecture, and beyond. Join Juan Sequeda and Tim Gasper to explore emerging topics and hear from visionary leaders across the data space.