Data Engineering is the plumbing of data science. Almost invisible, but super important and a big mess when done wrong.
We talk about interesting Data Engineering trends and topics. I also train Data Engineering in my Data Engineering Academy at LearnDataEngineering.com
#90 Taylor McGrath - The Future of the Modern Data Stack
Super happy to have Taylor with me on this stream. She is the VP of Data Labs at Rivery and therefore has a lot of experience with data platforms. We'll talk about the modern data stack and where it's going. I'm excited to hear her experience about the changes that are happening in the data space, and what that means for data engineers & data teams.
#89 Piyush Sachdeva - Getting Into Google After Eight Rejections from Amazon!
In this video I talk to Piyush who's an engineer at Google and has his own YouTube channel: "Tech Tutorials with Piyush". He's a really good guy and I love how he's dedicated to teaching engineering. We are talking about some awesome topics like:
Is Linkedin a must for getting a job?
Tips for recording yourself
Cloud Engineering vs Data Engineering
Which Cloud Platform should you choose right now?
The amazing Google work culture explained
Everybody should learn how to use Kubernetes
How getting rejected over and over at Amazon got him into Google
The hiring process at Google
You can also check this on out on YouTube: https://youtu.be/FZemVaqQcnM
If you want to get into Data Engineering check out my Academy at https://learndataengineering.com
#88 - Wouter Trappers - How to Realize a Data Strategy Like a Pro!
I have seen people doing that wrong a few times. Luckily Wouter Trappers who is helping companies as a professional can help. We talked about The steps you need to take from value proposition to dashboards. Wouter is really knowledgeable and it was super fun talking with him and hearing his approach.
#87 - Dhruba Borthakur - From Hadoop to real time analytics
Dhruba Borthakur is CTO at Rockset and a passionate Data Engineer. Before co-founding Rockset he played a big role in development of Hadoop HDFS at Yahoo as well as HBase and RocksDB at Facebook. His current project is the serverless Rockset platform where you can gain real time analytics insight into your data. I tried it out before our talk and really liked it.
#86 The Ultimate Data Engineering Introduction
The Podcast is back!!!! I promise I am going to keep it up to date this time ;)
In this episode I talk about my newest Data Engineering course. I think it's the ultimate 1 hour 15 minutes introduction to Data Engineering.
There were also a ton of questions from the chat that I answered. Think you really enjoy this.
#085 Big Data and Data Science Landscape plus trying to read Tweets with Nifi
We are looking into the network communication protocol map. I first saw this like 10 years ago and its awesome.
Then we check out the Big Data and Data Science Landscape image. It shows you all the tools available to do data science, machine learning and data engineering. Which is very helpful if you are researching for tools to use.
Before using the Twitter API you got to create a developer account. So, I show you how I created one. After that I tried to get Nifi to download Tweets but it is not working.