31 min

DEW #129: DoorDash's Generative AI, Europe data salary, Data Validation with Great Expectations, Expedia's Event Sourcing Data Engineering Weekly

    • Technology

Welcome to another episode of Data Engineering Weekly. Aswin and I select 3 to 4 articles from each edition of Data Engineering Weekly and discuss them from the author’s and our perspectives.

On DEW #129, we selected the following article



DoorDash identifies Five big areas for using Generative AI

Generative AI has taken the industry by storm, and every company is trying to determine what it means to them. DoorDash writes about its discovery of Generative AI and its application to boost its business.


The assistance of customers in completing tasks


Better tailored and interactive discovery [Recommendation]


Generation of personalized content and merchandising


Extraction of structured information


Enhancement of employee productivity



https://doordash.engineering/2023/04/26/doordash-identifies-five-big-areas-for-using-generative-ai/



Mikkel Dengsøe: Europe data salary benchmark 2023

Fascinating findings on Europe’s data salary among various countries. The key findings are


German-based roles pay lower.


London and Dublin-based roles have the highest compensations. The Dublin sample is skewed to more senior roles, with 55% of reported salaries being senior, which is more indicative of the sample than jobs in Dublin paying higher than in London.


The top 75% percentile jobs in Amsterdam, London, and Dublin pay nearly 50% more than those in Berlin



https://medium.com/@mikldd/europe-data-salary-benchmark-2023-b68cea57923d



Trivago: Implementing Data Validation with Great Expectations in Hybrid Environments

The article by Trivago discusses the integration of data validation with Great Expectations. It presents a well-balanced case study that emphasizes the significance of data validation and the necessity for sophisticated statistical validation methods.

https://tech.trivago.com/post/2023-04-25-implementing-data-validation-with-great-expectations-in-hybrid-environments.html



Expedia: How Expedia Reviews Engineering Is Using Event Streams as a Source Of Truth

“Events as a source of truth” is a simple but powerful idea to persist the state of the business entity as a sequence of state-changing events. How to build such a system? Expedia writes about the review stream system to demonstrate how it adopted the event-first approach.

https://medium.com/expedia-group-tech/how-expedia-reviews-engineering-is-using-event-streams-as-a-source-of-truth-d3df616cccd8

Welcome to another episode of Data Engineering Weekly. Aswin and I select 3 to 4 articles from each edition of Data Engineering Weekly and discuss them from the author’s and our perspectives.

On DEW #129, we selected the following article



DoorDash identifies Five big areas for using Generative AI

Generative AI has taken the industry by storm, and every company is trying to determine what it means to them. DoorDash writes about its discovery of Generative AI and its application to boost its business.


The assistance of customers in completing tasks


Better tailored and interactive discovery [Recommendation]


Generation of personalized content and merchandising


Extraction of structured information


Enhancement of employee productivity



https://doordash.engineering/2023/04/26/doordash-identifies-five-big-areas-for-using-generative-ai/



Mikkel Dengsøe: Europe data salary benchmark 2023

Fascinating findings on Europe’s data salary among various countries. The key findings are


German-based roles pay lower.


London and Dublin-based roles have the highest compensations. The Dublin sample is skewed to more senior roles, with 55% of reported salaries being senior, which is more indicative of the sample than jobs in Dublin paying higher than in London.


The top 75% percentile jobs in Amsterdam, London, and Dublin pay nearly 50% more than those in Berlin



https://medium.com/@mikldd/europe-data-salary-benchmark-2023-b68cea57923d



Trivago: Implementing Data Validation with Great Expectations in Hybrid Environments

The article by Trivago discusses the integration of data validation with Great Expectations. It presents a well-balanced case study that emphasizes the significance of data validation and the necessity for sophisticated statistical validation methods.

https://tech.trivago.com/post/2023-04-25-implementing-data-validation-with-great-expectations-in-hybrid-environments.html



Expedia: How Expedia Reviews Engineering Is Using Event Streams as a Source Of Truth

“Events as a source of truth” is a simple but powerful idea to persist the state of the business entity as a sequence of state-changing events. How to build such a system? Expedia writes about the review stream system to demonstrate how it adopted the event-first approach.

https://medium.com/expedia-group-tech/how-expedia-reviews-engineering-is-using-event-streams-as-a-source-of-truth-d3df616cccd8

31 min

Top Podcasts In Technology

Waveform: The MKBHD Podcast
Vox Media Podcast Network
Darknet Diaries
Jack Rhysider
FT Tech Tonic
Financial Times
Lex Fridman Podcast
Lex Fridman
Super Data Science: ML & AI Podcast with Jon Krohn
Jon Krohn
How AI Is Built
Nicolay Gerold