100 episodes

How do you create innovative machine learning and analytics products? Brian T. O’Neill reveals the strategies and activities that CxOs and innovative leaders in technical product management, data science and analytics are using to deliver indispensable experiences around data. From traditional analytics to machine learning and AI, Brian and his guests explore how extraordinary value can be created when the outputs of data science and analytics are turned into engaging, valuable decision support applications and user experiences centered around the humans in the loop. Experiencing Data also features special guests on design, ethics, explainable AI (XAI), and innovation who relate their expertise to the world of data-driven software. If you're in charge of creating simple, valuable, human-centered data products that produce business value in the last mile, you'll enjoy #ExperiencingData.

Transcripts available at: https://designingforanalytics.com/ed

ABOUT THE HOST
Brian T. O’Neill is a consulting product designer who helps companies create innovative ML and analytics solutions. He is also the founder and principal of Designing for Analytics.…and a professional percussionist/drummer.

Experiencing Data w/ Brian T. O’Neill - Data Products, Product Management, & UX Design Brian T. O’Neill from Designing for Analytics

    • Technology
    • 5.0 • 36 Ratings

How do you create innovative machine learning and analytics products? Brian T. O’Neill reveals the strategies and activities that CxOs and innovative leaders in technical product management, data science and analytics are using to deliver indispensable experiences around data. From traditional analytics to machine learning and AI, Brian and his guests explore how extraordinary value can be created when the outputs of data science and analytics are turned into engaging, valuable decision support applications and user experiences centered around the humans in the loop. Experiencing Data also features special guests on design, ethics, explainable AI (XAI), and innovation who relate their expertise to the world of data-driven software. If you're in charge of creating simple, valuable, human-centered data products that produce business value in the last mile, you'll enjoy #ExperiencingData.

Transcripts available at: https://designingforanalytics.com/ed

ABOUT THE HOST
Brian T. O’Neill is a consulting product designer who helps companies create innovative ML and analytics solutions. He is also the founder and principal of Designing for Analytics.…and a professional percussionist/drummer.

    141 - How They’re Adopting a Producty Approach to Data Products at RBC with Duncan Milne

    141 - How They’re Adopting a Producty Approach to Data Products at RBC with Duncan Milne

    In this week's episode of Experiencing Data, I'm joined by Duncan Milne, a Director, Data Investment & Product Management at the Royal Bank of Canada (RBC). Today, Duncan (who is also a member of the DPLC) gives a preview of his upcoming webinar on April 24, 2024 entitled, “Is that Data Product Worth Building? Estimating Economic Value…Before You Build It!”  Duncan shares his experience of implementing a product mindset within RBC's Chief Data Office, and he explains some of the challenges, successes, and insights gained along the way. He emphasizes the critical role of understanding user needs and evaluating the economic impact of data products—before they are built. Duncan was gracious to let us peek inside and see a transformation that is currently in progress and I’m excited to check out his webinar this month!
    Highlights/ Skip to:
    I introduce Duncan Milne from RBC (00:00)
    Duncan outlines the Chief Data Office's function at RBC  (01:01)
    We discuss data products and how they are used to improve business process (04:05)
    The genesis behind RBC's move towards a product-centric approach in handling data, highlighting initial challenges and strategies for fostering a product mindset (07:26)
    Duncan discusses developing a framework to guide the lifecycle of data products at RBC (09:29)
    Duncan addresses initial resistance and adaptation strategies for engaging teams in a new product-centric methodology (12:04)
    The scaling challenges of applying a product mindset across a large organization like RBC (22:02)
    Insights into the framework for evaluating and prioritizing data product ideas based on their desirability, usability, feasibility, and viability. (26:30)
    Measuring success and value in data product management (30:45)
    Duncan explores process mapping challenges in banking (34:13)
    Duncan shares creating specialized training for data product management at RBC (36:39)
    Duncan offers advice and closing thoughts on data product management (41:38)
    Quotes from Today’s Episode
    “We think about data products as anything that solves a problem using data... it's helping someone do something they already do or want to do faster and better using data." - Duncan Milne (04:29)
    “The transition to data product management involves overcoming initial resistance by demonstrating the tangible value of this approach." - Duncan Milne (08:38)
    "You have to want to show up and do this kind of work [adopting a product mindset in data product management]…even if you do a product the right way, it doesn’t always work, right? The thing you make may not be desirable, it may not be as usable as it needs to be. It can be technically right and still fail. It’s not a guarantee, it’s just a better way of working.” - Brian T. O’Neill (15:03)
    “[Product management]... it's like baking versus cooking. Baking is a science... cooking is much more flexible. It’s about... did we produce a benefit for users? Did we produce an economic benefit? ...It’s a multivariate problem... a lot of it is experimentation and figuring out what works." - Brian T. O'Neill (23:03)
    "The easy thing to measure [in product management] is did you follow the process or not? That is not the point of product management at all. It's about delivering benefits to the stakeholders and to the customer." - Brian O'Neill (25:16)
    “Data product is not something that is set in stone... You can leverage learnings from a more traditional product approach, but don’t be afraid to improvise." - Duncan Milne (41:38)
    “Data products are fundamentally different from digital products, so even the traditional approach to product management in that space doesn’t necessarily work within the data products construct.” - Duncan Milne (41:55)
    “There is no textbook for data product management; the field is still being developed…don’t be afraid to create your own answer if what exists out there doesn’t necessarily work within your context.”- Duncan Milne (42:17)
    Links
    Dunc

    • 43 min
    140 - Why Data Visualization Alone Doesn’t Fix UI/UX Design Problems in Analytical Data Products with T from Data Rocks NZ

    140 - Why Data Visualization Alone Doesn’t Fix UI/UX Design Problems in Analytical Data Products with T from Data Rocks NZ

    This week on Experiencing Data, I chat with a new kindred spirit! Recently, I connected with Thabata Romanowski—better known as "T from Data Rocks NZ"—to discuss her experience applying UX design principles to modern analytical data products and dashboards. T walks us through her experience working as a data analyst in the mining sector, sharing the journey of how these experiences laid the foundation for her transition to data visualization. Now, she specializes in transforming complex, industry-specific data sets into intuitive, user-friendly visual representations, and addresses the challenges faced by the analytics teams she supports through her design business. T and I tackle common misconceptions about design in the analytics field, discuss how we communicate and educate non-designers on applying UX design principles to their dashboard and application design work, and address the problem with "pretty charts." We also explore some of the core ideas in T's Design Manifesto, including principles like being purposeful, context-sensitive, collaborative, and humanistic—all aimed at increasing user adoption and business value by improving UX.
     
    Highlights/ Skip to:
    I welcome T from Data Rocks NZ onto the show (00:00)
    T's transition from mining to leading an information design and data visualization consultancy. (01:43)
    T discusses the critical role of clear communication in data design solutions. (03:39)
    We address the misconceptions around the role of design in data analytics. (06:54) 
    T explains the importance of journey mapping in understanding users' needs. (15:25)
    We discuss the challenges of accurately capturing end-user needs. (19:00) 
    T and I discuss the importance of talking directly to end-users when developing data products. (25:56) 
    T shares her 'I like, I wish, I wonder' method for eliciting genuine user feedback. (33:03)
    T discusses her Data Design Manifesto for creating purposeful, context-aware, collaborative, and human-centered design principles in data. (36:37)
    We wrap up the conversation and share ways to connect with T. (40:49)
    Quotes from Today’s Episode
    "It's not so much that people…don't know what design is, it's more that they understand it differently from what it can actually do..." - T from Data Rocks NZ (06:59)
    "I think [misconception about design in technology] is rooted mainly in the fact that data has been very tied to IT teams, to technology teams, and they’re not always up to what design actually does.” - T from Data Rocks NZ (07:42) 
    “If you strip design of function, it becomes art. So, it’s not art… it’s about being functional and being useful in helping people.” - T from Data Rocks NZ (09:06)
    "It’s not that people don’t know, really, that the word design exists, or that design applies to analytics and whatnot; it’s more that they have this misunderstanding that it’s about making things look a certain way, when in fact... It’s about function. It’s about helping people do stuff better." - T from Data Rocks NZ (09:19)
    “Journey Mapping means that you have to talk to people...  Data is an inherently human thing. It is something that we create ourselves. So, it’s biased from the start. You can’t fully remove the human from the data" - T from Data Rocks NZ (15:36)
     “The biggest part of your data product success…happens outside of your technology and outside of your actual analysis. It’s defining who your audience is, what the context of this audience is, and to which purpose do they need that product. - T from Data Rocks NZ (19:08)
    “[In UX research], a tight, empowered product team needs regular exposure to end customers; there’s nothing that can replace that." - Brian O'Neill (25:58)
    “You have two sides [end-users and data team]  that are frustrated with the same thing. The side who asked wasn’t really sure what to ask. And then the data team gets frustrated because the users don’t know what they want…Nobody really understood wh

    • 42 min
    139 - Monetizing SAAS Analytics and The Challenges of Designing a Successful Embedded BI Product (Promoted Episode)

    139 - Monetizing SAAS Analytics and The Challenges of Designing a Successful Embedded BI Product (Promoted Episode)

    This week on Experiencing Data, something new as promised at the beginning of the year. Today, I’m exploring the world of embedded analytics with Zalak Trivedi from Sigma Computing—and this is also the first approved Promoted Episode on the podcast. In today’s episode, Zalak shares his journey as the product lead for Sigma’s embedded analytics and reporting solution which seeks to accelerate and simplify the deployment of decision support dashboards to their SAAS companies’ customers. Right there, we have the first challenge that Zalak was willing to dig into with me: designing a platform UX when we have multiple stakeholder and user types. In Sigma’s case, this means Sigma’s buyers, the developers that work at these SAAS companies to integrate Sigma into their products, and then the actual customers of these SAAS companies who will be the final end users of the resulting dashboards.  also discuss the challenges of creating products that serve both beginners and experts and how AI is being used in the BI industry.  
     
    Highlights/ Skip to:
    I introduce Zalak Trivedi from Sigma Computing onto the show (03:15)
    Zalak shares his journey leading the vision for embedded analytics at Sigma and explains what Sigma looks like when implemented into a customer’s SAAS product . (03:54)
    Zalak and I discuss the challenge of integrating Sigma's analytics into various companies' software, since they need to account for a variety of stakeholders. (09:53)
    We explore Sigma's team approach to user experience with product management, design, and technical writing (15:14)
    Zalak reveals how Sigma leverages telemetry to understand and improve user interactions with their products (19:54)
    Zalak outlines why Sigma is a faster and more supportive alternative to building your own analytics (27:21)
    We cover data monetization, specifically looking at how SAAS companies can monetize analytics and insights (32:05)
    Zalak highlights how Sigma is integratingAI into their BI solution (36:15)
    Zalak share his customers' current pain points and interests (40:25) 
    We wrap up with final thoughts and ways to connect with Zalak and learn more about Sigma (49:41) 
    Quotes from Today’s Episode
    "Something I’m really excited about personally that we are working on is [moving] beyond analytics to help customers build entire data applications within Sigma. This is something we are really excited about as a company, and marching towards [achieving] this year." - Zalak Trivedi (04:04)
    “The whole point of an embedded analytics application is that it should look and feel exactly like the application it’s embedded in, and the workflow should be seamless.” - Zalak Trivedi (09:29) 
    “We [at Sigma] had to switch the way that we were thinking about personas. It was not just about the analysts or the data teams; it was more about how do we give the right tools to the [SAAS] product managers and developers to embed Sigma into their product.” - Zalak Trivedi (11:30) 
    “You can’t not have a design, and you can’t not have a user experience. There’s always an experience with every tool, solution, product that we use, whether it emerged organically as a byproduct, or it was intentionally created through knowledge data... it was intentional” - Brian O’Neill (14:52) 
    “If we find that [in] certain user experiences,people are tripping up, and they’re not able to complete an entire workflow, we flag that, and then we work with the product managers, or [with] our customers essentially, and figure out how we can actually simplify these experiences.” - Zalak Trivedi (20:54)
    “We were able to convince many small to medium businesses and startups to sign up with Sigma. The success they experienced after embedding Sigma was tremendous. Many of our customers managed to monetize their existing data within weeks, or at most, a couple of months, with lean development teams of two to three developers and a few business-side personnel, generating seven

    • 51 min
    138 - VC Spotlight: The Impact of AI on SAAS and Data/Developer Products in 2024 w/ Ellen Chisa of BoldStart Ventures

    138 - VC Spotlight: The Impact of AI on SAAS and Data/Developer Products in 2024 w/ Ellen Chisa of BoldStart Ventures

    In this episode of Experiencing Data, I speak with Ellen Chisa, Partner at BoldStart Ventures, about what she’s seeing in the venture capital space around AI-driven products and companies—particularly with all the new GenAI capabilities that have emerged in the last year. Ellen and I first met when we were both engaged in travel tech startups in Boston over a decade ago, so it was great to get her current perspective being on the “other side” of products and companies working as a VC.  Ellen draws on her experience in product management and design to discuss how AI could democratize software creation and streamline backend coding, design integration, and analytics. We also delve into her work at Dark and the future prospects for developer tools and SaaS platforms. Given Ellen’s background in product management, human-centered design, and now VC, I thought she would have a lot to share—and she did!
    Highlights/ Skip to:
    I introduce the show and my guest, Ellen Chisa (00:00)
    Ellen discusses her transition from product and design to venture capital with BoldStart Ventures. (01:15)
    Ellen notes a shift from initial AI prototypes to more refined products, focusing on building and testing with minimal data. (03:22)
    Ellen mentions BoldStart Ventures' focus on early-stage companies providing developer and data tooling for businesses.  (07:00)
    Ellen discusses what she learned from her time at Dark and Lola about narrowing target user groups for technology products (11:54)
    Ellen's Insights into the importance of user experience is in product design and the process venture capitalists endure to make sure it meets user needs (15:50)
    Ellen gives us her take on the impact of AI on creating new opportunities for data tools and engineering solutions, (20:00)
    Ellen and I explore the future of user interfaces, and how AI tools could enhance UI/UX for end users. (25:28)
    Closing remarks and the best way to find Ellen on online (32:07)
    Quotes from Today’s Episode
    “It's a really interesting time in the venture market because on top of the Gen AI wave, we obviously had the macroeconomic shift. And so we've seen a lot of people are saying the companies that come out now are going to be great companies because they're a little bit more capital-constrained from the beginning, typically, and they'll grow more thoughtfully and really be thinking about how do they build an efficient business.”- Ellen Chisa (03: 22) 
    “We have this big technological shift around AI-enabled companies, and I think one of the things I’ve seen is, if you think back to a year ago, we saw a lot of early prototyping, and so there were like a couple of use cases that came up again and again.”-Ellen Chisa (3:42)
    “I don't think I've heard many pitches from founders who consider themselves data scientists first. We definitely get some from ML engineers and people who think about data architecture, for sure..”- Ellen Chisa (05:06)  
    “I still prefer GUI interfaces to voice or text usually, but I think that might be an uncanny valley sort of thing where if you think of people who didn’t have technology growing up, they’re more comfortable with the more human interaction, and then you get, like, a chunk of people who are digital natives who prefer it.”- Ellen Chisa (24:51)
    [Citing some excellent Boston-area restaurants!] “The Arc browser just shipped a bunch of new functionality, where instead of opening a bunch of tabs, you can say, “Open the recipe pages for Oleana and Sarma,” and it just opens both of them, and so it’s like multiple search queries at once.” - Ellen Chisa (27:22)
    “The AI wave of  technology biases towards people who already have products [in the market] and have existing datasets, and so I think everyone [at tech companies] is getting this big, top-down mandate from their executive team, like, ‘Oh, hey, you have to do something with AI now.’”- Ellen Chisa (28:37)
    “I think it’s hard to really grasp what an

    • 33 min
    137 - Immature Data, Immature Clients: When Are Data Products the Right Approach? feat. Data Product Architect, Karen Meppen

    137 - Immature Data, Immature Clients: When Are Data Products the Right Approach? feat. Data Product Architect, Karen Meppen

    This week, I'm chatting with Karen Meppen, a founding member of the Data Product Leadership Community and a Data Product Architect and Client Services Director at Hakkoda. Today, we're tackling the difficult topic of developing data products in situations where a product-oriented culture and data infrastructures may still be emerging or “at odds” with a human-centered approach. Karen brings extensive experience and a strong belief in how to effectively negotiate the early stages of data maturity. Together we look at the major hurdles that businesses encounter when trying to properly exploit data products, as well as the necessity of leadership support and strategy alignment in these initiatives. Karen's insights offer a roadmap for those seeking to adopt a product and UX-driven methodology when significant tech or cultural hurdles may exist.
    Highlights/ Skip to:
    I Introduce Karen Meppen and the challenges of dealing with data products in places where the data and tech aren't quite there yet (00:00)
    Karen shares her thoughts on what it's like working with "immature data" (02:27)
    Karen breaks down what a data product actually is (04:20)
    Karen and I discuss why having executive buy-in is crucial for moving forward with data products (07:48)
    The sometimes fuzzy definition of "data products." (12:09)
    Karen defines “shadow data teams” and explains how they sometimes conflict with tech teams (17:35)
    How Karen identifies the nature of each team to overcome common hurdles of connecting tech teams with business units (18:47)
    How she navigates conversations with tech leaders who think they already understand the requirements of business users (22:48)
    Using design prototypes and design reviews with different teams to make sure everyone is on the same page about UX (24:00)
    Karen shares stories from earlier in her career that led her to embrace human-centered design to ensure data products actually meet user needs (28:29)
    We reflect on our chat about UX, data products, and the “producty” approach to ML and analytics solutions (42:11) 
    Quotes from Today’s Episode
    "It’s not really fair to get really excited about what we hear about or see on LinkedIn, at conferences, etc. We get excited about the shiny things, and then want to go straight to it when [our] organization [may not be ] ready to do that, for a lot of reasons." - Karen Meppen (03:00)
    "If you do not have support from leadership and this is not something [they are]  passionate about, you probably aren’t a great candidate for pursuing data products as a way of working." - Karen Meppen (08:30)
    "Requirements are just friendly lies." - Karen, quoting Brian about how data teams need to interpret stakeholder requests  (13:27)
    "The greatest challenge that we have in technology is not technology, it’s the people, and understanding how we’re using the technology to meet our needs." - Karen Meppen (24:04)
    "You can’t automate something that you haven’t defined. For example, if you don’t have clarity on your tagging approach for your PII, or just the nature of all the metadata that you’re capturing for your data assets and what it means or how it’s handled—to make it good, then how could you possibly automate any of this that hasn’t been defined?" - Karen Meppen (38:35)
    "Nothing upsets an end-user more than lifting-and-shifting an existing report with the same problems it had in a new solution that now they’ve never used before." - Karen Meppen (40:13)
    “Early maturity may look different in many ways depending upon the nature of  business you’re doing, the structure of your data team, and how it interacts with folks.” (42:46) 
    Links 
    Data Product Leadership Community https://designingforanalytics.com/community/
    Karen Meppen on LinkedIn: ​​https://www.linkedin.com/in/karen--m/
    Hakkōda, Karen's company, for more insights on data products and services:https://hakkoda.io/ 

    • 44 min
    136 - Navigating the Politics of UX Research and Data Product Design with Caroline Zimmerman

    136 - Navigating the Politics of UX Research and Data Product Design with Caroline Zimmerman

    This week I’m chatting with Caroline Zimmerman, Director of Data Products and Strategy at Profusion. Caroline shares her journey through the school of hard knocks that led to her discovery that incorporating more extensive UX research into the data product design process improves outcomes. We explore the complicated nature of discovering and building a better design process, how to engage end users so they actually make time for research, and why understanding how to navigate interdepartmental politics is necessary in the world of data and product design. Caroline reveals the pivotal moment that changed her approach to data product design, as well as her learnings from evolving data products with the users as their needs and business strategies change. Lastly, Caroline and I explore what the future of data product leadership looks like and Caroline shares why there's never been a better time to work in data.
    Highlights/ Skip to:
    Intros and Caroline describes how she learned crucial lessons on building data products the hard way (00:36)
    The fundamental moment that helped Caroline to realize that she needed to find a different way to uncover user needs (03:51)
    How working with great UX researchers influenced Caroline’s approach to building data products (08:31)
    Why Caroline feels that exploring the ‘why’ is foundational to designing a data product that gets adopted (10:25)
    Caroline’s experience building a data model for a client and what she learned from that experience when the client’s business model changed (14:34)
    How Caroline addresses the challenge of end users not making time for user research (18:00)
    A high-level overview of the UX research process when Caroline’s team starts working with a new client (22:28)
    The biggest challenges that Caroline faces as a Director of Data Products, and why data products require the ability to navigate company politics and interests (29:58)
    Caroline describes the nuances of working with different stakeholder personas (35:15)
    Why data teams need to embrace a more human-led approach to designing data products and focus less on metrics and the technical aspects (38:10)
    Caroline’s closing thoughts on what she’d like to share with other data leaders and how you can connect with her (40:48)
    Quotes from Today’s Episode
    “When I was first starting out, I thought that you could essentially take notes on what someone was asking for, go off and build it to their exact specs, and be successful. And it turns out that you can build something to exact specs and suffer from poor adoption and just not be solving problems because I did it as a wish fulfillment, laundry-list exercise rather than really thinking through user needs.” — Caroline Zimmerman (01:11)
    “People want a thing. They’re paying for a thing, right? And so, just really having that reflex to try to gently come back to that why and spending sufficient time exploring it before going into solution build, even when people are under a lot of deadline pressure and are paying you to deliver a thing [is the most important element of designing a data product].” – Caroline Zimmerman (11:53)
    “A data product evolves because user needs change, business models change, and business priorities change, and we need to evolve with it. It’s not like you got it right once, and then you’re good for life. At all.” – Caroline Zimmerman (17:48)
    “I continue to have lots to learn about stakeholder management and understanding the interplay between what the organization needs to be successful, but also, organizations are made up of people with personal interests, and you need to understand both.” – Caroline Zimmerman (30:18)
    “Data products are built in a political context. And just being aware of that context is important.” – Caroline Zimmerman (32:33)
    “I think that data, maybe more than any other function, is transversal. I think data brings up politics because, especially with larger organizations, there

    • 44 min

Customer Reviews

5.0 out of 5
36 Ratings

36 Ratings

CJG, Data Analyst ,

Only listen if you actually want people to use your data products

I can not stress enough how useful this podcast is. Every episode, every interview, helps illuminate ways to ensure our users are delighted at both our data insights and the ease of getting to those insights. I especially appreciate how this podcast tackles thorny challenges like how to define success metrics for data products and what sorts of environments help data folks thrive. These are discussions we need to be having!

Data PM ,

Great podcast!

In my current company and my prior company (both earlier stage healthcare startups), I often feel like I’m on an island. But, every time I listen to Experiencing Data, I feel so uplifted, gaining new perspectives and validation in some of the challenges I experience in my day to day work.

Will nickname not taken angel ,

Informative and well designed

This is an excellent podcast for anyone interested in making data more useful and less stressful, with great conversations about design and analytics.

Top Podcasts In Technology

Lex Fridman Podcast
Lex Fridman
All-In with Chamath, Jason, Sacks & Friedberg
All-In Podcast, LLC
Acquired
Ben Gilbert and David Rosenthal
The Neuron: AI Explained
The Neuron
TED Radio Hour
NPR
Dwarkesh Podcast
Dwarkesh Patel

You Might Also Like

DataFramed
DataCamp
Data Skeptic
Kyle Polich
Product Thinking
Melissa Perri
The Product Podcast
Product School
a16z Podcast
Andreessen Horowitz
Talk Python To Me
Michael Kennedy (@mkennedy)