Voices of VR

Kent Bye
Voices of VR

Since May 2014, Kent Bye has published over 1000 Voices of VR podcast interviews featuring the pioneering artists, storytellers, and technologists driving the resurgence of virtual & augmented reality. He's an oral historian, experiential journalist, & aspiring philosopher, helping to define the patterns of immersive storytelling, experiential design, ethical frameworks, & the ultimate potential of XR.

  1. DEC 2

    #1494: Innovative VR Opera “From Dust” Combines GenAI Prompts, Digital Serenading, & Personality Branching

    From Dust is a 24-minute VR Opera by composer Michel van der Aa that is premiering this week at the Rotterdam Immersive Tech Week, and I had a chance to get a sneak peak at the end of my trip covering IDFA DocLab in Amsterdam. The emotional core of From Dust is the top-notch composition from van der Aa and brilliant musical performance by Sjaella. It was a really powerful and moving immersive journey that seamlessly integrated my GenAI prompts creating a personalized experience. I can highly recommend checking it out to see where immersive music experiences are headed here in the future. The throughput of this piece is only 3-4 people per hour, and so it may be hard to be able to see it once they start touring it around Europe to different musical festivals. van der Aa told me that this is the lease commercial project that he's had a chance to ever work on, and acknowledges that this is a piece of subsidized art. There have been a lot of broader discussions happening within the XR industry about the sustainability of these types of location-based experiences, and the need for creators to understand some of the more pragmatic financial constraints for exhibition taking into consideration earlier in the production process. I'm in the process of finishing up the public report from the Think Tank at Venice Immersive this year on this very issue, and the MIT Open Documentary Lab is also actively starting to study these types of distribution questions as well at the R&D Summit at IDFA DocLab this year. But at the same time, it's also great to see artists who are able to get this type of work funded who are willing to push the virtual reality medium to the limits of creative expression despite some of the financial impracticalities of exhibition. Especially as it may drive the adaptation of this type of work into a format like the Apple Vision Pro or PCVR where it can be within a form factor that is a lot more scalable, even if there are compromises on fidelity or on the GenAI elements using the open source LLM of Flux that can not be distributed Steam due to Valve's restrictions on AI integrations within games. https://www.youtube.com/watch?v=ig9VqdLW9X0 I had a chance to catch up with van der Aa last week in order to get more context on his journey and process on creating the piece, as well as get some elaboration on the degree on some of the branching mechanics. There are some questions that they ask during the onboarding process that categorize the user's Big Five Personality characteristics, and then they are creating some invisible branching of my experience that was completely imperceptible to me. van der Aa told me that about 75% of the musical experience is the same for everyone, but that there are some explicit and implicit branching that is happening musically, but also a bit more visually as they are integrating my GenAI prompts in 4-5 different places throughout the experience. It's certainly an innovative and ambitious piece that has some GenAI parallels to Tulpamancer from Venice 2023, but one that shows the potential of combining musical composition with these types of immersive adventures that are able to tell a much richer story when combined. This is a listener-supported podcast through the Voices of VR Patreon. Music: Fatality

    57 min
  2. NOV 13

    #1492: IDFA DocLab Curators Preview 2024 Slate of AI & XR Immersive Documentaries

    I speak with the curators of the 28 immersive documentary projects being featured at the 18th edition of IDFA DocLab including Caspar Sonnen, Nina van Doren, and Toby Coffey. The theme of this year's program is "This is Not a Simulation," and there were many immersive projects that featured AI this year. We talked about each of the experiences in this year's program, except for the three projects I've previously covered at Venice Immersive 2024 (All I Know About Teacher Li, Fragile Home, & Impulse: Play with Reality) . We also briefly discussed the IDFA campaign around being complicit and challenging neutrality. For more information on each of the pieces in this year's program,, then be sure to check out the time stamps below to hear what the curators have to say. 12:15You Can Sing Me on My Way 15:01AI & ME 17:59About a Hero 22:54Oryza: Healing Ground 26:26Future Botanica 27:42Ancestors 31:00Drift 32:58Burn from Absence 36:13Sincerely, Victor Pike 37:22Limbophobia 40:20Ancestral Secret VR 41:04Drinking Brecht: an Automated Laboratory Performance 45:21Dollhouse for Queer Imaginaries 46:36The Liminal 49:38Me, A Depiction 53:55Walking Alone, Text You When I’m Home 56:00Rapture II – Portal 57:12ROAMance 60:02Speechless Witness of a Wandering Tree 61:52Thanks for Being Here 66:41Entropic Fields of Displacement 70:08Google Volume 2 71:46Sena, and Their Garden 73:20Töngö Sondi 75:33Bad Trip This is a listener-supported podcast through the Voices of VR Patreon. Music: Fatality

    1h 25m
  3. OCT 6

    #1489: “Gorilla Tag” Design Philosophy & Embodied Gameplay Deep Dive with Kerestell Smith

    I interviewed Kerestell Smith, Chief Creative Officer at Another Axiom and original solo creator of Gorilla Tag, at Meta Connect 2024. Another Axiom announced in June that Gorilla Tag has surpassed $100 million in lifetime revenue. We talk about the journey into creating Gorilla Tag, the underlying design philosophy of emphasizing embodied gameplay and proprioceptive consistency, as well as what's coming next in their follow-on title of Orion Drift. See more context in the rough transcript below. Since this is the last episode in my series from Meta Connect 2024, then here's a list of all 20+ interviews and 12+ hours of my coverage from this year: #1468: Kickoff of Meta Connect 2024 Coverage with Orion AR Glasses Hands-on Impressions with Tested's Norm Chan & CNET's Scott Stein #1469: Analyst Anshel Sag on Meta Connect Announcements & Orion Glasses Impressions #1470: Meta's Hyperscape Serves Cloud-Rendered, Photo Gaussian Splat Captures #1471: Tyriel Wood & Zimtok5 on Oculus Quest 3S Tradeoffs with Quest 3 #1472: VR Training Trends Using AI with Virti's Courtney Harding #1473: Learn XR's Dilmer Valecillos on Teaching XR Development & Meta Connect Announcement Impressions #1474: Teaching Immersive Storytelling at ASU's Narrative and Emerging Media Program with Nonny de la Peña & Mary Matheson #1475: A-Frame's Diego Marcos on WebXR Momentum and Integrations with Open Source AI #1476: UploadVR Editor Ian Hamilton's Deep Reflections: AR vs VR, Ethical Dilemmas, & Future of Meta's Algorithmic Realities #1477: Flat2VR Studios' Journey of Bringing 2D Games to VR with Eric Masher #1478: Agile Lens 2018: The Intersection of Architecture, Theatre, & Storytelling with Alex Coulombe #1479: Agile Lens 2023: Selling High-End Real Estate with VR, Unreal's Meta Humans. Pixel Streaming, & AI Experiments #1480: Agile Lens 2023: Hands on with Four Seasons VR Demo & A Christmas Carol VR 2023 #1481: Agile Lens 2024: Context on Boz's Apology to VR Devs, Orion AR Glasses Impressions, & Unreal Engine Mediation with Apple/Meta #1482: Mixed Reality Gameplay Innovations & Design Insights from "Starship Home" Co-Directors Mark Schramm & Ashley Pinnick #1483: Dimensional Double Shift Combines Multi-Player Co-Op, "Job Simulator" Gameplay, & Hand Tracking #1484: Cas & Chary on Meta Connect Announcements & Using Ray-Ban Meta Smartglasses to Stay Connected #1485: Fitness Flow States with "Starwave" Design Innovation Leads & Finding Love within VR #1486: Going All in with Gaussian Splats: Gracia's Viewer, AI Training, & Photoreal Capture with VR Fund's Tipatat Chennavasin #1487: XR Evangelists JoyReign & JDun on Horizon World Trends & Meta Connect Announcements #1488: Nima Zeighami on Delivering WebXR Content with Infinite Reality's Ethereal Engine Acquisition #1489: Gorilla Tag Design Philosophy & Embodied Gameplay Deep Dive with Kerestell Smith Here's the launch trailer for Gorilla Tag: https://www.youtube.com/watch?v=ivwQ2DUjcHI Here's a developer snapshot preview of their next title of Orion Drift: https://www.youtube.com/watch?v=8xjnw_skc9g This is a listener-supported podcast through the Voices of VR Patreon.

    1h 6m
4.8
out of 5
172 Ratings

About

Since May 2014, Kent Bye has published over 1000 Voices of VR podcast interviews featuring the pioneering artists, storytellers, and technologists driving the resurgence of virtual & augmented reality. He's an oral historian, experiential journalist, & aspiring philosopher, helping to define the patterns of immersive storytelling, experiential design, ethical frameworks, & the ultimate potential of XR.

You Might Also Like

To listen to explicit episodes, sign in.

Stay up to date with this show

Sign in or sign up to follow shows, save episodes, and get the latest updates.

Select a country or region

Africa, Middle East, and India

Asia Pacific

Europe

Latin America and the Caribbean

The United States and Canada