AI 'N Stuff

James McCammon

Casual conversations about technology.

  1. 09/23/2024

    Geospatial Data Demystified: Satellites, AI, and Earth’s Hidden Data

    This week, my guest was Yohan Iddawela. Yohan is a geospatial data scientist at the Asian Development Bank and previously worked for the World Bank. He has a PhD in economic geography from the London School of Economics. In this episode, we talked about all things related to geospatial analysis, including fascinating use cases for geospatial data, the integral role of satellites, how AI and machine learning are helping improve geospatial data quality, and a grab bag of other geospatial topics. Be sure to check out Yohan’s newsletter! It's called Spatial Edge, and you can find it on Substack. It covers all the latest innovations in geospatial analysis. You can view a condensed transcript of this conversation along with relevant links here.

    45 min

  2. 09/15/2024

    The weird, wonderful AI art of Niceaunties

    My guest this episode was Niceaunties, the pseudonym of a Singaporean-based AI artist that uses her cultural heritage and childhood experiences growing up with 11 aunties, plus parents and grandparents, as inspiration for an imaged reality she created called the Auntieverse, short for Auntie Universe. I spoke with nice aunties while she was exhibiting her work at the Zona Maco festival in Mexico City in partnership with the gallery Patricia Conde. This was part of a group show sponsored by Fellowship AI, a collective that helps support AI artists. She also recently completed an online solo show with the Fellowship that included more than 1,000 still images of her own work that she curated, many of them selling through Fellowship’s online platform Daily.xyz. We spoke about her inspiration, the AI tools she uses and how her artistic process has changed over time, and about the criticism of AI art from traditional artists. I had a great time speaking with her and I think you’ll enjoy our conversation. - Aunties Nail Spa video discussed in the intro - Niceaunties on Twitter and Instagram. - Full transcript with links to everything discussed is available here.

    34 min

  3. 07/01/2024

    Mitigating Catastrophic AI Risk Through Tort Law

    Earlier this spring, I had the chance to sit down in person with Professor Gabriel Weil here in New York to discuss his proposal for mitigating catastrophic risk from artificial intelligence. Professor Weil's proposal involves instituting a new punitive damages framework, which would increase defiance to AI companies in near miss scenarios where an AI generated harm was limited in its impact, but could have been catastrophic. Much of our discussion comes from Professor Weil's paper, “Tort law is a tool for mitigating catastrophic risk from artificial intelligence.” Professor Weil is a Professor of Law at Toro University, and his work is now partially funded by Open Philanthropy. We start by discussing the definition of harmful AI activity before walking through a case study to demonstrate how the proposal would work in practice. We also contrast Professor Weil's proposal with the current state of law and talk about some criticisms he's received in his response. I thought it was a fascinating conversation, and I think you will, too.

    45 min

  4. 06/05/2024

    AI-inflicted harms: Can insurance fill the gaps?

    Full show notes are available ⁠here⁠. If you follow AI you’ve probably heard about the growing volume of proposed AI legislation in the U.S. and beyond as well as the increasing number of AI-related cases being brought before the courts. Today’s guest argues there is another industry that is a key in handling AI-inflicted harms. Everyone’s favorite, the insurance industry. Anat Lior is a professor at Drexel University’s Kline School of Law and has written broadly about the intersection of insurance and emerging technologies. In our conversation today we’ll be focusing largely on her paper which appeared in the Harvard Journal of Law and Technology called “Insuring AI: The role of insurance in artificial intelligence regulation.” We discuss insurance’s role in society and its intersection with emerging technology, how insurance can supplement the courts and government regulation, and end with a discussion about specific insurance proposals related to autonomous vehicles. I thought it was a fascinating conversation and I think you’ll enjoy it.

    45 min

  5. 05/20/2024

    AI's impact on artist creativity and productivity

    This week, my guest was Eric Zhou, a PhD student at Boston University researching the impact of generative AI on art and artists. We discussed one of Eric's recent research projects, where he acquired access to a vast dataset of activity on a major online art platform. Eric used this data to assess how adopting generative AI tools impacted both the productivity and creativity of thousands of artists across 18 months, totaling about 4 million artworks. This is an important topic, and there were some pretty interesting findings. I think you'll enjoy the conversation. Full show notes available here.

    49 min

  6. 05/13/2024

    Transitioning from scale to efficiency in AI model training

    If you follow AI you might have heard the phrase, “scale is all you need.” The idea that to continue to improve the performance of AI systems, all you need is bigger models and more data. But as AI has continued its rapid advancement the tide is starting to shift on that paradigm. Many of the new AI language and image models released in 2024 have been a fraction of the size of the models we saw in early 2023. But even these smaller models are data hungry. That’s where today’s guest comes in. In a widely circulated paper from April of this year, Vishaal Udandarao and his coauthors showed that when it comes to AI image models, while more data is better, it takes an exponential increase in data volume to achieve a linear improvement in model performance. With concerns that AI models have already exhausted much of the easily scrapable data from the web Vishaal’s paper has added fuel to the conversation around how AI progress can continue. Vishaal is a second-year PhD student at the Max Plank Institute at The University of Tuebingen. He’s also affiliated with the European Laboratory for Learning and Intelligent Systems. Vishaal and I talk in detail about his paper’s results and about what solutions might be available to help continue the progress of AI model development by leveraging existing data more efficiently. Full show notes available here.

    41 min

  7. 04/10/2024

    Translating endangered languages with off-the-shelf large language models

    There are currently 7,000 languages actively spoken in the world and about 40% are endangered, at risk of disappearing forever (see map below, click for a larger version). Can Generative AI systems help us with preservation and education about these languages via translation into English or other high-resource languages? Not today. Current state-of-the-art, off-the-shelf large language models like OpenAI’s GPT-4, Anthropic’s Claude Opus, or Google’s Gemini are able to translate easily between high-resource languages, say translating Spanish to English. But training data for low-resource and endangered languages is sparse and absent from the pre-training data sets used by language models, like the Common Crawl, discussed in last week’s episode. But a team of researchers at Carnegie Mellon University and UC Santa Barbara is trying to solve this problem. They’ve developed LingoLLM, a workflow and pipeline for improving the translation capabilities of large language models for low-resource and endangered languages that don't have much digitized content. Importantly, the workflow doesn’t require any additional training of the language model or special fine-tuning. This week I spoke to Kexun Zhang, a PhD student in computer science at Carnegie Mellon University, who helped lead the first phase of LingoLLM’s development. The LingoLLM workflow automates the creation of a package of linguistic artifacts — like grammar books and a gloss — both of which we talk about during our conversation. This package can then be passed to off-the-shelf language models as part of a structured prompt along with the passage in the low-resource language that needs to be translated. LingoLLM upgrades off the shelf language models from essentially useless in translating low-resource languages to a translation tool that, while not perfect, is still pretty good. Kexun and I talked about how he got interested in linguistics, provide some background about low-resource and endangered languages, and talk in detail about the workflow behind LingoLLM and what challenges remain. I had a great time talking to Kexun, and I think you'll enjoy the conversation.

    39 min

  8. 04/02/2024

    The 100-billion webpage dataset that powers AI

    Full show notes and a transcript are available on 96layers.ai. This week I spoke to Stefan Baack from the Mozilla Foundation about a recent research article he authored on the Common Crawl. The Common Crawl is the name of both a non-profit open-data company founded in 2008 by Gil Elbaz and the name of the associated dataset. The Common Crawl is one of the most important datasets in the Generative AI ecosystem and has been used to train dozens of large language models. To give a sense of just how large Common Crawl, every month it collects 3 to 5 billion webpages, 500 times more webpages than all of the articles on Wikipedia. The associated size of these monthly datasets is around 90 Terabytes, 4,000 times as large as all of the text on Wikipedia. Over its 17 year history Common Crawl has collected more than 250 billion webpages. Stefan is a researcher and data analyst at the Mozilla Foundation’s Insights Team. He completed his PhD at the Research Center for Media and Journalism studies at the University of Grow Knee In, where he wrote a dissertation about the relationship between data journalism and civic tech. Stefan and I spoke about how Common Crawl decides what webpages to collect, about its founder Gil Elbaz and his philosophy of building neutral data companies, about how AI builders utilize and filter Common Crawl, and about how pre-training influences large language model behavior and biases.

    42 min
See All (14)

About

Casual conversations about technology.

Information

  • Creator
    James McCammon
  • Years Active
    2023 - 2024
  • Episodes
    14
  • Rating
    Clean
  • Copyright
    © James McCammon
  • Show Website
    AI 'N Stuff