Divorce the IRS

James Miller
  • 5.0 (4)
  • INVESTING

Welcome to Divorce the IRS, the Retirement Income Planning Podcast—built for people who want to pay the least amount of taxes possible and create retirement income that actually lasts. Inspired by Jimmy Miller’s bestselling book Divorce, the IRS, this show takes you behind the scenes of the tax rules, retirement strategies, and planning decisions that can quietly determine how much of your money you keep. The truth is, taxes aren’t just “something you deal with later.” The U.S. tax code is massive, confusing by design, and full of traps that can hit hardest right when you need your money most. From 401(k)s and IRAs to Social Security and Medicare, many common “smart moves” can turn into expensive surprises—like required minimum distributions, Medicare surcharges, the widow’s penalty, and other retirement tax time bombs most people don’t see coming until it’s too late. With 20+ years of experience as a global wealth manager, Jimmy breaks these topics down in a clear, practical way—so you can plan proactively, avoid unnecessary taxes, and build a retirement where your delayed gratification finally pays off. Subscribe so you never miss an episode, and remember: this podcast is for general education only and isn’t legal, tax, or investment advice—always consult a qualified professional for guidance specific to your situation.

  1. 4D AGO

    Tax Time Bomb 3: Sharing Your Retirement with the IRS

    Many people spend decades building their retirement savings, believing the money in their IRA or 401(k) will fully belong to them once they stop working. But when retirement finally arrives, many retirees discover a difficult truth: a significant portion of those savings was never fully theirs to begin with. In this episode of The Divorce the IRS Podcast, we explore the third major tax time bomb that appears at retirement — sharing your retirement with the IRS. While tax-deferred accounts provide valuable deductions during your working years, those tax benefits come with a future obligation. Once withdrawals begin, the IRS starts collecting on decades of deferred taxes. We discuss why many retirees are surprised to find themselves in similar tax brackets in retirement, why traditional deductions often disappear once you stop working, and how the balance in your retirement account may not represent the amount you actually get to spend. If you've built substantial savings in traditional retirement accounts, understanding this concept is critical to managing your income and taxes in retirement. What We’ll Talk About Why tax-deferred retirement accounts eventually trigger taxes in retirementThe hidden reality behind IRA and 401(k) balancesWhy many retirees are not in a lower tax bracket after leaving the workforceHow deductions and credits often disappear in retirementWhy part of your retirement account effectively belongs to the IRSThe concept of an “ideal number” for tax-deferred savingsWhy retirement planning should focus on after-tax income, not just tax deductionsTax-deferred strategies can play an important role in retirement planning. But without a clear tax strategy, many retirees discover too late that a portion of their savings was already spoken for. In the next episode, we’ll introduce tax time bomb number four and explore another hidden way retirement income can trigger unexpected taxes. Visit Divorce-the-IRS.com Visit Baobab Wealth Visit Baobab Wealth Abroad Buy a copy of Jimmy's book, Divorce the IRS Follow us on Facebook Subscribe to us on YouTube Connect with us on LinkedIn

    5 min

  2. MAR 3

    Tax Time Bomb 2: Early Withdrawal Penalties

    Withdrawing from your retirement account may seem like a quick solution when life throws you a curveball. But what if that decision quietly costs you far more than you realize, both today and decades into the future? In this episode of The Divorce the IRS Podcast, we break down the second major tax time bomb: early withdrawal penalties. While retirement accounts like 401(k)s and IRAs offer valuable tax advantages on the way in, accessing that money before age 59½ can trigger taxes, penalties, and long-term opportunity costs that compound over time. Life happens. Divorce. Job loss. Home repairs. Medical expenses. Financial pressure can push even disciplined savers to tap into retirement funds. But as we illustrate through a real-world example, the true cost of early withdrawals goes well beyond the 10 percent penalty. We walk through the case of Mike, a 35-year-old earning $110,000 per year who needs $30,000 for an emergency. To net that amount from his 401(k), he would actually need to withdraw $50,000 after accounting for federal taxes, state taxes, and penalties. What feels like a $30,000 solution becomes a $50,000 withdrawal — and potentially hundreds of thousands in lost future growth. You will learn: • How early withdrawal penalties work and why they are so costly • The true tax impact of taking money out before age 59½ • How taxes and penalties can force you to withdraw far more than you need • The long-term opportunity cost of interrupting compound growth • Why more Americans are tapping retirement accounts early • The limited 2024 emergency withdrawal exception and how it works • How Roth contributions differ from traditional IRA withdrawals • Why a properly structured emergency fund is your first line of defense We also explore the emotional side of these decisions. While some withdrawals are unavoidable, many are preventable. Using retirement savings for non-emergencies like vehicles, weddings, or lifestyle purchases can create financial damage that lasts far longer than the purchase itself. The solution is preparation. Establishing three to six months of living expenses in a liquid emergency fund can prevent the need to trigger unnecessary tax consequences. We also discuss how Roth contributions offer more flexibility, since contributions (not growth) can generally be accessed without taxes or penalties. This episode is not about guilt. It is about awareness. Retirement accounts are designed for long-term growth and long-term security. When accessed early, the damage is not just immediate. It compounds. In the next episode, we will introduce the third tax time bomb: sharing your retirement account with the IRS — and why many retirees are surprised by how much of their savings was never truly theirs to begin with. Visit Divorce-the-IRS.com Visit Baobab Wealth Visit Baobab Wealth Abroad Buy a copy of Jimmy's book, Divorce the IRS Follow us on Facebook Subscribe to us on YouTube Connect with us on LinkedIn

    7 min

  3. FEB 24

    Tax Time Bomb 1: Exploding Tax Rates

    Getting a tax deduction today feels responsible. But what if the bigger risk to your retirement is not how much you are paying in taxes now, but how much you might be forced to pay later? In this episode of The Divorce the IRS Podcast, we begin breaking down the first of eight major tax time bombs that can quietly threaten your long-term financial plan: exploding tax rates. Over the past several episodes, we have laid the foundation by unpacking basic tax concepts and challenging common assumptions. Now we shift into the structural risks built into many retirement strategies that often go unnoticed. Financial planning is always based on two categories of assumptions. The first includes the things you control, such as how much you save, how you invest, and when you retire. The second includes the things you cannot control, such as inflation, longevity, and future tax rates. Tax rates are one of the biggest unknown variables in retirement planning. As of 2026, the U.S. national debt exceeds 38 trillion dollars. Social Security and Medicare face long term funding pressure. Historically, tax rates have been far higher than they are today, with top marginal rates reaching 50 percent, 70 percent, and even 91 percent in prior decades. Today the top bracket is 37 percent. Are we truly in a high tax environment, or are we living through historically low rates? In this episode, we examine why rising government deficits increase long term tax risk and why today may represent a rare planning window to take action. We also introduce Roth strategies and Roth conversions as a way to lock in known tax rates instead of leaving your retirement exposed to unknown future policy changes. You will learn: Why future tax rates are completely outside your controlHow government debt and entitlement funding pressures can influence taxesA brief history of U.S. tax brackets and what it suggests about the futureWhy today’s rates may represent an opportunity that will not last foreverHow Roth conversions can help you lock in known tax ratesThe mortgage refinance analogy and how it applies to your IRAHow even a small increase in tax rates can compound into large lifetime costsWhy deferring taxes can benefit the IRS more than it benefits youWe explain why paying taxes intentionally today at known and historically low rates can function like refinancing your IRA. Many people instinctively prefer to defer taxes, but that strategy assumes future rates will be equal or lower. If they are higher, the long term cost can be significant. This episode introduces the first tax time bomb: exploding tax rates. It sets the stage for the remaining seven, each with the potential to create unnecessary lifetime tax exposure if left unaddressed. The goal is not fear. It is preparation. You cannot control government tax policy. But you can control how exposed you are to it. In upcoming episodes, we will continue breaking down the remaining tax time bombs and show you practical ways to defuse them before they quietly erode your retirement savings. Visit Divorce-the-IRS.com Visit Baobab Wealth Visit Baobab Wealth Abroad Buy a copy of Jimmy's book, Divorce the IRS Follow us on Facebook Subscribe to us on YouTube Connect with us on LinkedIn

    7 min
  4. Myth of the Lower Tax Bracket

    FEB 17

    Myth of the Lower Tax Bracket

    Getting a tax deduction today feels smart. But what if the strategy you’ve been told will “save you money” is quietly setting you up to pay far more over your lifetime? In this episode of The Divorce the IRS Podcast, we tackle one of the biggest myths in retirement planning: the belief that you’ll automatically be in a lower tax bracket when you retire. It sounds logical. You stop working, your income drops, and therefore your taxes drop too. But for disciplined savers — especially those consistently contributing to traditional 401(k)s and IRAs — that assumption often doesn’t hold up. We walk through detailed, real-world numbers showing how tax-deferred investing can function more like a loan from the IRS than true tax savings. When you contribute pre-tax dollars, you’re not just deferring taxes on what you put in — you’re deferring taxes on decades of compounded growth. That future liability can grow into what we call a “tax time bomb.” Using a 30-year example, we show how someone can save roughly $165,000 in taxes during their working years — only to pay back hundreds of thousands, or even close to a million dollars, in retirement. Even when assuming lower returns or conservative withdrawal strategies, the math often still favors the IRS. We also discuss why many retirees don’t actually end up in lower brackets. The deductions that helped during working years often disappear. Tax rates are controlled by the government — not you. Social Security can become taxable. Medicare premiums can increase. And required withdrawals can force income higher than expected. You’ll learn: Why the “lower tax bracket in retirement” argument often fails How tax-deferred growth creates compounding future tax obligations The impact of losing deductions in retirement How government tax policy risk affects long-term planning Why total lifetime taxes matter more than marginal tax brackets How to think about creating a near-zero tax retirement strategyThis episode introduces the concept of the eight tax time bombs that can quietly explode in retirement if you’re not planning properly. In the episodes ahead, we’ll break down each one and show you how to defuse them. The goal isn’t to say tax deferral never makes sense. It’s to challenge the assumption that it automatically does. Your tax bracket today is only part of the story. Your lifetime tax bill is what really matters. Visit Divorce-the-IRS.com Visit Baobab Wealth Visit Baobab Wealth Abroad Buy a copy of Jimmy's book, Divorce the IRS Follow us on Facebook Subscribe to us on YouTube Connect with us on LinkedIn

    15 min
  5. The Hidden Risk of Year-by-Year Tax Advice

    FEB 9

    The Hidden Risk of Year-by-Year Tax Advice

    Getting a big tax refund feels good. But what if that short-term win is quietly costing you far more over your lifetime? In this episode of The Divorce the IRS Podcast, we explore why common tax advice — even from well-meaning professionals — may not be aligned with your long-term financial best interest. Most tax preparers are trained to focus on one goal each year: helping you get the largest legal refund or the lowest current tax bill. What often gets overlooked is how those decisions impact your lifetime tax burden. Tax preparation is not the same as tax planning — and the difference can mean tens or even hundreds of thousands of dollars over time. We break down how short-term tax deductions can function more like a loan from the IRS than true savings. By deferring taxes today, many people are creating future tax liabilities on both their original contributions and decades of growth. The result can be what we call a “tax time bomb” — a growing obligation that shows up later in life when flexibility matters most. You’ll learn: The difference between tax preparation and long-term tax planningWhy maximizing deductions each year may not minimize lifetime taxesHow tax-deferred accounts can create compounding future tax obligationsThe role instant gratification plays in financial decision-makingWhen tax-deferred strategies do make senseWarning signs that taxes aren't being factored into your financial planWe also discuss how some financial products and strategies can unintentionally increase long-term tax exposure when used without a comprehensive plan. The goal isn’t to criticize tax professionals — they serve an important role. But your tax return is a snapshot of one year, while your financial life spans decades. The strategy that feels good today may not be the one that protects you tomorrow. Visit Divorce-the-IRS.com Visit Baobab Wealth Visit Baobab Wealth Abroad Buy a copy of Jimmy's book, Divorce the IRS Follow us on Facebook Subscribe to us on YouTube Connect with us on LinkedIn

    10 min
  6. A Crime Against Young People

    FEB 3

    A Crime Against Young People

    Most young professionals are unknowingly setting themselves up for higher taxes later in life. In this episode of The Divorce the IRS Podcast, we break down one of the biggest financial planning mistakes early-career workers make — prioritizing traditional, tax-deferred retirement accounts over Roth options when they are likely in the lowest tax bracket they’ll ever see. When you first enter the workforce, your income is typically lower than it will be later in life. That means your tax rate may be at its most favorable. Yet many people are taught to delay taxes through traditional 401(k) contributions instead of taking advantage of Roth accounts, where contributions are taxed now but can grow tax-free for decades. We walk through a real-world example of a young professional just starting his career and show how small short-term tax savings today can turn into a long-term tax burden later — especially once growth, compounding, and potential early withdrawal penalties are factored in. You’ll learn: Why early career tax brackets matter more than most people realizeThe long-term tradeoff between traditional and Roth retirement accountsHow tax-deferred savings can create future “tax time bombs”Why financial education is critical for young earnersThe importance of building an emergency fund before aggressive retirement savingThis episode is designed to help younger workers — and the people guiding them — think differently about taxes, retirement strategy, and long-term financial flexibility. If you know someone just starting their career, this is an important conversation to share. Visit Divorce-the-IRS.com Visit Baobab Wealth Visit Baobab Wealth Abroad Buy a copy of Jimmy's book, Divorce the IRS Follow us on Facebook Subscribe to us on YouTube Connect with us on LinkedIn

    6 min
  7. Are You Borrowing Money From The IRS?

    JAN 26

    Are You Borrowing Money From The IRS?

    In this episode of The Divorce the IRS Podcast, we break down a retirement planning idea that most people misunderstand: the so-called “tax deduction” you get when contributing to tax-deferred accounts like traditional IRAs and 401(k)s. What if those deductions aren’t really deductions at all—but small loans from the IRS that come due later? We start by revisiting the three tax buckets—Tax Me Now, Tax Me Later, and Tax Me Never—and focus on the bucket most Americans rely on: the Tax Me Later bucket. This includes traditional IRAs, 401(k)s, and similar plans where contributions are pre-tax, growth is tax-deferred, and withdrawals are taxed as ordinary income. While these accounts are incredibly popular, they also keep the IRS permanently attached to your retirement savings. Next, we explain why tax deferral works more like borrowing than saving. When you contribute pre-tax dollars, you’re not avoiding taxes—you’re postponing them. The IRS simply allows you to delay paying its share today, placing a lien on both your contributions and all future growth. When the money is withdrawn in retirement, the IRS collects—often on a much larger balance. We walk through a simple example to show how this works in real life and why growth inside tax-deferred accounts can actually increase your lifetime tax bill. Even if you’re in a lower tax bracket later, you may still pay back more than you ever saved. Finally, we explore why Roth accounts—part of the Tax Me Never bucket—can be one of the easiest ways to boost real retirement savings. By paying tax upfront, you eliminate future tax uncertainty and keep 100% of your retirement income working for you, not the IRS. The big takeaway: retirement accounts aren’t about getting deductions today—they’re about maximizing spendable income later. If you want to stop borrowing from the IRS and start building a more tax-free future, this episode shows you where to begin. Visit Divorce-the-IRS.com Visit Baobab Wealth Visit Baobab Wealth Abroad Buy a copy of Jimmy's book, Divorce the IRS Follow us on Facebook Subscribe to us on YouTube Connect with us on LinkedIn

    10 min
  8. The Three Tax Buckets

    JAN 19

    The Three Tax Buckets

    In this episode of The Divorce the IRS Podcast, we break down one of the most important concepts in tax-smart investing: the three tax buckets. Every account you own falls into one of these categories—Tax Me Now (taxable), Tax Me Later (tax-deferred), or Tax Me Never (tax-free). Understanding which bucket your money lives in can have a massive impact on your taxes in retirement. We start with the Tax Me Now bucket, which includes bank accounts and brokerage accounts where you pay taxes on interest, dividends, and gains along the way. These accounts offer liquidity and flexibility, making them ideal for emergency funds and short-term savings—but they can be tax-inefficient over time. Next, we cover the Tax Me Later bucket, which includes traditional IRAs, 401(k)s, 403(b)s, and similar plans. Contributions are tax-deductible, growth is tax-deferred, but withdrawals are taxed as ordinary income. While this is America’s most popular retirement savings bucket, it also keeps you permanently tied to the IRS. Finally, we explore the Tax Me Never bucket, which includes Roth accounts and certain life insurance retirement plans. You pay tax upfront, but qualified withdrawals are income-tax free—and crucially, they don’t count as provisional income for Social Security or Medicare calculations. The big takeaway: your goal shouldn’t just be to save—it should be to save in the right bucket. We’ll explain why most people are over-exposed to the Tax Me Later bucket and how to start shifting toward a more tax-free future. Resources Mentioned in This Episode Ideal Number Calculator: https://divorce-the-irs.com/ideal-number/ Visit Divorce-the-IRS.com Visit Baobab Wealth Visit Baobab Wealth Abroad Buy a copy of Jimmy's book, Divorce the IRS Follow us on Facebook Subscribe to us on YouTube Connect with us on LinkedIn

    11 min
See All (13)

Ratings & Reviews

5
out of 5
4 Ratings

About

Welcome to Divorce the IRS, the Retirement Income Planning Podcast—built for people who want to pay the least amount of taxes possible and create retirement income that actually lasts. Inspired by Jimmy Miller’s bestselling book Divorce, the IRS, this show takes you behind the scenes of the tax rules, retirement strategies, and planning decisions that can quietly determine how much of your money you keep. The truth is, taxes aren’t just “something you deal with later.” The U.S. tax code is massive, confusing by design, and full of traps that can hit hardest right when you need your money most. From 401(k)s and IRAs to Social Security and Medicare, many common “smart moves” can turn into expensive surprises—like required minimum distributions, Medicare surcharges, the widow’s penalty, and other retirement tax time bombs most people don’t see coming until it’s too late. With 20+ years of experience as a global wealth manager, Jimmy breaks these topics down in a clear, practical way—so you can plan proactively, avoid unnecessary taxes, and build a retirement where your delayed gratification finally pays off. Subscribe so you never miss an episode, and remember: this podcast is for general education only and isn’t legal, tax, or investment advice—always consult a qualified professional for guidance specific to your situation.

Information

  • Creator
    James Miller
  • Years Active
    2025 - 2026
  • Episodes
    13
  • Rating
    Clean
  • Copyright
    © 2026 Divorce the IRS
  • Show Website
    Divorce the IRS