Many doctors love talking about the idea of FIRE (Financial Independence and Retire Early). “I cannot wait to be able to do what I want, when I want. Every. Single. Day!” What we don’t spend as much time talking about is the early retirement gap that is created when we FIRE. Said differently, “How can I access my retirement savings before the age of 59.5 without the 10% penalty?”
That’s the early retirement gap. The age between your early retirement and 59.5 when you can tap into your 401K, 403B, IRA, etc.
Let’s talk about bridging the gap.
Basics: What’s the problem?
When we make our plans for early retirement, we often think about the freedom it will provide. Sometimes, however, we fail to think about the tactics and strategy of early retirement.
Most people use “the 25X rule” to determine how much they need to save to retire, though I follow a hybrid model of financial independence. Others utilize a 30X rule for early retirement. That is likely to last a very long time based on the Trinity Study even for an early retiree. So, if you are aiming to spend $100,000 annually then you likely need $2.5 million – $3 million to be financially independent.
However, this math gets a bit dodgy when the majority of our savings are stuck inside a retirement account that we cannot use (e.g. our 401K or 403B) until age 59.5 lest we receive a 10% penalty on anything we take out.
Note: The Rule of 55 (and some other exceptions) do exist that allow you to withdraw from your retirement savings earlier than 59.5 years old.
6.5 Ways to Bridge the Early Retirement Gap
There are certainly ways to retire early and to have the income we need to do so, but we need to make a plan. Here are 6.5 of the best ways to have the money you need to retire early.
Number 1. Cash reserve
Many early retirees advocate for having a year or two of annual expenses saved up in a cash reserves. There are two major advantages to this tactic.
First, if you don’t touch your investments for the first two years you retire, you can let your investments grow without having to worry about Sequence of Return Risk. This is a great way to make sure that you truly have enough in retirement.
The second reason is that it is the easiest way to bridge the early retirement gap! There is no penalty on money that is sitting inside a high-yield savings account or money market fund, though there is loss in cash value to inflation. Either way, it is there for you to use at will.
Number 2. The taxable account
Another source of money to bridge your early retirement gap is your taxable account.
A taxable brokerage account has a tremendous amount of flexibility in terms of access. You simply take the money out that you put in, and pay your long-term capital gains taxes (if held for more than one year). These taxes, which are usually 15-20%, are often substantially less than what you were paying in your peak earning years.
In fact, some people actually stop contributing money to their 401K/403B and, instead, put it into a taxable account so that they can access it more easily.
However, cash and brokerage accounts aren’t the only options.
Number 3. Partial FIRE
One of the least complicated ways to have enough money in early retirement is to have income from work. I hear you saying, “Wait a minute! I thought we were talking about retirement.”
This is true, but let me give you an example. My main gig is working as an anesthesiologist. However, that is not the only way that I make money. For example, both my work at Attend where I am co-founding a comprehensive financial platform that actually does what’s best for doctors is work that I love. In fact, it doesn’t even feel like work.
Given my work at Attend, I actually cut back my time at the hospital to 0.75 FTE before I became an associate professor at Wake Forest in 2023. A similar move might be made in early retirement where you continue to work part-time on something that you love.
Humans are meant to be productive in one way or another. This is why the people that retire well still have passions that they pursue. Playing golf every day is going to get old.
You need something to do when you are bridging that early retirement gap. Hopefully, it can also make a little money for you.
Number 4. Access your 457 in early retirement
One of the most common questions I get from my new colleagues is about 457 plans. I’ve written a post about everything you need to know about investing in a 457 plan previously.
Briefly, 457’s are definitely useful for early retirement. Unlike your other retirement accounts, you can access the deferred compensation 457 as soon as you leave your employer. You’ll, of course, pay taxes on what you deferred… but that’s fine. At least you aren’t getting slapped with the 10% penalty.
This is perfect for early retirement.
I could subtract my current age from 59.5 and stretch my 457 until I can access my 401K/403B. Ideally, I would be in a lower tax bracket in early retirement than I was in my peak earning years anyway. So, this could provide a great tax benefit without getting hit by the 10% penalty.
Or I could take it out over a shorter period of 5-10 years to avoid getting hit with high taxes while I perform a Roth Ladder Conversion on my 401K (see below). Also, a shorter time period means I don’t have to worry about the financial stability of my institution longer than necessary once I am gone and have no idea how it’s doing. Remember, the 457 is considered owned by the employer and is available to creditors if your employer falls on bad financial times.
Number 5. Roth Ladder Conversions
Using a Roth Ladder conversion is a really good strategy to bridge the early retirement gap. Particularly, in early (full) retirement so long as you can keep your taxable income low enough to take part.
The basics involve converting a portion of your 401K/403B into a traditional rollover IRA upon leaving your employer. (I believe that this must be done within 60 days of leaving most employers). You then take your money out of the traditional IRA and convert it (i.e. you get taxed) to a Roth IRA. You can then take your money out of the Roth IRA tax and penalty free.
There’s a catch, though – you have to wait 5 years to access that money! So, you still need five years of money saved up in early retirement (likely from numbers 1-4 above) to get you through the five years until you can access the money you have laddered.
As an example, you might convert money in years 1-5 that you then plan to take out in years 6-10. If you want to read more about Roth Ladder Conversions you can check out the articles written by Big Law Investor, Money Under 30, and Route to Retire.
Number 6. Substantially Equal Periodic Payments
I have talked about SEPP options to avoid the 10% 401K/403B penalty before. However, it is an available to access money in early retirement before age 59.5
The IRS states that if you take payments “as part of a series of substantially equal periodic payments beginning after separation from service” you can avoid the 10% penalty. The stipulations are the following:
- The payments must be “substantially equal” and occur after leaving your employer.
- They must not be altered or stopped for five years after payments begin or 59.5 (whichever is later).
- You must determine your payment in one of three ways: By calculating RMDs (required minimum distributions) for your age, using it as an annuity, or via amortization.
The gist is that you can arrange for equal payments to occur for you from your 401K/403B for five years or until age 59.5 (whichever happens later). This can provide some money if you need some not covered by the four above.
Number 6.5 Take Roth contributions out
This one isn’t a full number for a reason. You can choose to take out Roth contributions from earlier in your career tax-free. However, this has two problems.
First, you have to determine the proportion of which is your (Roth/penalty-free) contribution and what is part of the gains that are supposed to be left until age 59 1/2. So, if you want to take out $10,000 and $9,000 of this is the contribution the remaining $1,000 will be taxed and possibly be assessed a 10% penalty if accessed early. This can get complicated. Particularly, if you made a backdoor Roth IRA conversion.
Second, you should be accessing your Roth money last as this is money that is best left as a stretch Roth IRA inheritance and also has the biggest tax benefit. You’ve already paid the tax. Let it grow tax-free and take it out tax-free later.
I mention this because it is, technically, an option. Just not one that I would choose lightly.
Take Home
Retiring early can seem like it is all fun in the sun, but there are some details that must be worked out first. Chief among them is how you plan to access all of that money you have saved away for the impending early retirement gap.
Another reason to make changes is to adjust you tax liability in retirement after RMD hits. RMD hits at age 70.5 and has a built in ballooning tax bite. It turns out once your in the middle of RMD making changes to try and streamline the tax burden is very expensive. So there’s an aspect of pre 70.5 behavior that directly affects your post 70.5 returns and lower taxes means more money for you to spend.
I’ve done/am doing this not just thinking about it, since I am fully retired and living off the proceeds. The taxable account with accumulated long term capital loss is IMHO the best bet. You can grow this account in parallel with your 401K and other retirement accounts and if you plan you can easily tailor the plan. 30K per year for 20 years @ 4% gives you a million bucks. 90K per year draw for 10 years ($900,000) leaves you with 400K still left in the bank. You can withdraw for 15 years without running out of money. As long as you stay under 101K (married jointly) withdrawal your cap gains are zero. If you go over 101k having some LTCL means you still pay no tax. You can get 6% return using a (low risk) 16% total stock/84% total bond portfolio so its a good bet your money will be there when you need it.
If you use another (numbered) plan like a 457 you have to pay taxes since its ordinary income and the govt wants their money. You’ve already paid the govt on the post tax money. With the million buck plan you also have plenty of money to aggressively Roth convert (but not too aggressive, my analysis is 50-60% of your IRA is a good compromise between lowering future taxes (good) and creating a systematic SORR (bad) in your portfolio). In my case I’m Roth converting between 1 and 1.2M over 4 years living off tax free cash from my post tax account and sleeping in.
By moving 66% from a 1.5M IRA to Roth I save roughly 300K in taxes over a 25 year period (living in a post age 70 RMD) which is 300K more I will have to spend or a cushion if bad times come.
Live off cash tax free, Roth convert, save taxes when you’re old, what’s not to like?
Discuss among yourselves
Sounds like a solid plan, Gasem. I do want to flesh it out for any other readers following along.
1. The 101K number for 0% long term capital gains that you mention comes from the new 2018 rates that stay at zero as long as your income is less than $77,201 (married). This number + $24,000 standard deduction = 101K. So, any income less than that will keep you in the 0% long term capital gains tax rate.
2. I agree that your draw down plan sounds solid. Convert some money in your early years of retirement to Roth. Lean on your taxable account (plus some cash). And decrease your post 70.5 tax burden when RMD’s hit.
This will be my plan, too, though I am not contributing to a taxable account until my debt is gone. For now, its just my 403B, wife’s governmental 457, and backdoor Roths. This is because it’s either matched money or space we lose at the end of each year. Everything else goes to debt. Once gone, the taxable account starts.
3. Everything depends on how early you want to retire and how long of a gap you will have to 59 1/2. A sizeable taxable account is beneficial regardless, but I still prefer the tax advantage of the retirement accounts preferentially over the taxable account so long as you have enough money to bridge the gap to being able to use them.
Good stuff, doc.
I do contribute to my company’s 457. I see it as my own “severance” for myself. If I leave I can take it over 5 years or so. It could be a great sabbatical!
That is a good way to look at it! I like where your head is at on that one.
TPP
Is the 25x rule really meant to be post tax? If I have expenses of 100k annually, I would think I would need more than 2.5M because I would really need to withdraw 125k annually (and probably more to cover state and federal taxes). So wouldn’t a 125k withdrawal in order to spend 100k annually mean you would need 3.125M?
It actually works out well for a few reasons:
1) some of your money will be tax free (Roth money, post tax money in a brokerage account, deferred money in zero % tax bracket)
2) some of your money will be taxed at substantially lower rates (capital gains rates)
3) there are multiple ways to manipulate the above to get a zero dollar tax bill
4) the standard deduction is huge ($12k/$24k)
5) you can perform Roth ladder conversions.
Also, there are multiple examples of people making six figures in retirement without getting taxed:
https://www.physicianonfire.com/the-taxman-leaveth-taxes-in-early-retirement/
Spot on! We are rocking a few side hustles and building websites that will eventually generate income.
There is one more method that few people know about… using the little-known IRS rule of 55. If you can rollover all of you older 401k and IRAs into your latest employer’s 401k, then you can quit your last job the year you turn 55 (you can quit Jan 1st even if your 55th birthday is Dec 31st) and access all of your last employer’s 401k without penalty. It feels like stuffing the ballot box or shooting fish in a barrel, but it is perfectly legal if your last employer allows funds to be transferred into their plan.
I lucked out that 3 of my previous employers all used Fidelity, so that part was easy. Getting the other two rolled over required a little more paperwork where they wrote a check, sent to me, made out to Fidelity which I in turn sent to fidelity. It’s no more painful than rolling out of a 401k into an IRA (which many Dave Ramsey fans are instructed to do).