To some people, $3 million will sound like a lot. You probably think $3 million is enough to retire if you're among that crowd. But retiring with $3 million at 65 can last depending on your longevity, lifestyle and other factors. Let's break down what you need to consider when determining how much you can afford.