“Goodbye To All That” is the twelfth track from Sufjan Stevens' eighth studio album, The Ascension.
The song is named after Joan Didion’s 1967 essay about leaving New York that was itself named after Robert Graves’ 1929 war memoir. In an interview with Patrick Clarke for The Quietus Magazine, while talking about the titles of the songs on The Ascension, Stevens stated:

That phrase on its own is like ‘well that was fun!’ ‘Thank U, Next!’ ‘Keep calm and carry on!’ There’s such a proliferation of these phrases in our society and we shrug them off and find them meaningless, but right now I’m desperate for some kind of platitude that tells me where to go, and how to go about my business in a way that’s healthy and sustainable. These phrases are all carried down throughout the generations because they get us through the day.