In theory, yes. In practice, nuclear plants that are shut off are almost always replaced with fossils, with the specific fossil fuel of choice often being coal.
Energy is not something where you can just pick one solution and run with it (at least, non-fossils, anyway). Nuclear is slow to ramp, so it usually takes care of baseline load. Renewables like wind and solar are situational, they mostly work throughout the day (yes, wind too, differential heating of earth's surface by the sun is what causes surface-level winds) and depend greatly on weather. Hydro is quite reliable but it's rarely available in the quantities needed. The cleanest grids on the planet use all of these, and throw in some fossils for load balancing, phasing them out with energy storage solutions as they become available.
You can't just shoot one of the pillars of this system of clean energy and then say you never tried to topple the system, just wanted to prop up the other pillars. Discussing shutting off nuclear plants without considering the alternative is pure lunacy, driven by fearmongering, and propped up by no small amounts of oil money for a reason.
Replacing nuclear with renewables is simply not the reality of the situation. Nuclear and renewables work together to replace fossils, and fill different roles. It's not one or the other, it's both and even together they're not yet enough.
So when you do consider the alternatives, moving from nuclear to the inevitable replacement, fossils, is still lunacy, just for other reasons: even if you care about nothing more than atmospheric radiation, coal puts more of it out per kWh generated, solely because of C-14 isotopes. Nuclear is shockingly clean, mostly due to its energy density, but also because it's not producing barrels of green goo, just small pills of spicy ceramics. And if your point is accidents, just how many oil spills have we had to endure? How many times was the frickin ocean set on fire? How many bloody and brutal wars were motivated by oil? Is that really what a safer energy source sounds like to you, just because there are two nuclear accidents the world knows about, and a thousand fossil accidents, of which the world lost count already?
And deflecting to other industries is also quite disingenuous. Especially if your scapegoat is transportation, since that's an industry that's increasingly getting electrified in an effort to make it cleaner at the same logistical capacity, and therefore will depend more and more on the very same electrical grid which you're trying to detract from.