I care -- all else held equal, I'd rather have snazzier graphics -- but I feel like there's pretty strongly diminishing returns.
And because resources are finite, all else isn't held equal. You're giving up time spent working on gameplay or whatever to stick fancier graphic assets in.
Some of my favorite games don't have much by way of graphics.
I do kind of wish that I could get upscaled versions of a number of games that I enjoy with low-resolution pixel graphics, though -- I'd like "high-resolution DLC" to be a thing for successful games like that. Think Caves of Qud or something like that. IIRC Cave Story did that, along with a handful of other games. Would like to have higher-res versions of Balatro. Same for Noita, though there I guess the resolution hooks into the game mechanics, so have to be careful how to deal with that.
I've also seen some games with untextured polygons that have worked out pretty well. Star Fox for the Super Nintendo and Avara and Flying Nightmares for the classic Mac came from an era when texturing wasn't always possible. Carrier Command 2 is much newer, and uses only limited texturing.
Minecraft went a long way with very technically-limited graphics.
There are a lot of good roguelikes that just use text.