The ability to extrapolate what something would taste/feel like from mere looks is a learned one.
Toddlers don't have it yet, which is why they're stuffing everything into their mouths.
You might not consciously remember licking a carpet, but the part of you that's holding up the "dusty", "textured" and "CRUMBS!!" signs does.