Don't you worry, the baby will grow in a few years and the cat overlord will have once again what was its to begin with
Those seats are useful for approximately 2 months max. Kitty should soon have his toy back.
Not only that, but babies can't / shouldn't be using it all day everyday. So it really should be the cat's at least 90% of the time.