Ubuntu L4T - Is there a way to remove GUI so I can only run CLI on Nintendo Switch?

Tried sudo systemctl set-default multi-user, but it just broke the boot-up.