This happens to me pretty frequently.
I think is alright, language is a bridge and sometimes we feel more comfortable speaking our native language than others. But I don't really mind speaking in English or Spanish with people I meet in Brazil. But the moment of realization that you are talking with another native speaker is always full of joy.
#feels-nice to speak with other bilingual or polyglots :)
