It reportedly has the capability to translate languages in real-time during voice calls, video calls, and face-to-face. The feature is said to be better than language translation on Google’s Pixel Buds as the former doesn’t require an active internet connection.
From the article:
The on-device (mentioned a few areas) would lead me to believe it’s the buds themselves, despite it being also on the phone.