Follow these steps to change the language for your public calendar.

Navigate to Settings > Language- select your preferred language

Click on Public Calendar or navigate to your website calendar page and see the applied changes