When you will connect to your Windows server for the first time, by default server's display and keyboard languages will be set in English. However, Windows operating systems support many different languages allowing you to run the server in your own language.
So if you follow the below provided steps, you will be able to change Windows VPS display language and keyboard language.
Click on the Windows start button and open the Settings window.
Then click Time & Language.
Select Language.
Click Add a language.
From the list choose a language which you want to install and click Next.
Now you need to choose which language features you want to install and after doing this click Install.
The chosen language package should be installed.
After this you need to select Windows display language to your installed and you would be asked to reboot your server that the display language would be changed.