rsync acts as a client/server over ssh. It’s not a part of git for Windows or otherwise.
EDIT: in other words, you need an ssh client and rsync on your machine and server. I’m not aware of any good clients for Windows.
However, most people use git to deploy, using a bare backing repository with a post-receive hook to checkout a working directory in your webroot… or a hosting service which takes care of this automatically.