If you need to use rsync for data transfer (fast) from box to box and you have different ssh port setup then this use this:

rsync -avz -e "ssh -p $port" user@remoteip:/path/to/data/ /local/path/data/

or vice versa

rsync -avz -e "ssh -p $port" /local/path/data/ user@remoteip:/path/to/data/