You can automatically specify an SSH private key, via local configuration, when connecting to SSH hosts. This is especially helpful when using Git to connect to multiple repositories which require different SSH keys.
Host HOSTNAME_OR_IP
IdentityFile ~/.ssh/OTHER_ID_RSA