It's a good idea to keep a different key for every host. That way, should one be compromised, you're not compromising your access to all your hosts. An easy way to do this is to configure your SSH to automatically look for the key based on the host you're connecting to.
Edit the file
~/.ssh/config and add this
Host * rule in. Whenever SSH connects to a host, it will now look for a corresponding key in
Put your SSH keys in
~/.ssh/keys/ in the format of
<user>@<host>. My key folder looks a little bit something like this.
Try it out by connecting to a host that you have a key for.
To create new keys, simply use
ssh-keygen. When prompted for where to place files, put them in
<HOME>/.ssh/keys/[email protected]. Here's an example.