My current workaround is to add IdentityFile tag to ~\.ssh\config pointing to the right key, and this works for git commands in Cmder. I just have to enter my passphrase every time I run a command ...