To enable key forwarding on Bash on Ubuntu on Windows.

Create a ~/.ssh/config file with at least:

Host *
  ForwardAgent yes

Start ssh-agent:

eval `ssh-agent -s`

Then add key(s):

ssh-add

Then you can ssh into some machine.