I just tried, and if you hit 'Tab' a couple of times, it will select the 'Connect' button that shows up after the name of the discovered devices.

From time to time I need this to re-pair with my, very old, logitech wireless mouse, that's why I knew it is totally possible with just the keyboard.