The mouse has been working fine. I tried restarting the session. Yes I am using 'full control' access.
I have it set so I have full control as soon as I connect.

I uninstalled and then reinstalled the program.
This fixed it and I was able to control the remote keyboard again.
However after a few hours it has gone again.