Mouse/Controller inputs on Samsung device?

While using Teamviewer on samsung, I can connect to my PC at home and control it through that with touch controls, but when I connect a keyboard and mouse or controller it still makes me mimic touch control with that device. Does anyone know how to be able to use inputs directly from an external device (mouse+kb or controller) on the device I have connected to with my Samsung?
Thanks--
Broden