Remote Drag

I regularly use a connection from my laptop to my PC to transfer files, as well as run things on my PC that my laptop cant. Doing things such as 3D renders, or compiling stuff in unity. Recently when using it, ill randomly lose the ability to drag files. I can freely drag my mouse to select multiple items, but when I want to drag a item to move around, it refuses to let me.
The only fix I can figure out is to restart the PC and reconnect till it starts acting up again. Anyone know a fix, or also has this issue?