Linux, can't control 2nd gpu with xinerama

Bothrio

I have an issue where I can see both GPU outputs in one monitor in TeamViewer 14 but can only control gpu0. The toolbar at the top only shows I have one monitor so I can't switch to control the second GPU (gpu1). How can I control gpu1 using TeamViewer 14? Could xinerama or xrandr be causing this?