Teamviewer is assigned to my account, I have granted easy access and has a personal password set.
Once you setup a personal password for unattended access, you are not able to remove it later when you decide not to use any personal password. This is a GUI error which won't let you do that (unlike Windows version), and a cmdline teamviewer passwd won't work without a password as well.

The only solution I know of is to reinstall the teamviewer, but I'd like to avoid that.