Select groups you want the user to be removed from or added to. Unselected groups will not be changed. You can unselect a group by using CTRL + Left Click