I recommend adding a user control on the Group Detail page - Allow Leave Group yes/no.
See attached screen capture. This feature is similar to the Profile Type - Account Deletion yes/no user control.
The benefit to this feature allows administrators to prevent the user from leaving groups that are invite or closed. These group types are likely designated required by administrators for one reason or another.
Todd