Under the "Permission" tab of "Session Settings" there a few options for "Applied Permissions" which you can toggle between Allow/Deny.
I propose to add another Permission called "Invite Attendees".
There are often times where someone inadvertently did not get an invite to a Session, and it would be nice if Joined Attendees could add another colleague to the Session without having to go through the Session owner.