I aware of security reasons confluence user administration access given to confluence administrators only . If by any chance if user wants to handle group for their spaces they can do it or not without confluence administrator access .
Answers are really appreciated for learnings .
Thanks,
Vishnu .