It’s your community. You can remove whomever you like for any reason you like.
That’s not a mandate to go on a power crazed rampage. It’s a mandate to act quickly to remove members who are not a good fit for a community.
Some community managers fret and worry about removing a member. They try to be fair and prove the member broke a rule. That takes a lot of time which can be spent on improving the community.
You don’t need to go through a lengthy hearing process to remove a member. You’re not running a country, you’re running a community. If a member isn’t a good fit for the community, remove them.
It’s your community, you need to protect it. You have more important work to be doing.