It stands to reason that even if he doesn't sit in charge, the backups he prepared can stop Xianjun.

But the other party can come and go freely in the lair of the Black Spirit Clan.

This ability is extraordinary.