Should praying give immunity?

I note that Mr Albanese has expressed disapproval of muslims praying being moved from an illegal protest by police.

I don't think anyone wants to see police going into temples, churches, mosques, synagogues etc to break up prayers. But should those breaking the law be immune from enforcement by throwing down a prayer mat, singing hymns or reciting the rosary?