The magic of hot and spicy cauliflower that the longer you leave them the more the flavor comes out.  If you dont like them too spicy, dont put in