Iran said the vessels violated protocols for travelling across the waterway and could face fines or confiscation.