No legal place of worship for 40,000-strong town