We regularly use them in transformer feeders. The main reason is to ensure the transformer comes back online after a power fail without a human having go go out and press the 'close' button. I don't recall ever using one in a motor starter.
There is at least one manufacturer that makes a magnetically latched contactor. It basically uses an electromagnet to create enough force to close it and then the electromagnet is reversed to force it back open. The force to hold the contactor closed comes from a permanent magnet vs a low energy electromagnet circuit like most large contactors use. You might have run into these, and since the contactor design means they always latch, it's the way they have to be.