how do you remove hard water marks from a waterpipe?

The best answer is to use CLR.  Let is sit for a while.  You can also add some salt, preferably larger crystals, like kosher salts.   Shake, rinse and you should be good to go.