Calcium deposits usually originate from grout or setting mortar. To remove, scrape it off the pool tile. Another method for removing calcium deposits is the pumice stone. Pumice is a light porous glassy lava stone that can be rubbed over a pool stain to remove it. You can get a pumice stone that can attach to your telescopic pole or a pumice stone that has a handle you can swim with.