Normally we wouldn't allow cement to stay in contact with pipe that sees any temperature or under goes thermal cycling. We had one very bad excursion of our process steam piping. As stated above cement isn't a problem with CS piping as it used to encase piping along with anchors, kickers, all the time. At one time they did use a cement wash to coat CS piping.
You might be able to remove the cement residue that you have by using some citric acid based cleaned or pure inhibited citric acid. Citric acid is commonly used to remove residual cement from cement trucks.