Install line reactors. You could also turn an induction motor nearby. This would be analogous to running a synchronous condenser in the case of a lagging pf.
Is it only leading power factor? There could be over voltage, Harmonics as well when Computers and UPS are involved? What is the UPS size / capcity/ Load? Single phase,3 phase 120 volts?