Timing Sides of Timber Piles

I am working on a job where the piles were required to be driven deep - 50-60ft, and extend an additional 10-ft above grade. As timber piles are not perfect and neither are contractors there are instances of the piles protruding beyond the extent of the architectural envelope.
The question becomes: can the piles be "shaved" down on one side to compensate and allow for the architect to make his finish work? Or will the trimming of the pile effect the internal stresses of the already driven timber pile as it will now have a square side?

My assumption is that because the pile is larger at the top, there exists a pile with my specified dimensions within the pile found in-situ. Therefore as long as the pile is not trimmed beyond hypothetical pile dimension, the trimming of the sides of the pile should not influence the strength of the pile beyond my initial design.