If the house is relatively new (say less than 40 years), this much displacement is a concern...unless there is evidence that the displacement hasn't proceeded in several years.
Has the wall remained straight but it tilted inward? If so, the house strucure may have started to buttress against...