The first and most important question you need to answer is "Are ytou sure this isn't a gage R&R problem?" What is your gage R&R?".
With such a tight tolerance, both geometry (roundness and trueness of taper) have a great effect on the ability to hold tolerance. Keep in mind...