Much depends on the scale of the part you're arguing with your QC guy about.
Match drilling happens a lot in the aerospace world because they are very frequently assembling very large, flexible parts which may have hundreds of rivet holes per part, and they are often riveting three or more of these parts together, using rivets with very tight hole diameter requirements. Delivering parts with all the holes drilled such that they properly align on parts like these is very difficult.
If you're riveting smaller parts, it gets much easier to use pre-punched assembly components.
You may be able to demonstrate this easily by performing a tolerance stack analysis on your parts, and showing clearly how hard it may be for your vendor to supply pre-punched parts that will assemble correctly.