what CNC swiss style machine do you have? adding an AIR or electric driven spindle (example NSK http://www.nsk-nakanishi.co.jp/en/industrial/products/imf/ms_series.html )
will hel;p with the small drill, as will making a "starter hole drill" to get the hole started straight, spinning the part...