I haven't anything exotic to suggest, just attention to detail:
1. Impregnation.
VPI with a suitable resin gives lower winding temperatures than simple dipping - proper VPI is a vacuum cycle followed by a pressure cycle to push the resin in and eliminate air pockets - as described in the FAQ section of:
Insulation materials should be chosen to suit VPI - e.g. use of un-calendered (i.e. not rolled) slot liner material as it is better at absorbing the resin.
I have also seen brushless motor windings fully injection moulded with loaded nylon; more expensive on tooling but it does get over the problem of resin drain-off and curing times.
2. Slot fill.
High slot fill makes the stator more difficult to wind but it does increase the thermal conductivity between winding and laminations (and reduce the copper loss of course). Also, a slot with a lot of space in may suffer from resin drain-off during curing and therefore poorer thermal conductivity, unless special jigs etc are used.
3. End-windings
Windings have much better thermal conductivity in the axial direction than in the radial direction (where the heat has to flow through insulation) so it may be advantageous to pot the end-windings, or use some form of direct cooling to suck the heat out from the slots. Any potting resin should perhaps have some flexibility to cope with thermal cycling. As mentioned in the previous post, it is advisable to keep electrically conductive materials a few mm away otherwise eddy-current losses may become significant (for the same reason the stator core is laminated) - particularly important for high speed/high frequency machines.
4. Laminations
To reduce the radial temperature gradient a good fit is required between the lamination stack and external housing - this usually means grinding the o/d of the stack. The interference fit should still be good with the machine at operating temperature.
As a final comment, I think simulation using FE or lumped parameter modelling is worthwhile - I know some errors creep in as thermal resistances and heat transfer coefficient's are difficult to reliably predict, but it can be a real eye-opener if you get the chance to experiment in this way.
You may find that potting doesn't make such a big difference, and that most of the heat flow is radially outward through the lamination stack.
For typical software see: