Plain deep groove ball bearings will take axial loading to some extent, if you go to the skf website, they have an online catalogue with all the bearing info and equations for axial and radial load.
You should be able to design a simple setup which will have enough preload to alleviate play and...
