Birdstruck,
What you refer to has been perfected to a point and is now called the "wineglass" gyro. It works best in a vacum so space applications are ideal.
Since gravity is a known force, the INS, IRU, AHARS mathmatically compensates for the force of gravity. Gyro/accel based systems use various geodetic models of the earth as correction for gravity