Soonersoilguy,
Your point seems very academical (which is good), but on a practical perspective, I believe the effect is insignificant for the depth of material you mentioned. First of all you are replacing the soil with stones (poor graded, high void ratio material). That materials are not necessarily excessively heavier than natural soil. In the case of well graded aggregate, your might be able to get densities in the 140s pcf range. But for just say #57 stones, it is very unlikely to be that high. Since the soil has already been overburden with the natural soil, the increase weight that will cause settlement(due to the stones only) is how much the stone is heavier than the natural soil. Therefore, we are talking very small loads. Additionally, as mention in previous replies, the elastic modulus of the stone is likely higher than the natural soil, which further reduce elastic settlement.
As Ron mentioned above, I would always recommend placing a stone layer. If you have been at a construction site when it is raining you will appreciate that even more.