Polyester is a fairly classic thermoset matrix and should behave well in terms of ply stiffness behaviour.
I'm not too sure about the 'Huber formula.' I last saw something similar used for bodged equations for skin wrinkling of carbon on honeycomb (on the discontinued Ariane V H10 interstage). The skin there was sort of not-quite quasi-isotropic.
The formula is demonstrably wrong for the limiting case of woven lamina material: E1 = E2 and nu12 = nu21, so you'd get E/(2(1+nu)). For E1 = E2 = 25 GPa and nu = 0.06, G12predicted = 25/(2*1.06) ~= 12 GPa, fc. ~4 GPa. As the laminate becomes more isotropic it will behave more in accordance with E/(2(1+nu)), but the basic orthotropic material will never do so.
For UD glass E1 ~= 45 GPa, E2 ~= 10 GPa, nu12 ~= 0.3, nu21 ~= 0.02 and G12predicted would be ~10 GPa; a fair bit out from the actual 4 GPa. (G12 is roughly the same for woven and UD).
[G12predicted = sqrt(45*10)/2/(1+sqrt(0.3*0.02))]
So no, this won't work. It might be acceptable for a small difference from isotropic, such as a rolled metallic plate or even the formula for skin wrinkling that I used for an almost QI laminate. I confess I've not heard of Huber other than just looking him up via Google.
If you require some sort of reason for a number rather than quoting the (free!) MIL-HDBK-17 data, you could try a micro-mechanics approach. The glass fibre G is about 72000/(2(1+0.3)) = 28000 MPa (like aluminium) and the polyester E will be about 3000 MPa, giving a G of maybe 3000/(2*(1+0.35)) = 1100 MPa; I think fibers in series with a matrix for G12glasspolyester would then be, er, 1100*[(28000*(1+0.52) + 1100*0.48) / (28000*0.48 + 1100*(1+0.52))] = 3200 MPa??? (460 ksi.)
(See
.)
Well, maybe. You're better off with MIL-HDBK-17.