Its not cook-book, there are infinite variables, and even the experts get it almost right sometimes.
I would suggest Rotary Wing Aerodynamics, by Stepnewski and Keys, Dover publications, as a good basic discussion. But designing blades is one tough job, structurally and aerodynamically. It is...
A great deal of literature is available in the American Helicopter Society forum proceedings. There are some key technical problems with engine/rotor dynamics. The biggest is stability in the 2 Hz regime, where the engine control could cause rotor/drivetrain resonant response. The second major...