unclesyd is correct; your temperature is too high.
Fragmentation during hot rolling indicates “hot shortness” due to failure at the grain boundaries. Heating Al alloys above 500
oC results in grain growth (coarsening) and segregation of impurities to the grain boundaries. This can result in a liquid film between the grains even though the overall composition Al-3%Cu is about 20 to 25
oC below the solidus (see phase diagram below, from ASM Int.).
Also, your alloy may have a cored microstructure if it wasn’t homogenized (solutionized) after initial casting. Solidification at reasonable rates forms primary dendrites > 97% Al and a Cu-enriched interdendritic phase (possibly of eutectic composition, m.p. 548
oC). Very slow heating above the solvus temperature, ~472
oC, to allow diffusion, sometimes with intermediate mechanical deformations, is necessary to avoid liquid formation above the eutectic temperature, 548
oC. As solutionizing temperatures can result in excessive oxidation as well as grain growth, it may be best to warm roll as suggested by
unclesyd. This processing will also reduce the time needed if subsequent solutionizing is required.
Castings of this composition are also highly vulnerable to hot shortness (hot tearing) during solidification shrinkage, so possibly there were pre-existing flaws. One method to avoid this is addition of at least 3% Si.
Please give a more precise composition and the desired final properties or objective.