Brick veneer is just a very high quality siding material from a structural standpoint.
Ledgers cannot be attached to veneer. They must be attached directly to the bearing wall.
Everyone knows brick veneer provides substantial rigidity to a wood frame structure, but codes do not recognize the reliability because the construction methods and connections are not designed for the additional loads that it does resist. There is no structural tie between the wood frame and the brick that permits proper load distribution, plus the two materials are not compatible.
Granted, the brick veneer itself may have greater more vertical load capacity than the wood frame wall, you have to look at the structure and its behavior considering that stiffer materials will take more load even if they are not planned to.
Dick