Just a single, quick chirp? If so, I would suspect that the parking brake is not releasing until the rotor starts to turn backwards. Another possibility would be a control arm or rear axle assembly bushing.
Or is it a recurring chirping sound that makes multiple sounds and goes on for a second or two?