Pick out and discard the ginger. Stir the lime juice into the syrup; let cool completely. Meanwhile, using a sharp knife, peel all of the citrus fruits and cut off all of the bitter white pith.