Because bathrooms are exposed to so much moisture, it's important to regularly properly caulk it at least every five years (more if your bathtub or shower are used often) to prevent water damage.
And when fall comes around, have a plan for what you'll do for any problem windows. Buy caulking, weatherstripping, or heat film if you need it, and make time to properly install any draft prevention ...