The solution: A $5 tube of caulk is a prudent first step. When new windows are unavoidable, it's worth spending the extra $5 to $10 a square foot for an energy-efficient type; it will reduce your heating and cooling bills by up to 20%.
Talk to your installer about adding sufficient flashing, which is the material that's applied around the window edges for waterproofing.