Why does it bother you so much? Can't you reminisce on the summer you just had, or look forward to the next summer?
I've never had a seasonal attachment to an album, unless it's Christmas music, haha.
I have seasonal attachments to just about every album. It's more of a life soundtrack thing than a strict weather thing, but it definitely makes a big difference to how an album hits me. Stuff like Boys Like Girls and All Time Low is, plain and simple, not high on my list of things to listen to in the winter.