air con smell

Getting a nasty locker room smell from the air con when I start up the car. At first I thought it was just me, but my wife gets it too. Blows for a few seconds then fades away and smells normal again. Is there water getting trapped in there somewhere perhaps? How can I get rid of it?