I'd try to Febreeze it.... I find that stuff works wonders for me - I have problems with my closet because we keep the laundry basket in there, and my husband's socks STINK!
The Febreeze really keeps it under control; I usually spray it about once a week.