Bleach will DEFINITELY kill it!
But if you have one, wear a gas mask, or at least turn on lots of fans and open any windows down there! I've used bleach to get the mold off the bathroom ceiling, and it gets pretty stinky!
Afterwards, maybe some kind of waterproof latex? The hardware store might know better, but I would think something impervious to water would be good! That way, the mold won't be able to grab on.... heh!
To prevent more future mold, a dehumidifier will help. My parents' cellar used to be mold central, but with that machine sucking all the damp out of the air, it's much better... It's amazing that in the summer it used to collect many quarts of water a day in its bucket in the back! Phew!