If the Farmer's Market was his idea....ask him to go with you!
That way you can do something he came up with, showing interest, and spend time together!
Make sure to pick up something yummy and then ask if he wants to come over and cook something up...win/win! (Grab a bottle of wine or whatever to help lighten y'all up!)
His market idea and your cooking idea can easily be combined and lead to something more!