I would like to suggest a trip to your local health or natural foods store. Most will carry spices and herbs in bulk, so you can buy tiny amounts of each without a large investment. In fact, they are much cheaper than supermarket spices when you check the price per ounce. You can buy just a teaspoon full if you want to try it, and they put it in a baggie with a label on it. This way, you can try a wider variety of herbs and spices, and they are much fresher than the supermarket tins that have sat in a warehouse. I've had a lot of fun trying new flavors this way.
I also love to purchase them online, and prefer
http://www.worldspice.com/ for the highest quality spices. They are also sold in 'bulk' so you can get them in plastic bags, and are very affordable. They wrote a
book about herbs and spices that goes into detail about each one, including which foods they go with. The book also contains recipes for various herb blends that are delicious