There are two main types of herbs – woody and herbaceous. The base stems of woody herbs are brownish gray and woody. Herbaceous herbs which have softer green stems.
A lot of the woody herbs are perennials, but it depends on where you live.  While some herbaceous herbs like salad burnet are perennials, most are annuals.
I can usually find seedlings for the following herbs in Pittsburgh, PA or I can buy seeds from my favorite online companies.
Woody Herbs:
Bay
Lavender
Mushroom Herb
Oregano
Savory
Tarragon
Thyme
Herbaceous Herbs:
Anise
Caraway
Cat Grass
Catnip
Chamomile
Chervil
Cilantro
Culantro – I have not grown this one.
Cumin
Curry
Dill
Epazote
Fennel
Fenugreek
Feverfew
Lemon Balm
Lovage
Mint
Parsley
Summer Savory
