Great idea! And that's quite a list you've got there.
I use "nutmeg" also, usually along with cinnamon, but I would personally consider these "spice" rather than "sweet"
I generally characterize spicy in two ways in my mind:
1. Sweet spice - Cinnamon, Nutmeg, Clove, Licorice, etc.
2. Spicy spice - black pepper, hot pepper,
And I also separate "herby" flavors - mint, grass, hay, flowers, etc. - from the others.