It's hard to regulate something that you can easily grow in your backyard.
It all boils down to regulation and taxation.
English
-
People grow apple trees, tomatoes, raspberries, etc. in their backyards. Government can't regulate and tax that.
-
You can't smoke an apple and get high.
-
You can grow salvia divinorum in your backyard even in states where it is illegal to smoke salvia.