That's how I started, and it lead to new ventures quite fast. Weed is a step up drug for all other plants. Weed caused me to garden indoors, indoor gardening evolved to tomatoes and peppers, tropicals, orchids.. Then to carnivorous plants, then to beneficial herbs, then to trees.
Before I knew it, I ended up in biochemistry. And within a year I was growing pines from seed. Fast forward 4 years and now I don't even have garden space for my cannabis.
Weed kind of ruined the weed hobby for me. Terrible stuff! I feel like an addict, I see a plant, I buy it.