Yes, people are. This is because a lot of these Supreme Court arguments are shameless justifications for whatever people want to happen anyway. For instance, since you are bringing up recreational drugs, the fact that growing your own marijuana was ruled as something the Federal government may forbid under the interstate commerce clause of the constitution, arguing that people who grow their own marijuana have an influence on the illegal interstate commerce of marijuana because they stop participating in it:
https://en.wikipedia.org/wiki/Gonzales_v._Raich
You may argue that two wrongs don't make a right, but one needs to be wilfully blind to ignore the political reasons for the reversal of Roe v Wade.