Legalization is a half-step. Decriminalization (people not being victimized by the police for a victimless crime) is the full-step, and that requires the lack of the belief in outside authority, which is the reason to advocate such.
The worry about drug overuse does not validate slavery.