Regulation is fine, but people need to realize that there are always downstream effects that often result in a less efficient version of the same outcome.
For instance, say you just pass a blanket ban on plastic soda bottles and mandate glass. Production costs immediately go up (not to mention transportation and logistics), and those costs are naturally passed onto the consumer, so the prices of all sodas go up.
Has this really improved things? There are real questions about the environment impact of glass, since they're significantly heavier and thus require more carbon emissions to transport. Glass is better if it's reused, but there are situations where it's unlikely to be reused. Soda is now more expensive, just as it would have been under a plastic tax (and because lower income people tend to drink more soda, you've hit them extra hard relatively), but now you've also eliminated the ability for plastic bottles to be used in situations where they truly are called for; for instance, you probably don't want to be selling glass bottles at a music festival, so an organizer will need to instead purchase extra plastic cups instead, resulting in the consumption of extra glass and plastic.
I know people have this idea that the only factor that goes into a price is how greedy the CEO happens to feel that morning, but that's simply not the case. Prices are set by market circumstances, not greed. It's not like NYC landlords suddenly got less greedy in 2020; the market radically changed. They're already charging the most that the market will bear. In terms of regulation, it's almost always more effective to go after the market incentives - that is, price signals - instead of just taking a hammer to the thing you don't like and hoping it doesn't have any bad effects.