I see answers for why people dump junk, but not why they dump it on rivers/lakes in particular.
To remedy that: dumping junk isn't legal, and water is good at hiding things. If someone leaves their TV out on the street or whathaveyou, it might be traced back to them, but that's less likely in a river.