If a program has to keep in RAM all the things you are not currently, like right now, displaying or editing, then its author shouldn't be in the profession. That also applies to the portions of a huge text file or a huge image you are not touching right now.
EDIT: Thankfully people writing video players usually understand this.