At the moment if I, for example, want to every author's files apart from one or two, I would have to select each one manually, and this take a long, long time believe me. You can't shift click to select multiple people at once either.
Perhaps you could put in a "select all" button or an "invert selection" button or something similar. Or maybe a include/exclude toggle?