Assign to everyone except selected students

There are some assignments that go out to the majority of my students except one or two per class. It would be great to be able to assign to "everyone" and then have a button to select which students...