determine which actors receive action notifications

I would like to be able to add users/roles to be able to do the action in the workflow but not be receiving the email notification.  This is particularly useful when someone needs to be able to be backup to another staff person, or just needs the function in specific scenarios when logging in, but does not need to receive the regular notification.