Great idea! I, too, suggest adding a "delete e-mail" button directly to the notification window that appears in the system tray when I receive an e-mail.
Often, just looking at a message in the system tray makes it clear that I will delete this letter. It would be convenient to delete an incoming e-mail immediately at the moment of making a decision, without having to go to the e-mail client window.