Spammer Using Deleted Forwarder Address

I didn't think this was possible but someone is spamming me via an email address that I previously deleted from my forwarders, and it is still being routed to my main email address. I even added additional email filters in cPanel to discard anything from/to that address, but email from the old forwarder still gets through. How can I "turn off" the forwarder permanently?