One of the closing choices on the bottom of the Contact/Customer page is to delete this contact/customer.  This choice moves the Contact/Customer to the Recycle Bin.  You must have level 5 user access to empty the Recycle Bin.

Warning:  All tickets associated with the Contact/Customer will be lost when this Customer/Contact is Permanently Deleted from the Recycle Bin.