I have a habit of just deleting them (the ones that are just lost causes) because I get frustrated and don't want to be reminded of their existence. :P

It's ok to delete shit, but it can be a good idea to wait a few months, so that you can reassess it with fresh ears first. It might still be shit, but it might have some useful parts.