When someone leaves, you could set their address to "", and also do an appropriate blanket "add admincc" on all their tickets. That way someone will get notified and you still show the ticket owned by them.