ASAP. If you no longer need the money and can do everything you ever dreamed of on what you have saved, and most importantly feel you have given all you can to your job, its time.