Destroy (when done) or detach (when not done) the task object */