I cannot delete all the tasks, what am I missing?

You can only delete tasks that have been created by you, unless you have managerial access to the Project. Only owners/managers have the permission to do that.