To delete a task, simply swipe left on the task and tap on the delete button. An undo option will appear for a short time in case you want to retrieve the deleted task.
