Command (Mac) / Control (Win) to toggle from the Path Selection, Pen, Add, Delete or Convert Anchor Point tool to the Direct Selection tool.