Command (Mac) / Control (Win) + Shift + B will delete the contents of Quick Collection.
Command (Mac) / Control (Win) + Z will undo just in case you accidentally tap these keys!