YOU CAN ALWAYS GO BACK

If you have the toolbar hidden in a Finder window, with its all-important Go Back button, you can still go back to the previous window by pressing Command-[ (that's the Left Bracket key, which appears diagonally to the left of the Return key on your keyboard).