Select Color from Swatches

If you want to see if you've used a specific color in your document and if so, where with nothing selected, click on the swatch in the Swatches palette and then use Select>Same> Fill Color and every object filled with that color will be selected (regardless of which layer they're on).