Removing menu items isn't quite as easy as removing toolbar items. Hold down the Alt key, drag the unwanted item off the toolbar so that an X appears, and then release the mouse button.