You can find the Home button at the far right end side of the Navigation Toolbar.

You can find toolbar buttons like a button to open the bookmarks and the history in the sidebar in the toolbar palette and drag them on a toolbar.
Firefox 4 has two bookmark buttons with a star in the Customize window.
One star button has a drop marker that open a Bookmark menu.
The other star button without the drop marker opens the bookmarks in the sidebar.

Open the Customize window via "View > Toolbars > Customize" or via "Firefox > Options > Toolbar Layout"

You only see the Bookmarks menu button if the menu bar is hidden.
If the bookmarks toolbar is visible then the default bookmarks menu button will appear on the right hand side of the Bookmarks Toolbar as part of the Bookmarks Toolbar Items.

bookmarks in on the right side of the page now