Mozilla Connect

Right click anywhere on Toolbar.Goto Customize toolbar...Drag and drop the "Firefox view" button wherever you want.

Yes, I would also like it to float instead of shrinking the tab and changes the page layout.

He wants "vertical tabs" icons to appear on Left and rest the icons (History, bookmarks etc) to "right".

You can use, little bit of "Free space" to the right of address bar and will be able to drag the window. (I can do it on Linux KDE, not sure if same works in windows)

Pin tab option is already there when you right click on tab. So open a website in a new tab and pin the tab. Indirectly it will pin the website.