I had to enable userChrome.css and add these two rules:
:root[inFullscreen] #PersonalToolbar {
visibility: visible !important;
}
:root[inFullscreen] #toolbar-menubar {
visibility: visible !important;
}
I suggest this should be the default instead, or at least a way in the 'customize toolbar' tool exist to make it so.