focus-follows-mouse is pretty much impossible to use with the menu bar being in the panel. When you need something from the menu, you have to try to avoid moving your mouse over other windows while trying to reach the menu so that they don't get the focus.

You can disable the main menu bar by removing the appmenu-gtk package.