On my board it was worse on one side compared to the other. On closer inspection I found that one of the front boxes was mounted wrongly in the board, about 5-6mm too low, and the fin was sitting well too low compared to the surface of the board. I've since then made spacers to get a better match to the board on all fins, that helped some, but the real solution for me was to go with more toe-in on the fins. Now I feel like all the fins at grabbing, or letting go, at about the same time. Much like a singe fin will feel after a jump for instance.
You can see the spacers in the previous pictures, it is U-shaped and held in place by the fin. With each U-shape I can get two settings by simply turning it around 180 degrees. So the fin is either slightly aft or slightly forward of the centre in the box.