When i fish i use a 2 hook pully/pennel with a size 1 as my top hook, i normally find that even the larger size fish are taken on the much smaller top hook, ive found that if i use a 2 hook pennel with the same size larger hooks my catches are less.
I would try with the smaller hooks and you should see a better connect rate.