This has been bothering me a bit, and after another trackday I found that the front tyre wore excesively. It cupped way to fast on the track.
So I then turned back to the front suspension and stripped the forks completely, even the valving.
Cleaned everything with a fine comb and check everything 3 times.
The valving was clogged up by fine dirt and some metal chafings.
No wonder the suspension wasn't feeling right.
Managed to clean everything out, and also managed to put it all together the same way it came appart.
Feeling pretty chuffed with myself, and I can say that there has been a major improvement in the bikes handeling.
I went with the 7.5W fork oil, instead of the 10W Honda OEM fork oil.
The bike feels like it is gliding, no more hard knocks or bumps.
Did another trackday, and checked the wear pattern on the front wheel - no uneaven wearing down anymore, did notice that the rear spring was set a tad too hard - to compensate for the panniers.
Guess this will have to do, or I need to do the trackday with the panniers fitted...