Ok so I just replaced my steering head bearings - both were well dead.
I torqued to 50Nm as per the manual, then backed off to completely loose and retightened to about 6Nm (manual states 3Nm but but torque wrench won't go that low).
It now feels nice and smooth yet just tight enough without...