Ball joint issue, suspension moves with turning?

I have just reassembled a ball joint front end, after installing height adjusters and have found an interesting problem/issue.
Now I haven't set the chamber adjuster nut as yet i have just put the notch to the center as a starting point.
The beam is straight, the roller bearing and bushes are good, the trailing arms all appear symmetrical. The tye rods are disconnected.

The issue is as i turn the hub in and out the suspension travels up and down?? about 10mm.
Is the just because the chamber/caster nut is way out or is something seriously wrong??

Do you have the shocks fitted, if you don't then the ball joints will bottom out giving you this, when the shocks are installed the suspension does not droop this low as the shocks are the lower limit of travel.

ahhh haaa
Nope the shocks aren't on so it is sitting at full droop.
Thanks for the help❗