So i managed to find a spreadsheet programme by some bike fitter. By putting in a few measurements on his spreadsheet it calculates what bike size i should be. According to his spread sheet the fuji is grossly oversized.
He says i should be riding a 48.3 seat tube/52cm top tube frame and spinning cranks which is 168.2cm. It also recommends a 11cm stem for a non setback post or a 9.5cm stem if i run a setback. According to this guy i am pretty much killing myself when i ride my fuji because it is so incorrect for myself. Still though i think trying a smaller sized bike first would be the best judge of that.
If you want to have a play around with it yourself you can download it from here.