When you removed the hitch did you find a drawtube spacer located inside the tube where the front horizontal hitch bolt locates?
This is fitted to prevent the drawtube deforming when the bolt is tightened, and if the drawtube is deformed, ie narrower in the horizontal plane, then you'll struggle to get the damper out.
If that is the problem then if you turn the front T section of the damper 90 deg so it's vertical it should come out quite easily.