Tongue jack handle question

I would like to relocate the handle on my jack from the front to the back. This would let me open the rear hatch on my van without unhooking. I took the top cover of the jack off and there is a gear that the handle runs through and it is held to the handle with a gear key. This key seems to be riveted all the way through the gear. I can't pull it out with needle nose pliers. Does anyone have experience removing this key?

Thanks