I too needed to have my j-pouch removed. First I was diverted to a permanent ileostomy in hopes my j-pouch would get better so that I might be able to take down to using it again. It didn't heal so I had it and the rectal stump removed. During both of these surgeries my surgeon spent hours lysing an abdomen full of adhesions and scarring. I am doing much better. That was around 2 years ago.
My surgeon said the removal surgery is worse than the colon removal and j-pouch creation surgery. From my point of view the surgery was much better than the original surgeries and the recovery was faster too. The back door took a while to recover and I needed to sit on a cushion for months.
I'm not male so can not speak to the potential sexual dysfunction question. I went to the Mayo Clinic for my surgeries as I wanted someone that was an expert with lots of experience with the surgery. If I were you I would make sure that the surgeon had the experience and expertise required to perform the surgery. You will be sure to discuss the dysfunction question with your surgeon as well.
There are several guys on here that had their surgeries around the time that I did. You might want to read past posts in the Ostomy Forum here. You could ask your question there and you could also send them Private Messages about it. I'm telling you this in case you weren't aware of the section and the ability to PM members.