I had the surgeries to divert and then remove performed at the Mayo Clinic in Rochester, MN by Dr. Kelli Mathis. There was a patient in Mayo at the same time that because she needed another major surgery because the surgeon that removed her j-pouch on the east coast didn't get it right. That's scary.
The surgery is more complicated than when they removed our colons and constructed our j-pouches. That's because the number of people that need their j-pouches removed is very small. She usually schedules only one surgery on the day she removed j-pouches. I respect your doctor telling you that he wouldn't remove it but I don't think it is to be like that forever. I don't remember why. Maybe someone else on here does.
I don't know about the surgeons at the other locations but Mayo is in Phoenix area and in Florida. Cleveland Clinic also has similar locations besides their Cleveland, OH Clinic. There are also excellent surgeons in California but I don't know where.
Sorry you need this after so long!