I am going to suggest that you look for a new GI. I had a GI who basically dumped me after my j pouch surgery because he said, "I was well." When I contacted him with pouchitis, he couldn't help me because he didn't know what it was. I went to my surgeon just like you did for check-ups and meds as needed. Ultimately he referred me to a new GI, who I love.
There are plenty of good GI's out there who know j pouches and are teachers as well as partners with us in our care. You may have to interview quite a few to find one you like and trust, but the benefits will be so worth it.
Best of luck finding the right fit for you