I do not think you are alone in your experience.
My local GI basically discharged me at the first sign of dysplasia in my rectum. Handed me off to a colleague at a university hospital. Perhaps he saw the future for me and wanted no part of it. I never heard from him again and new GI doctor still takes care of me post TPC/IPAA.
perhaps they did you a favor and you will find better care going forward. I am not familiar with the condition you mentioned, but if a doctor is not comfortable, in my opinion, it’s time to move on. In fact I had a doctor who was clearly not comfortable treating a post surgical complication but never advised me to look elsewhere. I had to fire that doctor and look elsewhere.
I think you will be better off in the long run finding the right caregiver to treat your issue.
best of luck!