I am based in the U.K. so I'm not sure if this is available where you are, but the best relief I've found from this has been colesevelam tablets, prescribed by my surgeon.
It is a bile acid sequestrant. Bile is usually reabsorbed in the lower part of the small bowel, so this process can be disrupted by the pouch surgery. The bile burns the skin.
I also tried something called cholestyramine, which was granule that performs a similar function. But I have found the tablets much easier to take ano more relaible. Partly because taking a large amount of liquid in one go, as required with granules, seems to irritate my bowel
If I miss a dose or two of the tablets I really notice the difference.