It is not an infection usually if it is that far out. It is common for it to build up actually. They can just go away. Just like it is common to have GYN related fluid due to a cyst bursting.
Every doctor is different but so far I am told it doesn't cause damage so leave it be, to remove it is surgery and that can just cause more issues.