I have completely the same problem!
When we wipe i completely freeze for several seconds.
I use grid and ag_unitframes recount and omen and violation.
I see alot of increase in memory in my addons, but its never the same addon. Sometimes its Ace2 then its ag, then its whodrop.