This is because at the fastest speed, sometimes the radar "misses" the obelisk that warns you of the wisps and so the number goes down, but the next time around the radar sees it again and thinks it's a new entity. Sell back a couple of radar speed updates and this should stop.