XP has recently started having this strange behaviour. When the screen saver kicks in it slowly moves everything to swap.
Has one of the latest Microsoft upates done this?
As you can see as soon as you wake up the machine it moves stuff out of swap back into ram.