Have a strange problem with skype (latest version) on ubuntu 6.10 (esd killed)

During a skypeout call, after few minutes talking, I cant hear the other person anymore, while they still can hear me.
If I close the call and start another call then it works.

Strange thing is, this happens if I use bare "skype" with ALSA.

If I use "aoss skype" with OSS, then the issue does not happen.

Anyone that can explain this?