Make sure pulseaudio is not in way. Pulseaudio is known from time to time to cause sound lags. Yes it really should not be used but distrobutions have to insist on shipping with it installed and activated by default like Ubuntu.