I noticed that some albums become sluggish when skipping from track to track and some are not. So I thought this could be a tag reading issue.
I tried removing all the tags of my select songs using mp3tag and then update the tags again thru windows media player.
The player became snappy again.