Actually, the effect is two tracks. Pan left and Pan right. Pan your speakers to the left and listen to it, then go back and listen to it through the right.
Yeah, if you pan left you'll hear the actually notes he is playing. The pan right is where the delay effect comes in as you can hear. Put it center - and you can see how it all comes together