X and Y difference

For more on this see:

That said, in a material such as MDF, I could see the variations you are seeing as deflection of the material as the endmill moves over it.