Make sure you have reviewed the settings of your audio hardware outside of EZmix2. I.e. something like a separate 'control panel' for your hardware with buffer settings and sample rate, etc.
On my hardware I have a I/O roundtrip latency of 23,2 ms @44,1kHz when running through EZmix2 standalone.
BR,
John