Reply to Ableton Send Lag

In ableton I send all my tracks to sends and use them as busses. So Ill have 4 drum tracks for example, in the "I-O" section I put it to "sends only" then make that send into a drum bus.

Now if i have an impulse for an example and put a 4/4 kick it wont be on beat with the metronome theres a delay (this only happens with midi not audio loops) but once I freeze and unfreeze its on beat

any ideas on how to fix this?