Reply to USB Keyboard as Controller - Latency

Is it possible to easily modify a usb keyboard to improve the latency?

As far as I can tell by the program "KeyboardTest" the latency is at least 100ms on my system - making it unusable as a performance controller.
Perhaps it might be possible to modify it and make it into a really cheap but low latency midi device?

Any suggestions?