Does that custom search searches also by pages, posts, SKU or by products only?
Because our search has option to search by posts, pages, SKU, projects and of course it increases the time. Try to disable them http://prntscr.com/s3sech , set Do Ajax Search After … Characters to 3 and check the search after that.
Regards
