JQuery searchdialog plugin is a plugin that allows you to display a modal search dialog with an html text input to filter results being queried by a DWR Controller (or another source), to fill the table that is behind (a dataTable) the plugin is expecting only an array of arrays of strings so you can use any AJAX source.
Take a look at the source code at jquerysearchdialog
You can download the sample module source that includes the jquery plugin at openmrs-modules/devexamples/jquerysearchdialog, just download the source, build the .omod and install it through the openmrs module installer.
You can find sample code at Intro_to_JQuery_Framework, this is a basic example using DWR controllers to make the search.