Hi Kaiwei,
Creating custom OVS search help for ALV will be same as what we normally do for normal Input Fields/Table UI element.
We need to mention the component usage of the OVS for the attribute which you are specifying for search help.
**************** - OVS help in the WebDynpro application
Thank You,
Harsha