Search Technologies
Search Technologies' Document Processing Methodology for Search (DPMS) is a collection of tools, techniques, and processes which prepare data for use in search-based applications. The majority of business-critical search applications can be significantly enhanced, or even transformed by better document processing prior to indexing.
DPMS reduces complexity and makes search applications more maintainable and flexible. DPMS also helps search to deliver user-experience excellence in a controllable, cost-effective way.
Search Technologies' Document Processing Methodology for Search has been developed during the delivery of more than 25,000 consultant-days of search implementation services.
Objectives
The overall technical objectives of DPMS are the fusion, normalization, and enrichment of data to be indexed into a search engine.
- Fusion: Combining multiple data streams or document collections into a single, sensibly searchable set of indexes. Fusion is particularly important for applications aiming to present a “one search box” interface to users, despite the data being disparate.
- Normalization: Cleaning, extracting and normalizing content, metadata and formats.
- Enrichment: Automating the addition of metadata to documents using external or third-party resources. Normalization and enrichment provide a foundation for added-value search features.
DPMS is both a process and a technology suite.
- Process: DPMS is a well practiced process through which Search Technologies ’ engineers analyze, design, implement and validate data intended for indexing into a search engine. This process has been used for a wide range of customer engagements, including use with dozens of extremely challenging document collections.
- Technology Suite: DPMS uses a collection of tools, high performance frameworks and functional modules, specifically developed for the purpose and where practical, based on open source utilities.