SMILA - Unified information access architecture

SMILA is an extensible framework for building search solutions to access unstructured information in the enterprise. Besides providing essential infrastructure components and services, SMILA also delivers ready-to-use add-on components, like connectors to most relevant data sources. Using the framework as their basis will enable developers to concentrate on the creation of higher value solutions, like semantic driven applications etc.

It has a crawler / agent, which pushes the data. The data is then processed by various filters. BPEL workflows could be created using its WorkerManager. The pipeline could be well managed by this workflow engine.