Apache Solr Reference Guide Covering Apache Solr 6.0

While there are use cases where you might need to create a Solr document for each line read from a file, it is
expected that in most cases that the lines read by this processor will consist of a pathname, which in turn will be
consumed by another EntityProcessor, such as XPathEntityProcessor.
PlainTextEntityProcessor
This EntityProcessor reads all content from the data source into an single implicit field called plainText. The
content is not parsed in any way, however you may add transformers to manipulate the data within the plainTe
xt as needed, or to create other additional fields.
For example:
Ensure that the dataSource is of type DataSource ( FileDataSource, URLDataSource).
SolrEntityProcessor
Uses Solr instance as a datasource, see https://wiki.apache.org/solr/DataImportHandler#SolrEntityProcessor
Transformers
Transformers manipulate the fields in a document returned by an entity. A transformer can create new fields or
modify existing ones. You must tell the entity which transformers your import operation will be using, by adding
an attribute containing a comma separated list to the element.
Specific transformation rules are then added to the attributes of a element, as shown in the examples
below. The transformers are applied in the order in which they are specified in the transformer attribute.
The Data Import Handler contains several built-in transformers. You can also write your own custom
transformers, as described in the Solr Wiki (see http://wiki.apache.org/solr/DIHCustomTransformer). The
ScriptTransformer (described below) offers an alternative method for writing your own transformers.
Solr includes the following built-in transformers:
Transformer Name
ClobTransformer
DateFormatTransformer
HTMLStripTransformer
LogTransformer
NumberFormatTransformer
RegexTransformer
Use
Used to create a String out of a Clob type in database.
Parse date/time instances.
Strip HTML from a field.
Used to log data to log files or a console.
Uses the NumberFormat class in java to parse a string into a number.
Use regular expressions to manipulate fields.
Apache Solr Reference Guide 6.0
221