SOLRFile
| Executable | SOLRFile.exe
|
| Stage | 255 |
| Percent Complete | N/A |
| Message Queue | solrfile
|
SOLRFile indexes file and hash metadata in addition to extracting relevant file contents into a separately running SOLR Server. This ETL is untracked as the indexing operation of a load should not delay or postpone the completion of a load status.
Configuration
Configurations for this ETL are nested under the root
| Name | Data Type | Description |
|---|---|---|
| solr_url | string | The url to the solr server and core to use |
| solr_parallel_extractions | number | The number of extractions to do in parallel. Optional. Defaults to 1. |
| solr_parallel_additions | number | The number of addition batches to do in parallel. Optional. Defaults to 1. |
When tweaking the number of parallel extractions and additions is is recommended to not exceed the number of cores available on your exploitation machine. Additional, each parallel operation will consume additional ram in the solr instance running, so make sure you allocate enough for the JVM or you might run into out of memory issues.
E.G. for TruxtonSettings.xml
<truxton_options>
<!-- ...
other configs
...
-->
<solr_url>http://localhost:8983/solr/truxton-core</solr_url>
<solr_parallel_extractions>4</solr_parallel_extractions>
<solr_parallel_additions>2</solr_parallel_additions>
</truxton_options>
File Types
This ETL subscribes to ALL file types, however only subset are extracted.
Extracted file types include, but are not limited to:
- Text Files (all encodings)
- PDF files
- Office Files
- Windows Registry
- SQlite Databases
