SOLRFile - Revision history

Sam: /* Configuration */

2022-07-27T17:23:14Z

Configuration

Pmuessig: /* Configuration */

2021-04-02T13:49:02Z

Configuration

Pmuessig: /* Configuration */

2021-04-02T13:47:52Z

Configuration

Pmuessig at 13:47, 2 April 2021

2021-04-02T13:47:39Z

Pmuessig: /* Configuration */

2021-04-02T13:46:32Z

Configuration

Pmuessig at 13:46, 2 April 2021

2021-04-02T13:46:03Z

Pmuessig: Created page with "{| style="float:right;border:1px solid black" |+ Details | Executable | `SOLRFile.exe` |- | Stage | style="text-align:center;" | 255 |- | Percent Complete | style="..."

2021-01-25T19:30:17Z

Created page with "{| style="float:right;border:1px solid black" |+ Details | Executable | <code>SOLRFile.exe</code> |- | Stage | style="text-align:center;" | 255 |- | Percent Complete | style="..."

New page

{| style="float:right;border:1px solid black"
|+ Details
| Executable
| <code>SOLRFile.exe</code>
|-
| Stage
| style="text-align:center;" | 255
|-
| Percent Complete
| style="text-align:center;" | N/A
|-
| Message Queue
| style="text-align:center;" | <code>solrfile</code>
|}

SOLRFile indexes file and hash metadata in addition to extracting relevant file contents into a separately running SOLR Server. This ETL is untracked as the indexing operation of a load should not delay or postpone the completion of a load status.

This ETL subscribes to ALL file types, however only subset are extracted.

Extracted file types include, but are not limited to:

* Text Files (all encodings)
* PDF files
* Office Files
* Windows Registry
* SQlite Databases

@@ Line 41: / Line 41: @@
 When tweaking the number of parallel extractions and additions is is recommended to not exceed the number of cores available on your exploitation machine. Additional, each parallel operation will consume additional ram in the solr instance running, so make sure you allocate enough for the JVM or you might run into out of memory issues.
-E.G. for TruxtonSettings.xml
+E.G. for <code>[[Configuration_System#Truxton_Settings_File|TruxtonSettings.xml]]</code>
 <source lang="xml">
 <truxton_options>

@@ Line 39: / Line 39: @@
 |}
-When tweaking the number of parallel extractions and addition is is recommended to not exceed the number of cores available on your exploitation machine. Additional, each parallel operation will consume additional ram in the solr instance running, so make sure you allocate enough for the JVM or you might run into out of memory issues.
+When tweaking the number of parallel extractions and additions is is recommended to not exceed the number of cores available on your exploitation machine. Additional, each parallel operation will consume additional ram in the solr instance running, so make sure you allocate enough for the JVM or you might run into out of memory issues.
 E.G. for TruxtonSettings.xml

@@ Line 35: / Line 35: @@
 |-
 | solr_parallel_additions
-| string
+| number
 | The number of addition batches to do in parallel. Optional. Defaults to 1.
 |}

@@ Line 14: / Line 14: @@
 |}
-SOLRFile indexes file and hash metadata in addition to extracting relevant file contents into a separately running SOLR Server. This ETL is untracked as the indexing operation of a load should not delay or postpone the completion of a load status.
+SOLRFile indexes file and hash metadata in addition to extracting relevant file contents into a separately running SOLR Server. This [[ETL]] is untracked as the indexing operation of a load should not delay or postpone the completion of a load status.
 =Configuration=
@@ Line 56: / Line 56: @@
 =File Types=
-This ETL subscribes to ALL file types, however only subset are extracted.
+This [[ETL]] subscribes to ALL file types, however only subset are extracted.
 Extracted file types include, but are not limited to:

← Older revision		Revision as of 13:46, 2 April 2021
Line 17:		Line 17:

	=Configuration=		=Configuration=
		+
		+	Configurations for this [[ETL]] are nested under the root
		+
		+	{\| class="wikitable"
		+	\|-
		+	! Name
		+	! Data Type
		+	! Description
		+	\|-
		+	\| solr_url
		+	\| string
		+	\| The url to the solr server and core to use
		+	\|-
		+	\| solr_parallel_extractions
		+	\| number
		+	\| The number of extractions to do in parallel. Optional. Defaults to 1.
		+	\|-
		+	\| solr_parallel_additions
		+	\| string
		+	\| The number of addition batches to do in parallel. Optional. Defaults to 1.
		+	\|}
		+
		+	When tweaking the number of parallel extractions and addition is is recommended to not exceed the number of cores available on your exploitation machine. Additional, each parallel operation will consume additional ram in the solr instance running, so make sure you allocate enough for the JVM or you might run into out of memory issues.
		+
		+	E.G. for TruxtonSettings.xml
		+	<source lang="xml">
		+	<truxton_options>
		+	<!-- ...
		+	other configs
		+	...
		+	-->
		+	<solr_url>http://localhost:8983/solr/truxton-core</solr_url>
		+	<solr_parallel_extractions>4</solr_parallel_extractions>
		+	<solr_parallel_additions>2</solr_parallel_additions>
		+	</truxton_options>
		+	</source>

	=File Types=		=File Types=

← Older revision		Revision as of 13:46, 2 April 2021
Line 15:		Line 15:

	SOLRFile indexes file and hash metadata in addition to extracting relevant file contents into a separately running SOLR Server. This ETL is untracked as the indexing operation of a load should not delay or postpone the completion of a load status.		SOLRFile indexes file and hash metadata in addition to extracting relevant file contents into a separately running SOLR Server. This ETL is untracked as the indexing operation of a load should not delay or postpone the completion of a load status.
		+
		+	=Configuration=
		+
		+	=File Types=

	This ETL subscribes to ALL file types, however only subset are extracted.		This ETL subscribes to ALL file types, however only subset are extracted.

SOLRFile - Revision history

Sam: /* Configuration */

Pmuessig: /* Configuration */

Pmuessig: /* Configuration */

Pmuessig at 13:47, 2 April 2021

Pmuessig: /* Configuration */

Pmuessig at 13:46, 2 April 2021

Pmuessig: Created page with "{| style="float:right;border:1px solid black" |+ Details | Executable | SOLRFile.exe |- | Stage | style="text-align:center;" | 255 |- | Percent Complete | style="..."

Pmuessig: Created page with "{| style="float:right;border:1px solid black" |+ Details | Executable | `SOLRFile.exe` |- | Stage | style="text-align:center;" | 255 |- | Percent Complete | style="..."