SOLR - Revision history

Sam: /* Configuration */

2022-07-27T17:21:04Z

Configuration

2021-04-02T13:47:03Z

2021-04-02T13:45:11Z

2021-04-02T13:44:59Z

2021-04-02T13:44:28Z

Configuration

2021-04-02T13:44:11Z

Configuration

2021-04-02T13:38:13Z

2021-01-25T19:22:30Z

2021-01-25T19:21:55Z

2021-01-25T19:21:34Z

@@ Line 33: / Line 33: @@
 |}
-E.G. for TruxtonSettings.xml
+E.G. for <code>[[Configuration_System#Truxton_Settings_File|TruxtonSettings.xml]]</code>
 <source lang="xml">
 <truxton_options>

@@ Line 31: / Line 31: @@
 | string
 | The url to the solr server and core to use
 |}
 E.G. for TruxtonSettings.xml
@@ Line 51: / Line 41: @@
      -->
    <solr_url>http://localhost:8983/solr/truxton-core</solr_url>
 </truxton_options>
 </source>

@@ Line 16: / Line 16: @@
 The SOLR [[ETL]] (aka SOLR Contents Indexer) indexes media contents metadata items like artifacts, messages and locations into a separately running SOLR Server. It notably does '''NOT''' index file metadata, hashes or file contents (those operations are done in [[SOLRFile]]).
-It occurs near the end of the load once most ETL operations are complete.
+It occurs near the end of the load once most [[ETL]] operations are complete.
 =Configuration=

@@ Line 14: / Line 14: @@
 |}
-The SOLR [[ETL]] (aka SOLR Contents Indexer) indexes media contents metadata items like artifacts, messages and locations into a separately running SOLR Server. It notably does '''NOT''' index file metadata, hashes or file contents (those operations are done in [[SOLRFile|SOLRFile.exe]]).
+The SOLR [[ETL]] (aka SOLR Contents Indexer) indexes media contents metadata items like artifacts, messages and locations into a separately running SOLR Server. It notably does '''NOT''' index file metadata, hashes or file contents (those operations are done in [[SOLRFile]]).
 It occurs near the end of the load once most ETL operations are complete.

@@ Line 34: / Line 34: @@
 | solr_parallel_extractions
 | number
-| The number of extractions to do in parallel.
+| The number of extractions to do in parallel. Optional. Defaults to 1.
 |-
 | solr_parallel_additions
 | string
-| The number of addition batches to do in parallel
+| The number of addition batches to do in parallel. Optional. Defaults to 1.
 |}

← Older revision		Revision as of 13:44, 2 April 2021
Line 19:		Line 19:

	=Configuration=		=Configuration=
		+
		+	Configurations for this [[ETL]] are nested under the root
		+
		+	{\| class="wikitable"
		+	\|-
		+	! Name
		+	! Data Type
		+	! Description
		+	\|-
		+	\| solr_url
		+	\| string
		+	\| The url to the solr server and core to use
		+	\|-
		+	\| solr_parallel_extractions
		+	\| number
		+	\| The number of extractions to do in parallel.
		+	\|-
		+	\| solr_parallel_additions
		+	\| string
		+	\| The number of addition batches to do in parallel
		+	\|}
		+
		+	When tweaking the number of parallel extractions and addition is is recommended to not exceed the number of cores available on your exploitation machine. Additional, each parallel operation will consume additional ram in the solr instance running, so make sure you allocate enough for the JVM or you might run into out of memory issues.
		+
		+	E.G. for TruxtonSettings.xml
		+	<source lang="xml">
		+	<truxton_options>
		+	<!-- ...
		+	other configs
		+	...
		+	-->
		+	<solr_url>http://localhost:8983/solr/truxton-core</solr_url>
		+	<solr_parallel_extractions>4</solr_parallel_extractions>
		+	<solr_parallel_additions>2</solr_parallel_additions>
		+	</truxton_options>
		+	</source>

← Older revision		Revision as of 19:21, 25 January 2021
Line 15:		Line 15:

	SOLR (aka SOLR Contents Indexer) indexes media contents metadata items like artifacts, messages and locations.		SOLR (aka SOLR Contents Indexer) indexes media contents metadata items like artifacts, messages and locations.
−	It notably does '''NOT''' index file metadata, hashes or file contents (those operations are done in [[SOLRFile\|SOLRFile.exe]]). It occurs near the end of the load once most ETL operations are complete.	+	It notably does '''NOT''' index file metadata, hashes or file contents (those operations are done in [[SOLRFile\|SOLRFile.exe]]).
		+
		+	It occurs near the end of the load once most ETL operations are complete.

← Older revision	Revision as of 19:21, 25 January 2021
Line 1:	Line 1:
	+	{\| style="float:right;border:1px solid black"
	+	\|+ Details
	+	\| Executable
	+	\| <code>SOLR.exe</code>
	+	\|-
	+	\| Stage
	+	\| style="text-align:center;" \| 192
	+	\|-
	+	\| Percent Complete
	+	\| style="text-align:center;" \| 90%
	+	\|-
	+	\| Message Queue
	+	\| style="text-align:center;" \| <code>solrcontentstage</code>
	+	\|}

	+	SOLR (aka SOLR Contents Indexer) indexes media contents metadata items like artifacts, messages and locations.
	+	It notably does '''NOT''' index file metadata, hashes or file contents (those operations are done in [[SOLRFile\|SOLRFile.exe]]). It occurs near the end of the load once most ETL operations are complete.