Maintenance ETL - Revision history

Sam: /* Tasks Performed */

2022-07-25T19:33:10Z

Tasks Performed

Sam: /* Tasks Performed */

2022-07-25T19:31:09Z

Tasks Performed

Sam: /* Tasks Performed */

2022-07-25T19:27:49Z

Tasks Performed

Sam: /* Import Content */

2022-07-25T18:53:29Z

Import Content

Sam: /* Import Content */

2022-07-25T18:52:36Z

Import Content

Sam: /* Tasks Performed */

2022-07-25T18:47:49Z

Tasks Performed

Sam: /* Tasks Performed */

2022-07-25T18:34:00Z

Tasks Performed

Sam: /* Clean Database */

2022-07-25T18:31:46Z

Clean Database

Sam: /* Clean Database */

2022-07-25T18:30:12Z

Clean Database

Sam: /* Clean Database */

2022-07-25T17:59:16Z

Clean Database

← Older revision		Revision as of 19:33, 25 July 2022
Line 42:		Line 42:
	==Reindex==		==Reindex==
	This will cause all files with contents to have their contents indexed.		This will cause all files with contents to have their contents indexed.
		+
		+	==Set Media Primary Photo==
		+	This will add the given file to Truxton and set it as the media's primary photograph.

@@ Line 8: / Line 8: @@
 When Maintenance cleans a database, it will determine if there are any records in the following tables that do not belong to any media or file.
 These records are considered to be orphaned.
 ==Consolidate Depots==
@@ Line 38: / Line 23: @@
 If a "candidate" depot will surpass the maximum size set for it, it will be closed and its depot status set to "full."
 If all contents in the "donor" depot have been merged, it will be deleted from the <code>[Depot]</code> table and the name of the file will be renamed to add <code>.ToBeDeleted</code> to the extension.

← Older revision		Revision as of 19:27, 25 July 2022
Line 20:		Line 20:
	It will only import content that doesn't already exist in the database.		It will only import content that doesn't already exist in the database.
	If any content has been imported, a message will be sent to reindex the media.		If any content has been imported, a message will be sent to reindex the media.
		+
		+	==Reindex==
		+	This will cause all files with contents to have their contents indexed.
		+
		+	==Consolidate Depots==
		+	Consolidating [[Depot\|depot]] files is a process where the unique contents of a smaller depot is merged into a larger depot.
		+	In order for a depot file to be considered as a candidate to receive content, it must have a status of "closed" and the size of the depot less than the maximum.
		+	This is determined by the <code>[DepotStatusID]</code> and <code>[MaximumSize]</code> columns of the <code>[Depot]</code> table in the database.
		+	The algorithm for consolidating two depot files is:
		+	# Choose the largest depot that is closed and smaller than the maximum size as the "candidate" depot
		+	# Choose the smallest depot that is closed as the "donor" depot
		+	# Enumerate through the content in the "donor" depot
		+	# If the contents do not exist in any other depot in Truxton, append the "donor" content to the "candidate" depot
		+	# Add a new record to the <code>[Content]</code> table referencing the area in the "candidate" depot
		+	# Remove the record in the <code>[Content]</code> table that referenced the "donor" depot
		+
		+	If a "candidate" depot will surpass the maximum size set for it, it will be closed and its depot status set to "full."
		+	If all contents in the "donor" depot have been merged, it will be deleted from the <code>[Depot]</code> table and the name of the file will be renamed to add <code>.ToBeDeleted</code> to the extension.

@@ Line 17: / Line 17: @@
 ==Import Content==
-This will navigate the given [TPIF] file and import any file contents that may have been in there.
+This will navigate the given [[TPIF]] file and import any file contents that may have been in there.
 It will only import content that doesn't already exist in the database.
 If any content has been imported, a message will be sent to reindex the media.

@@ Line 17: / Line 17: @@
 ==Import Content==
-This will navigate the given TPIF and import any file contents that may have been in there.
+This will navigate the given [TPIF] file and import any file contents that may have been in there.
 It will only import content that doesn't already exist in the database.

@@ Line 9: / Line 9: @@
 These records are considered to be orphaned.
-* <code>[Alert]</code>
+==Delete Media==
-* <code>[Content]</code>
+This will delete the records in the database associated with the given media.
-==Delete Media==
+==Optimize==
-This will delete the media associated with the id in the message from the database.
+As SQL databases grow over time, the query planner may be using stale statistics for optimization.

← Older revision		Revision as of 18:34, 25 July 2022
Line 33:		Line 33:
	* <code><nowiki>[</nowiki>[[USBDevice Table\|USBDevice]]<nowiki>]</nowiki></code>		* <code><nowiki>[</nowiki>[[USBDevice Table\|USBDevice]]<nowiki>]</nowiki></code>
	* <code><nowiki>[</nowiki>[[WebsiteVisit Table\|WebsiteVisit]]<nowiki>]</nowiki></code>		* <code><nowiki>[</nowiki>[[WebsiteVisit Table\|WebsiteVisit]]<nowiki>]</nowiki></code>
		+
		+	==Delete Media==
		+	This will delete the media associated with the id in the message from the database.

@@ Line 7: / Line 7: @@
 ==Clean Database==
 When Maintenance cleans a database, it will determine if there are any records in the following tables that do not belong to any media.
 * <code><nowiki>[</nowiki>[[File Table|File]]<nowiki>]</nowiki></code>
-* Filename
+* <code>[Filename]</code>
-* Slack
+* <code>[Free]</code>
-* Entity Strings
+* <code>[Image]</code>
-* Expanded Files
+* <code>[InvestigationMedia]</code>
-* Message Address Message
+* <code><nowiki>[</nowiki>[[Location Table|Location]]<nowiki>]</nowiki></code>
 * <code><nowiki>[</nowiki>[[Log Table|Log]]<nowiki>]</nowiki></code>
-* Log Strings
+* <code>[LogString]</code>
-* Content
+* <code>[Message]</code>