Loading Strategies

From truxwiki.com
Revision as of 17:34, 18 January 2021 by Sam (talk | contribs) (→‎Small)
Jump to navigation Jump to search

The way you load data into Truxton mostly depends on the amount of data you have to load.

Small

When you have just a few pieces of media to load, you can use the Desktop Gui or Windows Explorer (right-button Load...). Manually starting a load is for single-user environments where everything is on a single machine. The amount of data is a couple of hard drives, half a dozen phones, etc.

You can also load from the command line.

"C:\Program Files\Truxton\Loader\Load.exe" WinXP.E01

Medium

When you get to the point where you have more than several hard drives to process at a time, a dedicated loader machine is used. At this level, overloading the machine becomes a problem. There's too much data to load and not enough time to sit and watch the loaders. Using a Load List will allow you to specify the media to load and how many simultaneous load processes to use. This allows you to balance the resources of your machine with the amount of data to load.

Large

When you have a never ending stream of incoming media, you need something even more automatic than load lists. Multiple machines dedicated to loading are pressed into service. Like other ETL processes, the loader has its own message queue that loading tasks can be sent to. When a load process on one of those machines finishes, it will grab another load task from the message queue.