Click or drag to resize

TeraSort Class

Job runner for GraySort, which sorts GenSortRecord records in the input.
Inheritance Hierarchy

Namespace:  Ookii.Jumbo.Jet.Samples
Assembly:  Ookii.Jumbo.Jet.Samples (in Ookii.Jumbo.Jet.Samples.dll) Version: 2.0.0
Syntax
public class TeraSort : JobBuilderJob

The TeraSort type exposes the following members.

Constructors
  NameDescription
Public methodTeraSort
Initializes a new instance of the TeraSort class
Top
Properties
  NameDescription
Public propertyBlockSize
Gets or sets the block size of the job's output files.
(Inherited from BaseJobRunner.)
Public propertyConfigOnly
Gets or sets a value indicating whether the job runner will only create and print the job configuration, instead of running the job.
(Inherited from JobBuilderJob.)
Public propertyDfsConfiguration
Gets or sets the configuration used to access the Distributed File System.
(Inherited from Configurable.)
Protected propertyFileSystemClient
Gets the DFS client.
(Inherited from BaseJobRunner.)
Public propertyInputPath
Gets or sets the input path.
Public propertyIsInteractive
Gets or sets a value that indicates whether the job runner should wait for user input before starting the job and before exitting.
(Inherited from BaseJobRunner.)
Protected propertyJetClient
Gets the jet client.
(Inherited from BaseJobRunner.)
Public propertyJetConfiguration
Gets or sets the configuration used to access the Jet servers.
(Inherited from Configurable.)
Public propertyJobOrStageProperties
Gets or sets the property values that will override predefined values in the job configuration.
(Inherited from BaseJobRunner.)
Public propertyJobOrStageSettings
Gets or sets additional job or stage settings that will be defined in the job configuration.
(Inherited from BaseJobRunner.)
Public propertyMaxMergeInputs
Gets or sets the maximum number of merge inputs for a single merge pass.
Public propertyMergeTasks
Gets or sets the merge tasks.
Public propertyOutputPath
Gets or sets the output path.
Public propertyOverwriteOutput
Gets or sets a value that indicates whether the output directory should be deleted, if it exists, before the job is executed.
(Inherited from BaseJobRunner.)
Public propertyPartitionsPerTask
Gets or sets the number of partitions per merge task.
Public propertyReplicationFactor
Gets or sets the replication factor of the job's output files.
(Inherited from BaseJobRunner.)
Public propertySampleSize
Gets or sets the sample size used to determine the partitioner's split points.
Public propertyTaskContext
Gets or sets the configuration for the task attempt.
(Inherited from Configurable.)
Top
Methods
  NameDescription
Protected methodApplyJobPropertiesAndSettings
Adds the values of properties marked with the JobSettingAttribute to the JobSettings dictionary, applies properties set by the JobOrStageProperties property, and adds settings defined by the JobOrStageSettings property, and .
(Inherited from BaseJobRunner.)
Protected methodBuildJob
Constructs the job configuration using the specified job builder.
(Overrides JobBuilderJobBuildJob(JobBuilder).)
Protected methodCheckAndCreateOutputPath
If OverwriteOutput is , deletes the output path and then re-creates it; otherwise, checks if the output path exists and creates it if it doesn't exist and fails if it does.
(Inherited from BaseJobRunner.)
Public methodEquals
Determines whether the specified object is equal to the current object.
(Inherited from Object.)
Protected methodFinalize
Allows an object to try to free resources and perform other cleanup operations before it is reclaimed by garbage collection.
(Inherited from Object.)
Public methodFinishJob
Called after the job finishes.
(Inherited from BaseJobRunner.)
Public methodGetHashCode
Serves as the default hash function.
(Inherited from Object.)
Protected methodGetInputFileSystemEntry
Gets a JumboFileSystemEntry instance for the specified path, or throws an exception if the input doesn't exist.
(Inherited from BaseJobRunner.)
Public methodGetType
Gets the Type of the current instance.
(Inherited from Object.)
Protected methodMemberwiseClone
Creates a shallow copy of the current Object.
(Inherited from Object.)
Public methodNotifyConfigurationChanged
Indicates the configuration has been changed. ApplyConfiguration(Object, DfsConfiguration, JetConfiguration, TaskContext) calls this method after setting the configuration.
(Inherited from BaseJobRunner.)
Protected methodOnJobCreated
Called when the job has been created on the job server, but before running it.
(Overrides JobBuilderJobOnJobCreated(Job, JobConfiguration).)
Protected methodPromptIfInteractive
Prompts the user to start or exit, if IsInteractive is .
(Inherited from BaseJobRunner.)
Public methodRunJob
Starts the job.
(Inherited from JobBuilderJob.)
Public methodToString
Returns a string that represents the current object.
(Inherited from Object.)
Protected methodWriteOutput
Writes the result of the operation to the DFS using this instance's settings for BlockSize and ReplicationFactor.
(Inherited from JobBuilderJob.)
Top
Remarks

This is a sort implementation according to the rules for the GraySort benchmark, see http://sortbenchmark.org/.

See Also