Click or drag to resize

AdvancedWordCount Class

JobBuilder for the advanced version of WordCount.
Inheritance Hierarchy

Namespace:  Ookii.Jumbo.Jet.Samples
Assembly:  Ookii.Jumbo.Jet.Samples (in Ookii.Jumbo.Jet.Samples.dll) Version: 2.0.0
Syntax
public class AdvancedWordCount : JobBuilderJob

The AdvancedWordCount type exposes the following members.

Constructors
  NameDescription
Public methodAdvancedWordCount
Initializes a new instance of the AdvancedWordCount class
Top
Properties
  NameDescription
Public propertyBlockSize
Gets or sets the block size of the job's output files.
(Inherited from BaseJobRunner.)
Public propertyCaseInsensitive
Gets or sets a value indicating whether to use a case-insensitive comparison for the words.
Public propertyConfigOnly
Gets or sets a value indicating whether the job runner will only create and print the job configuration, instead of running the job.
(Inherited from JobBuilderJob.)
Public propertyDfsConfiguration
Gets or sets the configuration used to access the Distributed File System.
(Inherited from Configurable.)
Protected propertyFileSystemClient
Gets the DFS client.
(Inherited from BaseJobRunner.)
Public propertyIgnorePatternsFile
Gets or sets the path of the ignore patterns file.
Public propertyInputPath
Gets or sets the input path.
Public propertyIsInteractive
Gets or sets a value that indicates whether the job runner should wait for user input before starting the job and before exitting.
(Inherited from BaseJobRunner.)
Protected propertyJetClient
Gets the jet client.
(Inherited from BaseJobRunner.)
Public propertyJetConfiguration
Gets or sets the configuration used to access the Jet servers.
(Inherited from Configurable.)
Public propertyJobOrStageProperties
Gets or sets the property values that will override predefined values in the job configuration.
(Inherited from BaseJobRunner.)
Public propertyJobOrStageSettings
Gets or sets additional job or stage settings that will be defined in the job configuration.
(Inherited from BaseJobRunner.)
Public propertyOutputPath
Gets or sets the output path.
Public propertyOverwriteOutput
Gets or sets a value that indicates whether the output directory should be deleted, if it exists, before the job is executed.
(Inherited from BaseJobRunner.)
Public propertyPartitions
Gets or sets the number of partitions for aggregation.
Public propertyReplicationFactor
Gets or sets the replication factor of the job's output files.
(Inherited from BaseJobRunner.)
Public propertyTaskContext
Gets or sets the configuration for the task attempt.
(Inherited from Configurable.)
Top
Methods
  NameDescription
Public methodStatic memberAggregateCounts
Aggregates the counts.
Protected methodApplyJobPropertiesAndSettings
Adds the values of properties marked with the JobSettingAttribute to the JobSettings dictionary, applies properties set by the JobOrStageProperties property, and adds settings defined by the JobOrStageSettings property, and .
(Inherited from BaseJobRunner.)
Protected methodBuildJob
Constructs the job configuration using the specified job builder.
(Overrides JobBuilderJobBuildJob(JobBuilder).)
Protected methodCheckAndCreateOutputPath
If OverwriteOutput is , deletes the output path and then re-creates it; otherwise, checks if the output path exists and creates it if it doesn't exist and fails if it does.
(Inherited from BaseJobRunner.)
Public methodEquals
Determines whether the specified object is equal to the current object.
(Inherited from Object.)
Protected methodFinalize
Allows an object to try to free resources and perform other cleanup operations before it is reclaimed by garbage collection.
(Inherited from Object.)
Public methodFinishJob
Called after the job finishes.
(Inherited from BaseJobRunner.)
Public methodGetHashCode
Serves as the default hash function.
(Inherited from Object.)
Protected methodGetInputFileSystemEntry
Gets a JumboFileSystemEntry instance for the specified path, or throws an exception if the input doesn't exist.
(Inherited from BaseJobRunner.)
Public methodGetType
Gets the Type of the current instance.
(Inherited from Object.)
Public methodStatic memberMapWords
Maps the words.
Protected methodMemberwiseClone
Creates a shallow copy of the current Object.
(Inherited from Object.)
Public methodNotifyConfigurationChanged
Indicates the configuration has been changed. ApplyConfiguration(Object, DfsConfiguration, JetConfiguration, TaskContext) calls this method after setting the configuration.
(Inherited from BaseJobRunner.)
Protected methodOnJobCreated
Called when the job has been created on the job server, but before running it.
(Inherited from JobBuilderJob.)
Protected methodPromptIfInteractive
Prompts the user to start or exit, if IsInteractive is .
(Inherited from BaseJobRunner.)
Public methodStatic memberReversePairsTKey, TValue
Reverses the key and value of a pair.
Public methodRunJob
Starts the job.
(Inherited from JobBuilderJob.)
Public methodToString
Returns a string that represents the current object.
(Inherited from Object.)
Protected methodWriteOutput
Writes the result of the operation to the DFS using this instance's settings for BlockSize and ReplicationFactor.
(Inherited from JobBuilderJob.)
Top
Remarks
This sample is a more advanced version of WordCount that demonstrates some more advanced features.
See Also