SortSpillRecordWriterT Class

public sealed class SortSpillRecordWriter<T> : SpillRecordWriter<T>

Public NotInheritable Class SortSpillRecordWriter(Of T)
	Inherits SpillRecordWriter(Of T)

generic<typename T>
public ref class SortSpillRecordWriter sealed : public SpillRecordWriter<T>

[<SealedAttribute>]
type SortSpillRecordWriter<'T> =  
    class
        inherit SpillRecordWriter<'T>
    end

Type Parameters

T

The type of the records.

Each spill is written to its own file, and each partition is sorted using IndexedQuicksort before being spilled. When FinishWriting is called, the individual spills are merged using MergeHelperT into the final output file.

It is possible to specify a combiner task that will be run on the records of each spill after sorting. Use this to reduce the size of the output records after sorting. The combiner must be a ITaskTInput, TOutput where both the input and output record type are T. The Run(RecordReaderTInput, RecordWriterTOutput) method will be called multiple times (once for each spill), so the task must be prepared for. You can use a ReduceTaskTKey, TValue, TOutput for Map-Reduce style combining.

Reference