SpillRecordWriterT Class

Multi record writer that collects records in an in-memory buffer, and periodically spills the record to the output when the buffer is full.

Inheritance Hierarchy

SystemObject
  Ookii.Jumbo.IORecordWriterT
    Ookii.Jumbo.Jet.ChannelsSpillRecordWriterT
      Ookii.Jumbo.Jet.ChannelsSortSpillRecordWriterT

Namespace: Ookii.Jumbo.Jet.Channels
Assembly: Ookii.Jumbo.Jet (in Ookii.Jumbo.Jet.dll) Version: 0.3.0+dc1307f20e065bb638e0b73a34cd216f57e486f1

Syntax

C++

Copy

public abstract class SpillRecordWriter<T> : RecordWriter<T>, 
	IMultiRecordWriter<T>

Public MustInherit Class SpillRecordWriter(Of T)
	Inherits RecordWriter(Of T)
	Implements IMultiRecordWriter(Of T)

generic<typename T>
public ref class SpillRecordWriter abstract : public RecordWriter<T>, 
	IMultiRecordWriter<T>

[<AbstractClassAttribute>]
type SpillRecordWriter<'T> = 
    class
        inherit RecordWriter<'T>
        interface IMultiRecordWriter<'T>
    end

Type Parameters

T: The type of the records.

The SpillRecordWriterT type exposes the following members.

Constructors

	Name	Description
	SpillRecordWriterT	Initializes a new instance of the SpillRecordWriterT class.

Top

Properties

	Name	Description
	BytesWritten	Gets the number of bytes that were actually written to the output. (Overrides RecordWriterTBytesWritten)
	ErrorOccurred	Gets a value indicating whether an error occurred during a background spill.
	HasFinishedWriting	Gets a value indicating whether FinishWriting method has been called. (Inherited from RecordWriterT)
	OutputBytes	Gets the size of the written records after serialization. (Overrides RecordWriterTOutputBytes)
	Partitioner	Gets the partitioner.
	RecordsWritten	Gets the total number of records written by this record writer. (Inherited from RecordWriterT)
	SpillBuffer	Gets the spill buffer for the current spill.
	SpillCount	Gets the number of spills performed.
	WriteTime	Gets the time spent writing. (Inherited from RecordWriterT)

Top

Methods

	Name	Description
	Dispose	Cleans up all resources held by this RecordWriter{T}. (Inherited from RecordWriterT)
	Dispose(Boolean)	Releases unmanaged and - optionally - managed resources (Overrides RecordWriterTDispose(Boolean))
	Equals	Determines whether the specified object is equal to the current object. (Inherited from Object)
	Finalize	Allows an object to try to free resources and perform other cleanup operations before it is reclaimed by garbage collection. (Inherited from Object)
	FinishWriting	Informs the record writer that no further records will be written. (Overrides RecordWriterTFinishWriting)
	GetHashCode	Serves as the default hash function. (Inherited from Object)
	GetSpillIndex	Gets the index for the specified partition for the current spill.
	GetType	Gets the Type of the current instance. (Inherited from Object)
	HasDataForPartition	Determines whether the current spill has data for the specified partition.
	MemberwiseClone	Creates a shallow copy of the current Object. (Inherited from Object)
	PreparePartition	When overridden in a derived class, prepares the partition for the spill.
	SpillDataSizeForPartition	Gets the spill data size for the specified partition.
	SpillOutput	When overridden by a derived class, writes the spill data to the output.
	ToString	Returns a string that represents the current object. (Inherited from Object)
	WritePartition(Int32, RecordWriterRawRecord)	Writes the specified partition to the output using the RawRecord format, which includes record sizes.
	WritePartition(Int32, Stream)	Writes the specified partition to the output.
	WriteRecord	Writes a record. (Inherited from RecordWriterT)
	WriteRecordInternal	Writes a record. (Overrides RecordWriterTWriteRecordInternal(T))
	WriteRecords	Writes the specified sequence of records. (Inherited from RecordWriterT)

Top

Reference

Ookii.Jumbo.Jet.Channels Namespace