org.apache.flink.api.java.operators

Class SortPartitionOperator<T>

java.lang.Object

org.apache.flink.api.java.DataSet<OUT>

org.apache.flink.api.java.operators.Operator<OUT,O>

org.apache.flink.api.java.operators.SingleInputOperator<T,T,SortPartitionOperator<T>>

org.apache.flink.api.java.operators.SortPartitionOperator<T>

Type Parameters:

T - The type of the DataSet with locally sorted partitions.

@Public
public class SortPartitionOperator<T>
extends SingleInputOperator<T,T,SortPartitionOperator<T>>

This operator represents a DataSet with locally sorted partitions.

Field Summary

Fields inherited from class org.apache.flink.api.java.operators.Operator

minResources, name, parallelism, preferredResources

Fields inherited from class org.apache.flink.api.java.DataSet

context

Constructor Summary

Constructors

Constructor and Description
SortPartitionOperator(DataSet<T> dataSet, int sortField, org.apache.flink.api.common.operators.Order sortOrder, String sortLocationName)
SortPartitionOperator(DataSet<T> dataSet, org.apache.flink.api.common.operators.Keys.SelectorFunctionKeys<T,K> sortKey, org.apache.flink.api.common.operators.Order sortOrder, String sortLocationName)
SortPartitionOperator(DataSet<T> dataSet, String sortField, org.apache.flink.api.common.operators.Order sortOrder, String sortLocationName)

Method Summary

Modifier and Type	Method and Description
SortPartitionOperator<T>	sortPartition(int field, org.apache.flink.api.common.operators.Order order) Appends an additional sort order with the specified field in the specified order to the local partition sorting of the DataSet.
<K> SortPartitionOperator<T>	sortPartition(org.apache.flink.api.java.functions.KeySelector<T,K> keyExtractor, org.apache.flink.api.common.operators.Order order) Locally sorts the partitions of the DataSet on the extracted key in the specified order.
SortPartitionOperator<T>	sortPartition(String field, org.apache.flink.api.common.operators.Order order) Appends an additional sort order with the specified field in the specified order to the local partition sorting of the DataSet.
protected org.apache.flink.api.common.operators.SingleInputOperator<?,T,?>	translateToDataFlow(org.apache.flink.api.common.operators.Operator<T> input) Translates this operation to a data flow operator of the common data flow API.
boolean	useKeySelector() Returns whether using key selector or not.

Methods inherited from class org.apache.flink.api.java.operators.SingleInputOperator

getInput, getInputType

Methods inherited from class org.apache.flink.api.java.operators.Operator

getMinResources, getName, getParallelism, getPreferredResources, getResultType, name, setParallelism

Methods inherited from class org.apache.flink.api.java.DataSet

aggregate, checkSameExecutionContext, clean, coGroup, collect, combineGroup, count, cross, crossWithHuge, crossWithTiny, distinct, distinct, distinct, distinct, fillInType, filter, first, flatMap, fullOuterJoin, fullOuterJoin, getExecutionEnvironment, getType, groupBy, groupBy, groupBy, iterate, iterateDelta, join, join, joinWithHuge, joinWithTiny, leftOuterJoin, leftOuterJoin, map, mapPartition, max, maxBy, min, minBy, output, partitionByHash, partitionByHash, partitionByHash, partitionByRange, partitionByRange, partitionByRange, partitionCustom, partitionCustom, partitionCustom, print, print, printOnTaskManager, printToErr, printToErr, project, rebalance, reduce, reduceGroup, rightOuterJoin, rightOuterJoin, runOperation, sum, union, write, write, writeAsCsv, writeAsCsv, writeAsCsv, writeAsCsv, writeAsFormattedText, writeAsFormattedText, writeAsText, writeAsText

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SortPartitionOperator

public SortPartitionOperator(DataSet<T> dataSet,
                             int sortField,
                             org.apache.flink.api.common.operators.Order sortOrder,
                             String sortLocationName)

SortPartitionOperator

public SortPartitionOperator(DataSet<T> dataSet,
                             String sortField,
                             org.apache.flink.api.common.operators.Order sortOrder,
                             String sortLocationName)

SortPartitionOperator

public SortPartitionOperator(DataSet<T> dataSet,
                             org.apache.flink.api.common.operators.Keys.SelectorFunctionKeys<T,K> sortKey,
                             org.apache.flink.api.common.operators.Order sortOrder,
                             String sortLocationName)

Method Detail

useKeySelector

public boolean useKeySelector()

Returns whether using key selector or not.

sortPartition

public SortPartitionOperator<T> sortPartition(int field,
                                              org.apache.flink.api.common.operators.Order order)

Appends an additional sort order with the specified field in the specified order to the local partition sorting of the DataSet.

Overrides:

sortPartition in class DataSet<T>

Parameters:

field - The field index of the additional sort order of the local partition sorting.

order - The order of the additional sort order of the local partition sorting.

Returns:

The DataSet with sorted local partitions.

sortPartition

public SortPartitionOperator<T> sortPartition(String field,
                                              org.apache.flink.api.common.operators.Order order)

Appends an additional sort order with the specified field in the specified order to the local partition sorting of the DataSet.

Overrides:

sortPartition in class DataSet<T>

Parameters:

field - The field expression referring to the field of the additional sort order of the local partition sorting.

order - The order of the additional sort order of the local partition sorting.

Returns:

The DataSet with sorted local partitions.

sortPartition

public <K> SortPartitionOperator<T> sortPartition(org.apache.flink.api.java.functions.KeySelector<T,K> keyExtractor,
                                                  org.apache.flink.api.common.operators.Order order)

Description copied from class: DataSet

Locally sorts the partitions of the DataSet on the extracted key in the specified order. The DataSet can be sorted on multiple values by returning a tuple from the KeySelector.

Note that no additional sort keys can be appended to a KeySelector sort keys. To sort the partitions by multiple values using KeySelector, the KeySelector must return a tuple consisting of the values.

Overrides:

sortPartition in class DataSet<T>

Parameters:

keyExtractor - The KeySelector function which extracts the key values from the DataSet on which the DataSet is sorted.

order - The order in which the DataSet is sorted.

Returns:

The DataSet with sorted local partitions.

translateToDataFlow

protected org.apache.flink.api.common.operators.SingleInputOperator<?,T,?> translateToDataFlow(org.apache.flink.api.common.operators.Operator<T> input)

Description copied from class: SingleInputOperator

Translates this operation to a data flow operator of the common data flow API.

Specified by:

translateToDataFlow in class SingleInputOperator<T,T,SortPartitionOperator<T>>

Parameters:

input - The data flow operator that produces this operation's input data.

Returns:

The translated data flow operator.