org.apache.flink.api.java.operators

Class MapPartitionOperator<IN,OUT>

java.lang.Object

org.apache.flink.api.java.DataSet<OUT>

org.apache.flink.api.java.operators.Operator<OUT,O>

org.apache.flink.api.java.operators.SingleInputOperator<IN,OUT,O>

org.apache.flink.api.java.operators.SingleInputUdfOperator<IN,OUT,MapPartitionOperator<IN,OUT>>

org.apache.flink.api.java.operators.MapPartitionOperator<IN,OUT>

Type Parameters:

IN - The type of the data set consumed by the operator.

OUT - The type of the data set created by the operator.

All Implemented Interfaces:

UdfOperator<MapPartitionOperator<IN,OUT>>

@Public
public class MapPartitionOperator<IN,OUT>
extends SingleInputUdfOperator<IN,OUT,MapPartitionOperator<IN,OUT>>

This operator represents the application of a "mapPartition" function on a data set, and the result data set produced by the function.

See Also:

MapPartitionFunction

Field Summary

Fields

Modifier and Type	Field and Description
protected String	defaultName
protected org.apache.flink.api.common.functions.MapPartitionFunction<IN,OUT>	function

Fields inherited from class org.apache.flink.api.java.operators.Operator

minResources, name, parallelism, preferredResources

Fields inherited from class org.apache.flink.api.java.DataSet

context

Constructor Summary

Constructors

Constructor and Description
MapPartitionOperator(DataSet<IN> input, org.apache.flink.api.common.typeinfo.TypeInformation<OUT> resultType, org.apache.flink.api.common.functions.MapPartitionFunction<IN,OUT> function, String defaultName)

Method Summary

Modifier and Type	Method and Description
protected org.apache.flink.api.common.functions.MapPartitionFunction<IN,OUT>	getFunction()
protected org.apache.flink.api.common.operators.base.MapPartitionOperatorBase<IN,OUT,org.apache.flink.api.common.functions.MapPartitionFunction<IN,OUT>>	translateToDataFlow(org.apache.flink.api.common.operators.Operator<IN> input) Translates this operation to a data flow operator of the common data flow API.

Methods inherited from class org.apache.flink.api.java.operators.SingleInputUdfOperator

extractSemanticAnnotations, getAnalyzedUdfSemanticsFlag, getBroadcastSets, getParameters, getSemanticProperties, returns, returns, returns, setAnalyzedUdfSemanticsFlag, setSemanticProperties, udfWithForwardedFieldsAnnotation, withBroadcastSet, withForwardedFields, withParameters

Methods inherited from class org.apache.flink.api.java.operators.SingleInputOperator

getInput, getInputType

Methods inherited from class org.apache.flink.api.java.operators.Operator

getMinResources, getName, getParallelism, getPreferredResources, getResultType, name, setParallelism

Methods inherited from class org.apache.flink.api.java.DataSet

aggregate, checkSameExecutionContext, clean, coGroup, collect, combineGroup, count, cross, crossWithHuge, crossWithTiny, distinct, distinct, distinct, distinct, fillInType, filter, first, flatMap, fullOuterJoin, fullOuterJoin, getExecutionEnvironment, getType, groupBy, groupBy, groupBy, iterate, iterateDelta, join, join, joinWithHuge, joinWithTiny, leftOuterJoin, leftOuterJoin, map, mapPartition, max, maxBy, min, minBy, output, partitionByHash, partitionByHash, partitionByHash, partitionByRange, partitionByRange, partitionByRange, partitionCustom, partitionCustom, partitionCustom, print, print, printOnTaskManager, printToErr, printToErr, project, rebalance, reduce, reduceGroup, rightOuterJoin, rightOuterJoin, runOperation, sortPartition, sortPartition, sortPartition, sum, union, write, write, writeAsCsv, writeAsCsv, writeAsCsv, writeAsCsv, writeAsFormattedText, writeAsFormattedText, writeAsText, writeAsText

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

function

protected final org.apache.flink.api.common.functions.MapPartitionFunction<IN,OUT> function

defaultName

protected final String defaultName

Constructor Detail

MapPartitionOperator

public MapPartitionOperator(DataSet<IN> input,
                            org.apache.flink.api.common.typeinfo.TypeInformation<OUT> resultType,
                            org.apache.flink.api.common.functions.MapPartitionFunction<IN,OUT> function,
                            String defaultName)

Method Detail

getFunction

protected org.apache.flink.api.common.functions.MapPartitionFunction<IN,OUT> getFunction()

Specified by:

getFunction in class SingleInputUdfOperator<IN,OUT,MapPartitionOperator<IN,OUT>>

translateToDataFlow

protected org.apache.flink.api.common.operators.base.MapPartitionOperatorBase<IN,OUT,org.apache.flink.api.common.functions.MapPartitionFunction<IN,OUT>> translateToDataFlow(org.apache.flink.api.common.operators.Operator<IN> input)

Description copied from class: SingleInputOperator

Translates this operation to a data flow operator of the common data flow API.

Specified by:

translateToDataFlow in class SingleInputOperator<IN,OUT,MapPartitionOperator<IN,OUT>>

Parameters:

input - The data flow operator that produces this operation's input data.

Returns:

The translated data flow operator.