org.apache.flink.api.java.operators

Class JoinOperator.EquiJoin<I1,I2,OUT>

java.lang.Object

org.apache.flink.api.java.DataSet<OUT>

org.apache.flink.api.java.operators.Operator<OUT,O>

org.apache.flink.api.java.operators.TwoInputOperator<IN1,IN2,OUT,O>

org.apache.flink.api.java.operators.TwoInputUdfOperator<I1,I2,OUT,JoinOperator<I1,I2,OUT>>

org.apache.flink.api.java.operators.JoinOperator<I1,I2,OUT>

org.apache.flink.api.java.operators.JoinOperator.EquiJoin<I1,I2,OUT>

Type Parameters:

I1 - The type of the first input DataSet of the Join transformation.

I2 - The type of the second input DataSet of the Join transformation.

OUT - The type of the result of the Join transformation.

All Implemented Interfaces:

UdfOperator<JoinOperator<I1,I2,OUT>>

Direct Known Subclasses:

JoinOperator.DefaultJoin, JoinOperator.ProjectJoin

Enclosing class:

JoinOperator<I1,I2,OUT>

@Public
public static class JoinOperator.EquiJoin<I1,I2,OUT>
extends JoinOperator<I1,I2,OUT>

A Join transformation that applies a JoinFunction on each pair of joining elements.

It also represents the DataSet that is the result of a Join transformation.

See Also:

RichFlatJoinFunction, DataSet

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.flink.api.java.operators.JoinOperator

JoinOperator.DefaultJoin<I1,I2>, JoinOperator.EquiJoin<I1,I2,OUT>, JoinOperator.JoinOperatorSets<I1,I2>, JoinOperator.ProjectJoin<I1,I2,OUT extends org.apache.flink.api.java.tuple.Tuple>

Field Summary

Fields inherited from class org.apache.flink.api.java.operators.JoinOperator

joinType, keys1, keys2

Fields inherited from class org.apache.flink.api.java.operators.Operator

minResources, name, parallelism, preferredResources

Fields inherited from class org.apache.flink.api.java.DataSet

context

Constructor Summary

Constructors

Constructor and Description
EquiJoin(DataSet<I1> input1, DataSet<I2> input2, org.apache.flink.api.common.operators.Keys<I1> keys1, org.apache.flink.api.common.operators.Keys<I2> keys2, org.apache.flink.api.common.functions.FlatJoinFunction<I1,I2,OUT> generatedFunction, org.apache.flink.api.common.functions.JoinFunction<I1,I2,OUT> function, org.apache.flink.api.common.typeinfo.TypeInformation<OUT> returnType, org.apache.flink.api.common.operators.base.JoinOperatorBase.JoinHint hint, String joinLocationName)
EquiJoin(DataSet<I1> input1, DataSet<I2> input2, org.apache.flink.api.common.operators.Keys<I1> keys1, org.apache.flink.api.common.operators.Keys<I2> keys2, org.apache.flink.api.common.functions.FlatJoinFunction<I1,I2,OUT> generatedFunction, org.apache.flink.api.common.functions.JoinFunction<I1,I2,OUT> function, org.apache.flink.api.common.typeinfo.TypeInformation<OUT> returnType, org.apache.flink.api.common.operators.base.JoinOperatorBase.JoinHint hint, String joinLocationName, JoinType type)
EquiJoin(DataSet<I1> input1, DataSet<I2> input2, org.apache.flink.api.common.operators.Keys<I1> keys1, org.apache.flink.api.common.operators.Keys<I2> keys2, org.apache.flink.api.common.functions.FlatJoinFunction<I1,I2,OUT> function, org.apache.flink.api.common.typeinfo.TypeInformation<OUT> returnType, org.apache.flink.api.common.operators.base.JoinOperatorBase.JoinHint hint, String joinLocationName)
EquiJoin(DataSet<I1> input1, DataSet<I2> input2, org.apache.flink.api.common.operators.Keys<I1> keys1, org.apache.flink.api.common.operators.Keys<I2> keys2, org.apache.flink.api.common.functions.FlatJoinFunction<I1,I2,OUT> function, org.apache.flink.api.common.typeinfo.TypeInformation<OUT> returnType, org.apache.flink.api.common.operators.base.JoinOperatorBase.JoinHint hint, String joinLocationName, JoinType type)

Method Summary

Modifier and Type	Method and Description
protected org.apache.flink.api.common.operators.DualInputSemanticProperties	extractSemanticAnnotationsFromUdf(Class<?> udfClass)
protected org.apache.flink.api.common.functions.FlatJoinFunction<I1,I2,OUT>	getFunction()
org.apache.flink.api.common.operators.DualInputSemanticProperties	getSemanticProperties() Gets the semantic properties that have been set for the user-defined functions (UDF).
protected org.apache.flink.api.common.operators.base.JoinOperatorBase<?,?,OUT,?>	translateToDataFlow(org.apache.flink.api.common.operators.Operator<I1> input1, org.apache.flink.api.common.operators.Operator<I2> input2) Translates this java API operator into a common API operator with two inputs.
protected boolean	udfWithForwardedFieldsFirstAnnotation(Class<?> udfClass)
protected boolean	udfWithForwardedFieldsSecondAnnotation(Class<?> udfClass)

Methods inherited from class org.apache.flink.api.java.operators.JoinOperator

getJoinHint, getJoinType, getKeys1, getKeys2, getPartitioner, withPartitioner

Methods inherited from class org.apache.flink.api.java.operators.TwoInputUdfOperator

getAnalyzedUdfSemanticsFlag, getBroadcastSets, getParameters, returns, returns, returns, setAnalyzedUdfSemanticsFlag, setSemanticProperties, withBroadcastSet, withForwardedFieldsFirst, withForwardedFieldsSecond, withParameters

Methods inherited from class org.apache.flink.api.java.operators.TwoInputOperator

getInput1, getInput1Type, getInput2, getInput2Type

Methods inherited from class org.apache.flink.api.java.operators.Operator

getMinResources, getName, getParallelism, getPreferredResources, getResultType, name, setParallelism

Methods inherited from class org.apache.flink.api.java.DataSet

aggregate, checkSameExecutionContext, clean, coGroup, collect, combineGroup, count, cross, crossWithHuge, crossWithTiny, distinct, distinct, distinct, distinct, fillInType, filter, first, flatMap, fullOuterJoin, fullOuterJoin, getExecutionEnvironment, getType, groupBy, groupBy, groupBy, iterate, iterateDelta, join, join, joinWithHuge, joinWithTiny, leftOuterJoin, leftOuterJoin, map, mapPartition, max, maxBy, min, minBy, output, partitionByHash, partitionByHash, partitionByHash, partitionByRange, partitionByRange, partitionByRange, partitionCustom, partitionCustom, partitionCustom, print, print, printOnTaskManager, printToErr, printToErr, project, rebalance, reduce, reduceGroup, rightOuterJoin, rightOuterJoin, runOperation, sortPartition, sortPartition, sortPartition, sum, union, write, write, writeAsCsv, writeAsCsv, writeAsCsv, writeAsCsv, writeAsFormattedText, writeAsFormattedText, writeAsText, writeAsText

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

EquiJoin

public EquiJoin(DataSet<I1> input1,
                DataSet<I2> input2,
                org.apache.flink.api.common.operators.Keys<I1> keys1,
                org.apache.flink.api.common.operators.Keys<I2> keys2,
                org.apache.flink.api.common.functions.FlatJoinFunction<I1,I2,OUT> function,
                org.apache.flink.api.common.typeinfo.TypeInformation<OUT> returnType,
                org.apache.flink.api.common.operators.base.JoinOperatorBase.JoinHint hint,
                String joinLocationName)

EquiJoin

public EquiJoin(DataSet<I1> input1,
                DataSet<I2> input2,
                org.apache.flink.api.common.operators.Keys<I1> keys1,
                org.apache.flink.api.common.operators.Keys<I2> keys2,
                org.apache.flink.api.common.functions.FlatJoinFunction<I1,I2,OUT> generatedFunction,
                org.apache.flink.api.common.functions.JoinFunction<I1,I2,OUT> function,
                org.apache.flink.api.common.typeinfo.TypeInformation<OUT> returnType,
                org.apache.flink.api.common.operators.base.JoinOperatorBase.JoinHint hint,
                String joinLocationName)

EquiJoin

public EquiJoin(DataSet<I1> input1,
                DataSet<I2> input2,
                org.apache.flink.api.common.operators.Keys<I1> keys1,
                org.apache.flink.api.common.operators.Keys<I2> keys2,
                org.apache.flink.api.common.functions.FlatJoinFunction<I1,I2,OUT> function,
                org.apache.flink.api.common.typeinfo.TypeInformation<OUT> returnType,
                org.apache.flink.api.common.operators.base.JoinOperatorBase.JoinHint hint,
                String joinLocationName,
                JoinType type)

EquiJoin

public EquiJoin(DataSet<I1> input1,
                DataSet<I2> input2,
                org.apache.flink.api.common.operators.Keys<I1> keys1,
                org.apache.flink.api.common.operators.Keys<I2> keys2,
                org.apache.flink.api.common.functions.FlatJoinFunction<I1,I2,OUT> generatedFunction,
                org.apache.flink.api.common.functions.JoinFunction<I1,I2,OUT> function,
                org.apache.flink.api.common.typeinfo.TypeInformation<OUT> returnType,
                org.apache.flink.api.common.operators.base.JoinOperatorBase.JoinHint hint,
                String joinLocationName,
                JoinType type)

Method Detail

getFunction

protected org.apache.flink.api.common.functions.FlatJoinFunction<I1,I2,OUT> getFunction()

Specified by:

getFunction in class TwoInputUdfOperator<I1,I2,OUT,JoinOperator<I1,I2,OUT>>

getSemanticProperties

@Internal
public org.apache.flink.api.common.operators.DualInputSemanticProperties getSemanticProperties()

Description copied from interface: UdfOperator

Gets the semantic properties that have been set for the user-defined functions (UDF).

Specified by:

getSemanticProperties in interface UdfOperator<JoinOperator<I1,I2,OUT>>

Overrides:

getSemanticProperties in class TwoInputUdfOperator<I1,I2,OUT,JoinOperator<I1,I2,OUT>>

Returns:

The semantic properties of the UDF.

extractSemanticAnnotationsFromUdf

protected org.apache.flink.api.common.operators.DualInputSemanticProperties extractSemanticAnnotationsFromUdf(Class<?> udfClass)

Overrides:

extractSemanticAnnotationsFromUdf in class TwoInputUdfOperator<I1,I2,OUT,JoinOperator<I1,I2,OUT>>

udfWithForwardedFieldsFirstAnnotation

protected boolean udfWithForwardedFieldsFirstAnnotation(Class<?> udfClass)

Overrides:

udfWithForwardedFieldsFirstAnnotation in class TwoInputUdfOperator<I1,I2,OUT,JoinOperator<I1,I2,OUT>>

udfWithForwardedFieldsSecondAnnotation

protected boolean udfWithForwardedFieldsSecondAnnotation(Class<?> udfClass)

Overrides:

udfWithForwardedFieldsSecondAnnotation in class TwoInputUdfOperator<I1,I2,OUT,JoinOperator<I1,I2,OUT>>

translateToDataFlow

protected org.apache.flink.api.common.operators.base.JoinOperatorBase<?,?,OUT,?> translateToDataFlow(org.apache.flink.api.common.operators.Operator<I1> input1,
                                                                                                     org.apache.flink.api.common.operators.Operator<I2> input2)

Description copied from class: TwoInputOperator

Translates this java API operator into a common API operator with two inputs.

Specified by:

translateToDataFlow in class TwoInputOperator<I1,I2,OUT,JoinOperator<I1,I2,OUT>>

Parameters:

input1 - The first input of the operation, as a common API operator.

input2 - The second input of the operation, as a common API operator.

Returns:

The created common API operator.