Package org.apache.flink.streaming.examples.sideoutput

Class SideOutputExample.Tokenizer

java.lang.Object
org.apache.flink.api.common.functions.AbstractRichFunction
org.apache.flink.streaming.api.functions.ProcessFunction<String,org.apache.flink.api.java.tuple.Tuple2<String,Integer>>
org.apache.flink.streaming.examples.sideoutput.SideOutputExample.Tokenizer
All Implemented Interfaces:
Serializable, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.RichFunction
Enclosing class:
SideOutputExample
public static final class SideOutputExample.Tokenizer extends org.apache.flink.streaming.api.functions.ProcessFunction<String,org.apache.flink.api.java.tuple.Tuple2<String,Integer>>
Implements the string tokenizer that splits sentences into words as a user-defined FlatMapFunction. The function takes a line (String) and splits it into multiple pairs in the form of "(word,1)" (Tuple2<String, Integer>).

This rejects words that are longer than 5 characters long.

See Also:

  • Nested Class Summary

    Nested classes/interfaces inherited from class org.apache.flink.streaming.api.functions.ProcessFunction

    org.apache.flink.streaming.api.functions.ProcessFunction.Context, org.apache.flink.streaming.api.functions.ProcessFunction.OnTimerContext

  • Constructor Summary

    Constructors
    Constructor
    Description
    Tokenizer()
     

  • Method Summary

    Modifier and Type
    Method
    Description
    void
    processElement(String value, org.apache.flink.streaming.api.functions.ProcessFunction<String,org.apache.flink.api.java.tuple.Tuple2<String,Integer>>.org.apache.flink.streaming.api.functions.ProcessFunction.Context ctx, org.apache.flink.util.Collector<org.apache.flink.api.java.tuple.Tuple2<String,Integer>> out)
     

    Methods inherited from class org.apache.flink.streaming.api.functions.ProcessFunction

    onTimer

    Methods inherited from class org.apache.flink.api.common.functions.AbstractRichFunction

    close, getIterationRuntimeContext, getRuntimeContext, open, setRuntimeContext

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

  • Constructor Details

    • Tokenizer

      public Tokenizer()

  • Method Details

    • processElement

      public void processElement(String value, org.apache.flink.streaming.api.functions.ProcessFunction<String,org.apache.flink.api.java.tuple.Tuple2<String,Integer>>.org.apache.flink.streaming.api.functions.ProcessFunction.Context ctx, org.apache.flink.util.Collector<org.apache.flink.api.java.tuple.Tuple2<String,Integer>> out) throws Exception
      Specified by:
      processElement in class org.apache.flink.streaming.api.functions.ProcessFunction<String,org.apache.flink.api.java.tuple.Tuple2<String,Integer>>
      Throws:
      Exception