Javatpoint Logo
Javatpoint Logo

Apache Pig TOKENIZE Function

The Apache Pig TOKENIZE function is used to splits the existing string and generates a bag of words in a result.

Example of TOKENIZE Function

In this example, we split the string in the tokens.

Steps to execute TOKENIZE Function

  • Create a text file in your local machine and insert the list of tuples.
Apache Pig TOKENIZE Function
  • Check the tuples inserted in the text files.
Apache Pig TOKENIZE Function
  • Upload the text files on HDFS in the specific directory.
  • Open the pig MapReduce run mode.
  • Load the file that contains the data.
  • Now, execute and verify the data.
Apache Pig TOKENIZE Function
  • Let's return the tokenized form of the string.
Apache Pig TOKENIZE Function

Here, we got the desired output.





Please Share

facebook twitter google plus pinterest

Learn Latest Tutorials


Preparation


Trending Technologies


B.Tech / MCA