MapReduce TutorialMapReduce tutorial provides basic and advanced concepts of MapReduce. Our MapReduce tutorial is designed for beginners and professionals. Our MapReduce tutorial includes all topics of MapReduce such as Data Flow in MapReduce, Map Reduce API, Word Count Example, Character Count Example, etc. What is MapReduce?A MapReduce is a data processing tool which is used to process the data parallelly in a distributed form. It was developed in 2004, on the basis of paper titled as "MapReduce: Simplified Data Processing on Large Clusters," published by Google. The MapReduce is a paradigm which has two phases, the mapper phase, and the reducer phase. In the Mapper, the input is given in the form of a key-value pair. The output of the Mapper is fed to the reducer as input. The reducer runs only after the Mapper is over. The reducer too takes input in key-value format, and the output of reducer is the final output. Steps in Map Reduce
Sort and ShuffleThe sort and shuffle occur on the output of Mapper and before the reducer. When the Mapper task is complete, the results are sorted by key, partitioned if there are multiple reducers, and then written to disk. Using the input from each Mapper <k2,v2>, we collect all the values for each unique key k2. This output from the shuffle phase in the form of <k2, list(v2)> is sent as input to reducer phase. Usage of MapReduce
PrerequisiteBefore learning MapReduce, you must have the basic knowledge of Big Data. AudienceOur MapReduce tutorial is designed to help beginners and professionals. ProblemWe assure that you will not find any problem in this MapReduce tutorial. But if there is any mistake, please post the problem in contact form.
Next TopicData Flow in MapReduce
|