Friday, 20 May 2016

How to write a custom partitioner for a Hadoop job ?


1. Create a new class that extends Partitioner Class
2. Override method getPartition()
3. Add the custom partitioner to the job programmatically using method setPartitionerClass
    or
    Add the custom partitioner to the job as a config file

No comments:

Post a Comment

Note: only a member of this blog may post a comment.