How to write a custom partitioner for a Hadoop job ?
1. Create a new class that extends Partitioner Class 2. Override method getPartition() 3. Add the custom partitioner to the job programmatically using method setPartitionerClass or Add the custom partitioner to the job as a config file
No comments:
Post a Comment
Note: only a member of this blog may post a comment.
No comments:
Post a Comment
Note: only a member of this blog may post a comment.