Sunday 15 April 2012

hadoop - How to deal with multiple STORES in Pig-Latin Script -


I have a dip script with input like this:

| Colonel A | Colonel b. Colonel c. Colonel d | Colonel e.

I have links in different columns like this group:

x = colonel A | Even Colonels C | Sam Colonel D |

Y = Colonel B | Sam Colonel D |

ETC

I need to store X, Y, Z in different folders and in this way I call STORE many times. Does the pig know how to load and process the data once and then store it?

Yes, how to go to pig You will have an MR job.

No comments:

Post a Comment