Hadoop

Hi,

I have a working hadoop process.

I would like to migrate it to spring framework using spring hadoop.

I have a few questions.

1. How does hadoop child procesess instatiate spring application context, Is the xml uploaded to distributed
cache?

2. configureReducerTypesIfPossible() at JobFactoryBean is not implemented, how does reducerKey and
value types determined?

3. How can I determine job properties like org.apache.hadoop.mapreduce.JobContext.setNumReduc eTasks() ,
If they are not in spring-hadoop.xsd ?

 

Thanks

4.I would like to determine parameter 'input-path' dynamically at runtime, What is the recommened
approcah?

davidginzburg 27/03/2012 - 17:25

 Outbrain gave this week a practical talk about Hadoop, by one of their US Ops Engineers. They have an Hadoop cluster for genrating user-facing reports & analytics.

 

My summary:

http://www.mindmeister.com/75831919/hadoop-talk-nathan-milford-outbrain

 

Slides:

udib 11/01/2011 - 09:51
Syndicate content