@InterfaceAudience.Public @InterfaceStability.Evolving public interface PigReducerEstimator
InputSizeReducerEstimator| Modifier and Type | Field and Description |
|---|---|
static String |
BYTES_PER_REDUCER_PARAM |
static long |
DEFAULT_BYTES_PER_REDUCER |
static int |
DEFAULT_MAX_REDUCER_COUNT_PARAM |
static String |
MAX_REDUCER_COUNT_PARAM |
| Modifier and Type | Method and Description |
|---|---|
int |
estimateNumberOfReducers(org.apache.hadoop.mapreduce.Job job,
MapReduceOper mapReduceOper)
Estimate the number of reducers for a given job based on the collection
of load funcs passed.
|
static final String BYTES_PER_REDUCER_PARAM
static final String MAX_REDUCER_COUNT_PARAM
static final long DEFAULT_BYTES_PER_REDUCER
static final int DEFAULT_MAX_REDUCER_COUNT_PARAM
int estimateNumberOfReducers(org.apache.hadoop.mapreduce.Job job,
MapReduceOper mapReduceOper)
throws IOException
job - job instancemapReduceOper - map reducer operator of the jobIOExceptionCopyright © 2007-2017 The Apache Software Foundation