public static class Fetcher.InputFormat extends SequenceFileInputFormat<Text,CrawlDatum>
FileInputFormat.CounterDEFAULT_LIST_STATUS_NUM_THREADS, INPUT_DIR, INPUT_DIR_RECURSIVE, LIST_STATUS_NUM_THREADS, NUM_INPUT_FILES, PATHFILTER_CLASS, SPLIT_MAXSIZE, SPLIT_MINSIZE| Constructor and Description |
|---|
InputFormat() |
| Modifier and Type | Method and Description |
|---|---|
InputSplit[] |
getSplits(JobContext job,
int nSplits)
Don't split inputs, to keep things polite.
|
createRecordReader, getFormatMinSplitSize, listStatusaddInputPath, addInputPathRecursively, addInputPaths, computeSplitSize, getBlockIndex, getInputDirRecursive, getInputPathFilter, getInputPaths, getMaxSplitSize, getMinSplitSize, getSplits, isSplitable, makeSplit, makeSplit, setInputDirRecursive, setInputPathFilter, setInputPaths, setInputPaths, setMaxInputSplitSize, setMinInputSplitSizepublic InputSplit[] getSplits(JobContext job, int nSplits) throws java.io.IOException
java.io.IOExceptionCopyright © 2018 The Apache Software Foundation