資源簡介
這是一個在hadoop集群環境下的文檔倒排程序。數據源是莎士比亞文集(運行是需要設置)

代碼片段和文件信息
package?example;
import?java.io.IOException;
import?java.util.Iterator;
import?org.apache.hadoop.io.IntWritable;
import?org.apache.hadoop.mapreduce.Reducer;
public?class?InvertedIndexCombiner?extends?Reducer?
{ @Override
protected?void?reduce(Posting?key?Iterable?values?Context?context)
throws?IOException?InterruptedException?
? { Iterator?it?=?values.iterator();
?
? int?sum=0;
?
? while(it.hasNext()){
? sum++;
? it.next();
? }
?
? context.write(keynew?IntWritable(sum));
}
}
?屬性????????????大小?????日期????時間???名稱
-----------?---------??----------?-----??----
?????目錄???????????0??2011-04-26?09:49??InvertedIndex\
?????文件????????4462??2011-04-26?09:39??InvertedIndex\.classpath
?????文件?????????389??2011-04-26?09:38??InvertedIndex\.project
?????目錄???????????0??2011-05-16?20:02??InvertedIndex\bin\
?????文件???????????0??2011-04-26?09:49??InvertedIndex\SecurityAuth.audit
?????目錄???????????0??2011-04-26?09:39??InvertedIndex\src\
?????目錄???????????0??2011-04-26?10:57??InvertedIndex\src\example\
?????文件?????????608??2011-05-16?14:30??InvertedIndex\src\example\InvertedIndexCombiner.java
?????文件????????1527??2011-04-26?10:59??InvertedIndex\src\example\InvertedIndexer.java
?????文件????????1042??2011-05-16?14:22??InvertedIndex\src\example\InvertedIndexMapper.java
?????文件????????2575??2011-04-26?14:55??InvertedIndex\src\example\InvertedIndexReducer.java
?????文件?????????405??2011-04-26?10:58??InvertedIndex\src\example\NewPartitioner.java
?????文件????????3034??2011-04-26?10:45??InvertedIndex\src\example\Posting.java
- 上一篇:支持向量回歸實現
- 下一篇:數電交通燈課程設計附Multisim仿真電路
評論
共有 條評論