-
大小: 92.28MB文件類(lèi)型: .zip金幣: 1下載: 0 次發(fā)布日期: 2023-06-25
- 語(yǔ)言: 其他
- 標(biāo)簽: Hadoop??大數(shù)據(jù)??配套資源??習(xí)題答案??
資源簡(jiǎn)介
本資源是《Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)》的全套配套資源(含源數(shù)據(jù)、代碼、實(shí)訓(xùn)數(shù)據(jù)、習(xí)題答案),適合Hadoop開(kāi)發(fā)者和大數(shù)據(jù)學(xué)習(xí)者學(xué)習(xí)大數(shù)據(jù)技術(shù),本資源可以方便大家學(xué)習(xí)和參考。
代碼片段和文件信息
package?test;
import?java.io.IOException;
import?org.apache.hadoop.conf.Configuration;
import?org.apache.hadoop.fs.Path;
import?org.apache.hadoop.io.IntWritable;
import?org.apache.hadoop.io.Text;
import?org.apache.hadoop.mapreduce.Job;
import?org.apache.hadoop.mapreduce.Mapper;
import?org.apache.hadoop.mapreduce.Reducer;
import?org.apache.hadoop.mapreduce.lib.input.FileInputFormat;
import?org.apache.hadoop.mapreduce.lib.output.FileOutputFormat;
import?org.apache.hadoop.util.GenericOptionsParser;
public?class?accessTimesSort?{
public?static?class?MyMapper?
extends?Mapperject?TextIntWritableText>{
public?void?map(object?key?Text?value?Context?context
?????????????)?throws?IOException?InterruptedException?{
?String?lines?=?value.toString();??
?String?array[]?=?lines.split(“\t“);?????????//指定tab為分隔符,組成數(shù)組
?int?keyOutput?=?Integer.parseInt(array[1]);?//提取訪(fǎng)問(wèn)次數(shù)做為Key
?String?valueOutput?=?array[0];??????????????//提取訪(fǎng)問(wèn)日期做為Values
?context.write(new?IntWritable(keyOutput)?new?Text(valueOutput));?
?}
}
public?static?class?MyReducer?
extends?Reducer?{
public?void?reduce(IntWritable?key?Iterable?values?
????????????????Context?context
????????????????)?throws?IOException?InterruptedException?{
????for(Text?value?:?values){
????????context.write(value?key);
????}
??}
}
public?static?void?main(String[]?args)?throws?Exception{
????Configuration?conf?=?new?Configuration();
????String[]?otherArgs?=?new?GenericOptionsParser(conf?args).getRemainingArgs();
????if?(otherArgs.length?2)?{
??????System.err.println(“Usage:?wordcount??[...]?“);
??????System.exit(2);
????}
????Job?job?=?new?Job(conf?“Access?Time?Sort“);
????job.setJarByClass(accessTimesSort.class);
????job.setMapperClass(MyMapper.class);
????job.setReducerClass(MyReducer.class);
????job.setMapOutputKeyClass(IntWritable.class);
????job.setMapOutputValueClass(Text.class);
????
????job.setOutputKeyClass(Text.class);
????job.setOutputValueClass(IntWritable.class);
????
????for?(int?i?=?0;?i? ??????FileInputFormat.addInputPath(job?new?Path(otherArgs[i]));
????}
????FileOutputFormat.setOutputPath(job
??????new?Path(otherArgs[otherArgs.length?-?1]));
????System.exit(job.waitForCompletion(true)???0?:?1);
}
}
?屬性????????????大小?????日期????時(shí)間???名稱(chēng)
-----------?---------??----------?-----??----
?????目錄???????????0??2019-04-10?00:19??《Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)》源數(shù)據(jù)和代碼\
?????目錄???????????0??2019-04-10?00:20??《Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)》源數(shù)據(jù)和代碼\Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)\
?????目錄???????????0??2019-04-10?00:19??《Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)》源數(shù)據(jù)和代碼\Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)\第2章\
?????目錄???????????0??2019-04-10?00:19??《Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)》源數(shù)據(jù)和代碼\Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)\第2章\02-習(xí)題答案\
?????文件???????47572??2018-07-29?17:49??《Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)》源數(shù)據(jù)和代碼\Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)\第2章\02-習(xí)題答案\第二章習(xí)題答案.docx
?????目錄???????????0??2019-04-10?00:20??《Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)》源數(shù)據(jù)和代碼\Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)\第3章\
?????目錄???????????0??2019-04-10?00:19??《Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)》源數(shù)據(jù)和代碼\Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)\第3章\01-任務(wù)程序\
?????目錄???????????0??2019-04-10?00:19??《Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)》源數(shù)據(jù)和代碼\Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)\第3章\01-任務(wù)程序\data\
?????文件???226379675??2018-07-29?18:06??《Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)》源數(shù)據(jù)和代碼\Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)\第3章\01-任務(wù)程序\data\email_log.txt
?????目錄???????????0??2019-04-10?00:20??《Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)》源數(shù)據(jù)和代碼\Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)\第3章\02-習(xí)題答案\
?????目錄???????????0??2019-04-10?00:20??《Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)》源數(shù)據(jù)和代碼\Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)\第3章\02-習(xí)題答案\data\
?????文件??????????46??2018-07-29?17:49??《Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)》源數(shù)據(jù)和代碼\Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)\第3章\02-習(xí)題答案\data\helloword.txt
?????文件??????180032??2018-07-29?17:49??《Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)》源數(shù)據(jù)和代碼\Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)\第3章\02-習(xí)題答案\第三章習(xí)題答案.docx
?????目錄???????????0??2019-04-10?00:20??《Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)》源數(shù)據(jù)和代碼\Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)\第4章\
?????目錄???????????0??2019-04-10?00:20??《Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)》源數(shù)據(jù)和代碼\Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)\第4章\01-任務(wù)程序\
?????目錄???????????0??2019-04-10?00:20??《Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)》源數(shù)據(jù)和代碼\Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)\第4章\01-任務(wù)程序\code\
?????目錄???????????0??2019-04-10?00:20??《Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)》源數(shù)據(jù)和代碼\Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)\第4章\01-任務(wù)程序\code\按日期統(tǒng)計(jì)及按日期排序(任務(wù)4.3與4.4)\
?????目錄???????????0??2019-04-10?00:20??《Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)》源數(shù)據(jù)和代碼\Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)\第4章\01-任務(wù)程序\code\按日期統(tǒng)計(jì)及按日期排序(任務(wù)4.3與4.4)\MemberCount\
?????文件???????18967??2018-07-29?17:49??《Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)》源數(shù)據(jù)和代碼\Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)\第4章\01-任務(wù)程序\code\按日期統(tǒng)計(jì)及按日期排序(任務(wù)4.3與4.4)\MemberCount\.classpath
?????文件?????????440??2018-07-29?17:49??《Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)》源數(shù)據(jù)和代碼\Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)\第4章\01-任務(wù)程序\code\按日期統(tǒng)計(jì)及按日期排序(任務(wù)4.3與4.4)\MemberCount\.project
?????目錄???????????0??2019-04-10?00:20??《Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)》源數(shù)據(jù)和代碼\Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)\第4章\01-任務(wù)程序\code\按日期統(tǒng)計(jì)及按日期排序(任務(wù)4.3與4.4)\MemberCount\.settings\
?????文件?????????670??2018-07-29?17:49??《Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)》源數(shù)據(jù)和代碼\Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)\第4章\01-任務(wù)程序\code\按日期統(tǒng)計(jì)及按日期排序(任務(wù)4.3與4.4)\MemberCount\.settings\org.eclipse.jdt.core.prefs
?????目錄???????????0??2019-04-10?00:20??《Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)》源數(shù)據(jù)和代碼\Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)\第4章\01-任務(wù)程序\code\按日期統(tǒng)計(jì)及按日期排序(任務(wù)4.3與4.4)\MemberCount\bin\
?????目錄???????????0??2019-04-10?00:20??《Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)》源數(shù)據(jù)和代碼\Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)\第4章\01-任務(wù)程序\code\按日期統(tǒng)計(jì)及按日期排序(任務(wù)4.3與4.4)\MemberCount\bin\test\
?????文件????????2197??2018-07-29?17:49??《Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)》源數(shù)據(jù)和代碼\Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)\第4章\01-任務(wù)程序\code\按日期統(tǒng)計(jì)及按日期排序(任務(wù)4.3與4.4)\MemberCount\bin\test\accessTimesSort$MyMapper.class
?????文件????????2213??2018-07-29?17:49??《Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)》源數(shù)據(jù)和代碼\Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)\第4章\01-任務(wù)程序\code\按日期統(tǒng)計(jì)及按日期排序(任務(wù)4.3與4.4)\MemberCount\bin\test\accessTimesSort$MyReducer.class
?????文件????????2185??2018-07-29?17:49??《Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)》源數(shù)據(jù)和代碼\Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)\第4章\01-任務(wù)程序\code\按日期統(tǒng)計(jì)及按日期排序(任務(wù)4.3與4.4)\MemberCount\bin\test\accessTimesSort.class
?????文件????????2215??2018-07-29?17:49??《Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)》源數(shù)據(jù)和代碼\Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)\第4章\01-任務(wù)程序\code\按日期統(tǒng)計(jì)及按日期排序(任務(wù)4.3與4.4)\MemberCount\bin\test\dailyAccessCount$MyMapper.class
?????文件????????2368??2018-07-29?17:49??《Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)》源數(shù)據(jù)和代碼\Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)\第4章\01-任務(wù)程序\code\按日期統(tǒng)計(jì)及按日期排序(任務(wù)4.3與4.4)\MemberCount\bin\test\dailyAccessCount$MyReducer.class
?????文件????????2192??2018-07-29?17:49??《Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)》源數(shù)據(jù)和代碼\Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)\第4章\01-任務(wù)程序\code\按日期統(tǒng)計(jì)及按日期排序(任務(wù)4.3與4.4)\MemberCount\bin\test\dailyAccessCount.class
?????文件????????2025??2018-07-29?17:49??《Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)》源數(shù)據(jù)和代碼\Hadoop大數(shù)據(jù)開(kāi)發(fā)基礎(chǔ)\第4章\01-任務(wù)程序\code\按日期統(tǒng)計(jì)及按日期排序(任務(wù)4.3與4.4)\MemberCount\bin\test\dataDistinct$MyMapper.class
............此處省略199個(gè)文件信息
- 上一篇:AE火焰特效
- 下一篇:大華智慧寫(xiě)字樓
評(píng)論
共有 條評(píng)論