锘??xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:trackback="http://madskills.com/public/xml/rss/module/trackback/" xmlns:wfw="http://wellformedweb.org/CommentAPI/" xmlns:slash="http://purl.org/rss/1.0/modules/slash/"><channel><title>&#20122;&#27954;&#22269;&#20135;&#31934;&#21697;&#20037;&#20037;&#20037;&#20037;&#23159;&#23159;&#36719;&#20214;&#13;&#44;&#20122;&#27954;&#22269;&#20135;&#20013;&#25991;&#22312;&#32447;&#20108;&#21306;&#19977;&#21306;&#20813;&#44;&#22269;&#20135;&#20122;&#27954;&#97;&#118;&#29255;&#22312;&#32447;&#35266;&#30475;&#49;&#56;&#22899;&#20154;</title><link>http://www.tkk7.com/ArcticOcean/archive/2010/08/03/327836.html</link><dc:creator>Cool Jazz</dc:creator><author>Cool Jazz</author><pubDate>Tue, 03 Aug 2010 09:03:00 GMT</pubDate><guid>http://www.tkk7.com/ArcticOcean/archive/2010/08/03/327836.html</guid><wfw:comment>http://www.tkk7.com/ArcticOcean/comments/327836.html</wfw:comment><comments>http://www.tkk7.com/ArcticOcean/archive/2010/08/03/327836.html#Feedback</comments><slash:comments>0</slash:comments><wfw:commentRss>http://www.tkk7.com/ArcticOcean/comments/commentRss/327836.html</wfw:commentRss><trackback:ping>http://www.tkk7.com/ArcticOcean/services/trackbacks/327836.html</trackback:ping><description><![CDATA[&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 鏈枃澶ч儴鍒嗗唴瀹歸兘鏄粠瀹樼綉<a title="Hadoop" ><span style="font-size: 14pt">Hadoop</span></a><span style="font-size: 14pt">涓婅漿鏉ョ殑銆傚叾涓湁綃?/span><a title="浠嬬粛HDFS鐨刾df鏂囨。" ><span style="font-size: 14pt">浠嬬粛HDFS鐨刾df鏂囨。</span></a><span style="font-size: 14pt">錛屽Hadoop浠嬬粛鐨勬瘮杈冨叏闈€�?br />
</span><span style="font-size: 14pt">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 鍏堣涓�涓婬adoop鐨勬潵榫欏幓鑴夈�傝皥鍒癏adoop灝變笉寰椾笉鎻愬埌</span><a title="Lucene" ><span style="font-size: 14pt">Lucene</span></a><span style="font-size: 14pt">鍜?/span><a title="Nutch" ><span style="font-size: 14pt">Nutch</span></a><span style="font-size: 14pt">銆傞鍏堬紝<span style="color: rgb(0,0,255)">Lucene騫朵笉鏄竴涓簲鐢ㄧ▼搴忥紝鑰屾槸鎻愪緵浜嗕竴涓函Java鐨勯珮鎬ц兘鍏ㄦ枃绱㈠紩寮曟搸宸ュ叿鍖?/span>錛屽畠鍙互鏂逛究鐨勫祵鍏ュ埌鍚勭瀹為檯搴旂敤涓疄鐜板叏鏂囨悳绱?绱㈠紩鍔熻兘銆?span style="color: rgb(0,0,255)">Nutch鏄竴涓簲鐢ㄧ▼搴忥紝鏄竴涓互Lucene涓哄熀紜�瀹炵幇鐨勬悳绱㈠紩鎿庡簲鐢?/span>錛孡ucene 涓篘utch鎻愪緵浜嗘枃鏈悳绱㈠拰绱㈠紩鐨凙PI錛孨utch涓嶅厜鏈夋悳绱㈢殑鍔熻兘錛岃繕鏈夋暟鎹姄鍙栫殑鍔熻兘銆傚湪nutch0.8.0鐗堟湰涔嬪墠錛孒adoop榪樺睘浜?Nutch鐨勪竴閮ㄥ垎錛岃�屼粠nutch0.8.0寮�濮嬶紝灝嗗叾涓疄鐜扮殑NDFS鍜孧apReduce鍓ョ鍑烘潵鎴愮珛涓�涓柊鐨勫紑婧愰」鐩紝榪欏氨鏄疕adoop錛岃�?nutch0.8.0鐗堟湰杈冧箣浠ュ墠鐨凬utch鍦ㄦ灦鏋勪笂鏈変簡鏍規湰鎬х殑鍙樺寲錛岄偅灝辨槸瀹屽叏鏋勫緩鍦℉adoop鐨勫熀紜�涔嬩笂浜嗐�傚湪Hadoop涓疄鐜頒簡 Google鐨凣FS鍜孧apReduce綆楁硶錛屼嬌Hadoop鎴愪負浜嗕竴涓垎甯冨紡鐨勮綆楀鉤鍙般�?br />
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Hadoop騫朵笉浠呬粎鏄竴涓敤浜庡瓨鍌ㄧ殑鍒嗗竷寮忔枃浠剁郴緇燂紝鑰屾槸璁捐鐢ㄦ潵鍦ㄧ敱閫氱敤璁＄畻璁懼緇勬垚鐨勫ぇ鍨嬮泦緹や笂鎵ц鍒嗗竷寮忓簲鐢ㄧ殑妗嗘灦銆?br />
<br />
&nbsp;&nbsp;&nbsp;<span style="color: rgb(0,0,255)">Hadoop鍖呭惈涓や釜閮ㄥ垎錛?/span><br />
<br />
&nbsp;&nbsp;&nbsp;<strong>1銆丠DFS<br />
</strong><br />
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;鍗矵adoop Distributed File System (Hadoop鍒嗗竷寮忔枃浠剁郴緇?<br />
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;HDFS 鍏鋒湁楂樺閿欐�э紝騫朵笖鍙互琚儴緗插湪浣庝環鐨勭‖浠惰澶囦箣涓娿�侶DFS寰堥�傚悎閭ｄ簺鏈夊ぇ鏁版嵁闆嗙殑搴旂敤錛屽茍涓旀彁渚涗簡瀵規暟鎹鍐欑殑楂樺悶鍚愮巼銆侶DFS鏄竴涓?master/slave鐨勭粨鏋勶紝灝遍�氬父鐨勯儴緗叉潵璇達紝鍦╩aster涓婂彧榪愯涓�涓狽amenode錛岃�屽湪姣忎竴涓猻lave涓婅繍琛屼竴涓狣atanode銆?br />
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;HDFS 鏀寔浼犵粺鐨勫眰嬈℃枃浠剁粍緇囩粨鏋勶紝鍚岀幇鏈夌殑涓�浜涙枃浠剁郴緇熷湪鎿嶄綔涓婂緢綾諱技錛屾瘮濡備綘鍙互鍒涘緩鍜屽垹闄や竴涓枃浠訛紝鎶婁竴涓枃浠朵粠涓�涓洰褰曠Щ鍒板彟涓�涓洰褰曪紝閲嶅懡鍚嶇瓑絳夋搷 浣溿�侼amenode綆＄悊鐫�鏁翠釜鍒嗗竷寮忔枃浠剁郴緇燂紝瀵規枃浠剁郴緇熺殑鎿嶄綔錛堝寤虹珛銆佸垹闄ゆ枃浠跺拰鏂囦歡澶癸級閮芥槸閫氳繃Namenode鏉ユ帶鍒躲�?nbsp;<br />
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;涓嬮潰鏄疕DFS鐨勭粨鏋勶細</span><br />
<div align="center">
<div align="center"><img style="width: 748px; height: 561px" height="561" alt="" src="http://www.cnblogs.com/images/cnblogs_com/wayne1017/HDFSArch.JPG" width="748" border="0" /></div>
</div>
<br />
<span style="font-size: 14pt">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;浠庝笂闈㈢殑鍥句腑鍙互鐪?鍑猴紝Namenode錛孌atanode錛孋lient涔嬮棿鐨勯�氫俊閮芥槸寤虹珛鍦═CP/IP鐨勫熀紜�涔嬩笂鐨勩�傚綋Client瑕佹墽琛屼竴涓啓鍏ョ殑鎿嶄綔鐨勬椂鍊欙紝鍛戒護 涓嶆槸椹笂灝卞彂閫佸埌Namenode錛孋lient棣栧厛鍦ㄦ湰鏈轟笂涓存椂鏂囦歡澶逛腑緙撳瓨榪欎簺鏁版嵁錛屽綋涓存椂鏂囦歡澶逛腑鐨勬暟鎹潡杈懼埌浜嗚瀹氱殑Block鐨勫�鹼紙榛樿鏄?64M錛夋椂錛孋lient渚夸細閫氱煡Namenode錛孨amenode渚垮搷搴擟lient鐨凴PC璇鋒眰錛屽皢鏂囦歡鍚嶆彃鍏ユ枃浠剁郴緇熷眰嬈′腑騫朵笖鍦?Datanode涓壘鍒頒竴鍧楀瓨鏀捐鏁版嵁鐨刡lock錛屽悓鏃跺皢璇atanode鍙婂搴旂殑鏁版嵁鍧椾俊鎭憡璇塁lient錛孋lient渚胯繖浜涙湰鍦頒復鏃舵枃浠跺す涓?鐨勬暟鎹潡鍐欏叆鎸囧畾鐨勬暟鎹妭鐐廣�?br />
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;HDFS閲囧彇浜嗗壇鏈瓥鐣ワ紝鍏剁洰鐨勬槸涓轟簡鎻愰珮緋葷粺鐨勫彲闈犳�э紝鍙敤鎬с�侶DFS鐨勫壇鏈斁緗瓥鐣ユ槸涓変釜鍓湰錛?涓�涓斁鍦ㄦ湰鑺傜偣涓婏紝涓�涓斁鍦ㄥ悓涓�鏈烘灦涓殑鍙︿竴涓妭鐐逛笂錛岃繕鏈変竴涓壇鏈斁鍦ㄥ彟涓�涓笉鍚岀殑鏈烘灦涓殑涓�涓妭鐐逛笂銆傚綋鍓嶇増鏈殑hadoop0.12.0涓繕娌℃湁瀹?鐜幫紝浣嗘槸姝ｅ湪榪涜涓紝鐩鎬俊涓嶄箙灝卞彲浠ュ嚭鏉ヤ簡銆?br />
<br />
&nbsp;&nbsp;&nbsp;<strong>2銆丮apReduce鐨勫疄鐜?br />
</strong><br />
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</span><a title="MapReduce" ><span style="font-size: 14pt">MapReduce</span></a><span style="font-size: 14pt">鏄疓oogle 鐨勪竴欏歸噸瑕佹妧鏈紝瀹冩槸涓�涓紪紼嬫ā鍨嬶紝鐢ㄤ互榪涜澶ф暟鎹噺鐨勮綆椼�傚浜庡ぇ鏁版嵁閲忕殑璁＄畻錛岄�氬父閲囩敤鐨勫鐞嗘墜娉曞氨鏄茍琛岃綆椼�傝嚦灝戠幇闃舵鑰岃█錛屽璁稿寮�鍙戜漢鍛樻潵 璇達紝騫惰璁＄畻榪樻槸涓�涓瘮杈冮仴榪滅殑涓滆タ銆侻apReduce灝辨槸涓�縐嶇畝鍖栧茍琛岃綆楃殑緙栫▼妯″瀷錛屽畠璁╅偅浜涙病鏈夊灝戝茍琛岃綆楃粡楠岀殑寮�鍙戜漢鍛樹篃鍙互寮�鍙戝茍琛屽簲鐢ㄣ�?br />
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;MapReduce鐨勫悕瀛楁簮浜庤繖涓ā鍨嬩腑鐨勪袱欏規牳蹇冩搷浣滐細Map鍜?Reduce銆備篃璁哥啛鎮塅unctional Programming錛?/span><a title="鍑芥暟寮忕紪紼? ><span style="font-size: 14pt">鍑芥暟寮忕紪紼?/span></a><span style="font-size: 14pt">錛?鐨勪漢瑙佸埌榪欎袱涓瘝浼氬�嶆劅浜插垏銆傜畝鍗曠殑璇存潵錛孧ap鏄妸涓�緇勬暟鎹竴瀵逛竴鐨勬槧灝勪負鍙﹀鐨勪竴緇勬暟鎹紝鍏舵槧灝勭殑瑙勫垯鐢變竴涓嚱鏁版潵鎸囧畾錛屾瘮濡傚[1, 2, 3, 4]榪涜涔?鐨勬槧灝勫氨鍙樻垚浜哰2, 4, 6, 8]銆俁educe鏄涓�緇勬暟鎹繘琛屽綊綰︼紝榪欎釜褰掔害鐨勮鍒欑敱涓�涓嚱鏁版寚瀹氾紝姣斿瀵筟1, 2, 3, 4]榪涜姹傚拰鐨勫綊綰﹀緱鍒扮粨鏋滄槸10錛岃�屽瀹冭繘琛屾眰縐殑褰掔害緇撴灉鏄?4銆?br />
<br />
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;鍏充簬MapReduce鐨勫唴瀹癸紝寤鴻鐪嬬湅瀛熷博鐨勮繖綃?/span><a title="MapReduce:The free lunch is not over!" ><span style="font-size: 14pt">MapReduce:The Free Lunch Is Not Over!</span></a>&nbsp;榪欑瘒綆楁槸浠嬬粛鐨勬瘮杈冭緇嗙殑銆侻apReduce鐨勭畻娉曞唴瀹硅Google鏂囨。錛?a title="MapReduce.pdf" >MapReduce.pdf</a><br />
<br />
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 鏈夊叧鍏跺畠浠嬬粛Hadoop鐨勬枃绔犲緩璁湅涓嬶細<a  rel="permalink">鍒嗗竷寮忚綆楀紑婧愭鏋禜adoop浠嬬粛</a>&nbsp;銆傦紙what錛寃hy錛宧ow鎻愮殑涓嶉敊錛?br />
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<br />
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 瀹夎閰嶇疆鍙互鐪嬶細1銆?a  rel="permalink">Hadoop涓殑闆嗙兢閰嶇疆鍜屼嬌鐢ㄦ妧宸?/a><br />
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 2銆?a >Hadoop搴旂敤涔婬adoop瀹夎綃?/a><br />
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 3銆?a title="Hadoop瀹夎閮ㄧ講鎸囧崡" >Hadoop瀹夎閮ㄧ講鎸囧崡</a><br />
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 濡傛灉瑕佸紑鍙戠殑璇濓紝鍒濇鍙傝�冿細<a  rel="permalink">Hadoop鍩烘湰嫻佺▼涓庡簲鐢ㄥ紑鍙?/a><br />
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<br />
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 鍏朵腑鐢ㄥ埌鏁版嵁搴撶殑閮ㄥ垎錛屽湪Hadoop鐨?.19.0寮�濮嬫敮鎾戞暟鎹簱璁塊棶錛屼富瑕侀噰鐢―BInputFormat鏉ヨ闂暟鎹簱銆傛枃绔犲彲瑙侊細<a >Hadoop涓殑鏁版嵁搴撹闂?/a><br />
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 
 <img src ="http://www.tkk7.com/ArcticOcean/aggbug/327836.html" width = "1" height = "1" /><br><br><div align=right><a style="text-decoration:none;" href="http://www.tkk7.com/ArcticOcean/" target="_blank">Cool Jazz</a> 2010-08-03 17:03 <a href="http://www.tkk7.com/ArcticOcean/archive/2010/08/03/327836.html#Feedback" target="_blank" style="text-decoration:none;">鍙戣〃璇勮</a></div>]]></description></item></channel></rss>                                                 <footer>
<div class="friendship-link">
<p>感谢您访问我们的网站，您可能还对以下资源感兴趣：</p>
<a href="http://www.tkk7.com/" title="&#20122;&#27954;&#97;&#118;&#25104;&#20154;&#29255;&#22312;&#32447;&#35266;&#30475;">&#20122;&#27954;&#97;&#118;&#25104;&#20154;&#29255;&#22312;&#32447;&#35266;&#30475;</a>

<div class="friend-links">


</div>
</div>

</footer>

主站蜘蛛池模板：
<a href="http://jinmenonline.com" target="_blank">精品国产无限资源免费观看</a>|
<a href="http://pite2.com" target="_blank">国产一级黄片儿免费看</a>|
<a href="http://ekyzs.com" target="_blank">无码国产精品久久一区免费</a>|
<a href="http://langtuojidian.com" target="_blank">亚洲精品国产成人专区</a>|
<a href="http://bdgxhome.com" target="_blank">三年片免费高清版
</a>|
<a href="http://7272004.com" target="_blank">亚洲精品亚洲人成在线</a>|
<a href="http://69ct.com" target="_blank">亚洲精品午夜无码电影网</a>|
<a href="http://zgnyxx.com" target="_blank">永久免费精品影视网站</a>|
<a href="http://taoduoduo666.com" target="_blank">午夜亚洲国产成人不卡在线</a>|
<a href="http://www04ggg.com" target="_blank">国产亚洲精品2021自在线</a>|
<a href="http://taiyu18.com" target="_blank">日批日出水久久亚洲精品tv</a>|
<a href="http://xiaoduanfa.com" target="_blank">日韩毛片在线免费观看</a>|
<a href="http://adcaes.com" target="_blank">亚洲伊人久久大香线蕉综合图片</a>|
<a href="http://3688008.com" target="_blank">一级特黄录像免费播放肥</a>|
<a href="http://lzqzvip.com" target="_blank">久久精品国产精品亚洲艾草网</a>|
<a href="http://dou18.com" target="_blank">久久国产乱子伦免费精品</a>|
<a href="http://1515m.com" target="_blank">亚洲a视频在线观看</a>|
<a href="http://btintemet.com" target="_blank">女人18毛片特级一级免费视频</a>|
<a href="http://hysw100.com" target="_blank">亚洲AV永久无码天堂影院</a>|
<a href="http://www-kj5799.com" target="_blank">国产特级淫片免费看</a>|
<a href="http://gujingyuye.com" target="_blank">四虎精品免费永久免费视频</a>|
<a href="http://fuzhiwushu.com" target="_blank">中文字幕在亚洲第一在线
</a>|
<a href="http://aplus178.com" target="_blank">亚洲国产成人久久</a>|
<a href="http://c7vl.com" target="_blank">看全色黄大色大片免费久久</a>|
<a href="http://cangtuyuan.com" target="_blank">美女免费视频一区二区</a>|
<a href="http://jdwx58.com" target="_blank">57PAO成人国产永久免费视频</a>|
<a href="http://www77753.com" target="_blank">ww亚洲ww在线观看国产</a>|
<a href="http://33a55.com" target="_blank">国产免费人成在线视频</a>|
<a href="http://34jjjj.com" target="_blank">a级片免费在线观看</a>|
<a href="http://xvwenyue.com" target="_blank">亚洲综合色丁香麻豆</a>|
<a href="http://9haolc.com" target="_blank">日韩免费a级在线观看</a>|
<a href="http://c2277.com" target="_blank">国产人成网在线播放VA免费</a>|
<a href="http://fsrongxing.com" target="_blank">久久亚洲国产精品成人AV秋霞</a>|
<a href="http://junyehome.com" target="_blank">成人在线视频免费</a>|
<a href="http://nmcytsi.com" target="_blank">久久国产美女免费观看精品</a>|
<a href="http://339258.com" target="_blank">亚洲视频一区二区三区</a>|
<a href="http://625r.com" target="_blank">又粗又硬又大又爽免费视频播放</a>|
<a href="http://huakangweicai.com" target="_blank">中文在线免费观看</a>|
<a href="http://by6215.com" target="_blank">丁香婷婷亚洲六月综合色</a>|
<a href="http://ksdhao.com" target="_blank">在线观看亚洲精品福利片</a>|
<a href="http://344zx.com" target="_blank">99在线精品免费视频九九视
</a>|
<script>
(function(){
    var bp = document.createElement('script');
    var curProtocol = window.location.protocol.split(':')[0];
    if (curProtocol === 'https') {
        bp.src = 'https://zz.bdstatic.com/linksubmit/push.js';
    }
    else {
        bp.src = 'http://push.zhanzhang.baidu.com/push.js';
    }
    var s = document.getElementsByTagName("script")[0];
    s.parentNode.insertBefore(bp, s);
})();
</script>
</body>