锘??xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:trackback="http://madskills.com/public/xml/rss/module/trackback/" xmlns:wfw="http://wellformedweb.org/CommentAPI/" xmlns:slash="http://purl.org/rss/1.0/modules/slash/"><channel><title>&#x56FD;&#x5185;&#x81EA;&#x62CD;&#x89C6;&#x9891;&#x4E00;&#x533A;&#x4E8C;&#x533A;&#x4E09;&#x533A;&#x2C;&#x8272;&#x7F51;&#x7AD9;&#x56FD;&#x4EA7;&#x7CBE;&#x54C1;&#x2C;&#x65E5;&#x672C;&#x514D;&#x8D39;&#x7CBE;&#x54C1;</title><link>http://www.aygfsteel.com/jjshcc/category/53705.html</link><description>妗戝反钁¤緲昏瘧宸ヤ綔瀹ゆ槸騫垮窞甯傛渶涓撲笟钁¤悇鐗欒緲昏瘧鏈烘瀯-www.puyufanyi.com</description><language>zh-cn</language><lastBuildDate>Mon, 01 Jul 2013 14:33:02 GMT</lastBuildDate><pubDate>Mon, 01 Jul 2013 14:33:02 GMT</pubDate><ttl>60</ttl><item><title>Hadoop浣撶郴浠嬬粛</title><link>http://www.aygfsteel.com/jjshcc/archive/2013/07/01/401121.html</link><dc:creator>Eric_jiang</dc:creator><author>Eric_jiang</author><pubDate>Mon, 01 Jul 2013 14:02:00 GMT</pubDate><guid>http://www.aygfsteel.com/jjshcc/archive/2013/07/01/401121.html</guid><wfw:comment>http://www.aygfsteel.com/jjshcc/comments/401121.html</wfw:comment><comments>http://www.aygfsteel.com/jjshcc/archive/2013/07/01/401121.html#Feedback</comments><slash:comments>0</slash:comments><wfw:commentRss>http://www.aygfsteel.com/jjshcc/comments/commentRss/401121.html</wfw:commentRss><trackback:ping>http://www.aygfsteel.com/jjshcc/services/trackbacks/401121.html</trackback:ping><description><![CDATA[
 
HDFS鍜孧apReduce鍙槸鎵撻�燞adoop騫沖彴鏈�鍩烘湰鐨勬牳蹇冨浠訛紝鍦ˋpache鍩洪噾浼氱殑緗戠珯涓繕鏈夊叾浠栫殑鐩稿叧寮�婧愬浠訛紝鍏卞悓緇勬垚浜嗕竴涓狧adoop浣撶郴錛圚adoop Ecosystem錛夈�?p>銆�銆�閫氳繃榪欎簺鐩稿叧欏圭洰鐨勫歡浼革紝寮�鍙戜漢鍛樺氨綆椾笉鎳侸ava,涔熷彲浠ョ敤鐗瑰畾Script璇█鏉ュ啓Hadoop涓婄殑MapReduce紼嬪簭錛岀敋鑷沖彲浠ョ敤SQL璇硶鏉ユ煡璇DFS涓婄殑鏁版嵁銆傝繖浜涘懆杈歸」鐩彲璇存槸澶у箙寮哄寲Hadoop鍔熻兘鐨勮蔣浠跺啗鐏簱錛屾兂瑕佸杽鐢℉adoop鐨勫紑鍙戜漢鍛樹笉鍙敊榪囥�傚叾涓噸瑕佺殑鍛ㄨ竟欏圭洰鍖呮嫭HBase銆丠ive 銆乑ooKeeper銆丳ig鍜孧ahout.</p><p>銆�銆�<strong>HBase 鑳藉綰砅B鏁版嵁閲忕殑鍒嗗竷寮忔暟鎹簱</strong>銆�銆�HBase鏄笓闂ㄧ敤浜嶩adoop鏂囦歡緋葷粺涓婄殑鏁版嵁搴撶郴緇燂紝閲囧彇Column-Oriented 鏁版嵁搴撹璁★紝涓嶅悓浜庝紶緇熺殑鍏崇郴鏁版嵁搴擄紝渚嬪娌℃湁鏁版嵁琛ㄣ�丼chema鏁版嵁鏋舵瀯絳夊姛鑳斤紝鑰屾槸閲囩敤Key-Value褰㈠紡鐨勬暟鎹灦鏋勶紝姣忕瑪鏁版嵁閮芥湁涓�涓狵ey鍊煎搴斿埌涓�涓猇alue鍊鹼紝鍐嶉�氳繃澶氱淮搴︾殑瀵瑰簲鍏崇郴鏉ュ緩绔嬬被浼艱〃鏍兼晥鏋滅殑鏁版嵁鏋舵瀯銆傚姝ゅ氨鑳介噰鍙栧垎甯冨紡鍌ㄥ瓨鏂瑰紡錛屽彲浠ユ墿灞曞埌鏁板崈鍙版湇鍔″櫒錛屽簲瀵筆B綰х殑鏁版嵁澶勭悊銆?/p><p>銆�銆�<strong>Hive 鍙敤SQL璇硶瀛樺彇Hadoop鏁版嵁</strong>銆�銆�Hive鏄儴緗插湪HDFS涓婄殑涓�濂楀垎甯冨紡鏁版嵁瀛樺偍緋葷粺錛屽彲璁╃敤鎴蜂互鎯敤鐨凷QL璇硶錛屾潵瀛樺彇Hadoop鏂囦歡涓殑澶у瀷鏁版嵁闆嗭紝渚嬪鍙互浣跨敤Join銆丟roup by銆丱rder by絳夛紝鑰岃繖涓娉曠О涓篐ive QL.涓嶈繃錛孒ive QL鍜孲QL騫墮潪瀹屽叏鐩稿悓錛屼緥濡侶ive灝變笉鏀寔Store Procedure銆乀rigger絳夊姛鑳姐�?nbsp;&nbsp; Hive浼氬皢鐢ㄦ埛杈撳叆鐨凥ive QL鎸囦護緙栬瘧鎴怞ava紼嬪簭錛屽啀鏉ュ瓨鍙朒DFS鏂囦歡緋葷粺涓婄殑鏁版嵁錛屾墍浠ワ紝鎵ц鏁堢巼渚濇寚浠ゅ鏉傚害鍜屽鐞嗙殑鏁版嵁閲忚�屽紓錛屽彲鑳芥湁鏁扮閽燂紝鐢氳嚦鏄暟鍒嗛挓鐨勫歡榪熴�傚拰HBase鐩告瘮錛孒ive瀹規槗浣跨敤涓斿脊鎬ч珮錛屼絾鎵ц閫熷害杈冩參銆備笉灝戞暟鎹簱緋葷粺錛岄兘鏄�氳繃鍏堣繛緇撳埌Hive,鎵嶈兘涓嶩adoop鏁村悎銆備緥濡傚井杞氨鏄�氳繃Hive ODBC椹卞姩紼嬪簭錛屽皢SQL鎸囦護杞崲鎴怘ive QL,璁〦xcel鍙互瀛樺彇Hadoop涓婄殑鏁版嵁銆?/p><p>銆�銆�鍦ㄥ悓涓�涓狧adoop闆嗙兢涓紝Hive鍙互瀛樺彇HBase涓婄殑鏁版嵁錛屽皢HBase涓婄殑鏁版嵁瀵瑰簲鎴怘ive鍐呯殑涓�涓〃鏍箋�?/p><p>銆�銆�<strong>Pig 涓嶆噦Java寮�鍙戜篃鑳藉啓MapReduce</strong>銆�銆�Pig鎻愪緵浜嗕竴涓猄cript璇█Pig Latin,璇硶綆�鍗曪紝綾諱技鍙鎬ч珮鐨勯珮絳塀asic璇█錛屽彲鐢ㄦ潵鍐橫apReduce紼嬪簭銆侾ig浼氳嚜鍔ㄥ皢榪欎簺鑴氭湰紼嬪簭杞崲錛屾垚涓鴻兘鍦℉adoop涓墽琛岀殑MapReduce Java紼嬪簭銆?/p><p>銆�銆�鍥犳錛屼嬌鐢ㄨ�呭嵆浣夸笉鎳侸ava涔熻兘鍐欏嚭MapReduce.涓嶈繃錛屼竴鑸潵璇達紝閫氳繃Pig鑴氭湰紼嬪簭杞崲錛屼細姣旂洿鎺ョ敤Java鍐橫apReduce鐨勬晥鑳介檷浣庝簡25%.</p><p>銆�銆�<strong>ZooKeeper 璁〩adoop鍐呴儴鏈嶅姟鍣ㄨ兘鍗忓悓榪愪綔</strong>銆�銆�Zookeeper鏄洃鎺у拰鍗忚皟Hadoop鍒嗗竷寮忚繍浣滅殑闆嗕腑寮忔湇鍔★紝鍙彁渚涘悇涓湇鍔″櫒鐨勯厤緗拰榪愪綔鐘舵�佷俊鎭紝鐢ㄤ簬鎻愪緵涓嶅悓Hadoop緋葷粺瑙掕壊涔嬮棿鐨勫伐浣滃崗璋冦�?/p><p>銆�銆�浠Base鏁版嵁搴撲負渚嬶紝鍏朵腑鏈変袱縐嶆湇鍔″櫒瑙掕壊錛歊egion鏈嶅姟鍣ㄨ鑹插拰Master鏈嶅姟鍣ㄨ鑹詫紝緋葷粺浼氳嚜鍔ㄩ�氳繃ZooKeeper鐩戠湅Master鏈嶅姟鍣ㄧ殑鐘舵�侊紝涓�鏃aster鐨勮繍浣滀俊鎭秷澶憋紝浠ｈ〃褰撴満鎴栫綉緇滄柇綰匡紝HBase灝變細閫夊嚭鍙︿竴鍙癛egion鏈嶅姟鍣ㄦ垚涓篗ater瑙掕壊鏉ヨ礋璐ｇ鐞嗗伐浣溿�?/p><p>銆�銆�<strong>Mahout 绔嬪嵆鍙敤鐨勫父鐢∕apReduce紼嬪簭搴?/strong>銆�銆�鍦℉adoop涓紝寮�鍙戜漢鍛樺繀欏誨皢鏁版嵁澶勭悊浣滄硶鎷嗚В鎴愬彲鍒嗘暎榪愮畻鐨凪ap鍜孯educe紼嬪簭錛屽洜涓烘�濊�冮�昏緫鍜屽父瑙佺殑紼嬪簭寮�鍙戦�昏緫涓嶅悓錛屾墍浠ュ紑鍙戦毦搴﹀緢楂樸�侻ahout鍒欐彁渚涗簡涓�涓父鐢ㄧ殑MapReduce鍑藉紡搴擄紝甯歌鐨勬暟鍊煎垎鏋愭柟娉曘�侀泦緹ゅ垎綾誨拰絳涢�夋柟寮忥紝閮藉凡緇忔湁瀵瑰簲鐨凪apReduce鍑芥暟鍙懠鍙紝寮�鍙戜漢鍛樺氨涓嶅繀鍐嶉噸澶嶅紑鍙戜竴嬈°�?/p><img src ="http://www.aygfsteel.com/jjshcc/aggbug/401121.html" width = "1" height = "1" /><br><br><div align=right><a style="text-decoration:none;" href="http://www.aygfsteel.com/jjshcc/" target="_blank">Eric_jiang</a> 2013-07-01 22:02 <a href="http://www.aygfsteel.com/jjshcc/archive/2013/07/01/401121.html#Feedback" target="_blank" style="text-decoration:none;">鍙戣〃璇勮</a></div>]]></description></item></channel></rss>           <footer>
<div class="friendship-link">
<a href="http://www.aygfsteel.com/" title="&#29408;&#29408;&#20037;&#20037;&#20122;&#27954;&#27431;&#32654;&#19987;&#21306;&#95;&#20013;&#25991;&#23383;&#24149;&#20122;&#27954;&#32508;&#21512;&#20037;&#20037;&#50;&#48;&#50;&#95;&#22269;&#20135;&#31934;&#21697;&#20122;&#27954;&#31532;&#20116;&#21306;&#22312;&#32447;&#95;&#26085;&#26412;&#20813;&#36153;&#32593;&#31449;&#35270;&#39057;">&#29408;&#29408;&#20037;&#20037;&#20122;&#27954;&#27431;&#32654;&#19987;&#21306;&#95;&#20013;&#25991;&#23383;&#24149;&#20122;&#27954;&#32508;&#21512;&#20037;&#20037;&#50;&#48;&#50;&#95;&#22269;&#20135;&#31934;&#21697;&#20122;&#27954;&#31532;&#20116;&#21306;&#22312;&#32447;&#95;&#26085;&#26412;&#20813;&#36153;&#32593;&#31449;&#35270;&#39057;</a>

</div>

</footer>


主站蜘蛛池模板：
<a href="http://" target="_blank">文成县</a>|
<a href="http://" target="_blank">镇沅</a>|
<a href="http://" target="_blank">双城市</a>|
<a href="http://" target="_blank">赣榆县</a>|
<a href="http://" target="_blank">建平县</a>|
<a href="http://" target="_blank">武安市</a>|
<a href="http://" target="_blank">麻城市</a>|
<a href="http://" target="_blank">嘉禾县</a>|
<a href="http://" target="_blank">托里县</a>|
<a href="http://" target="_blank">鲁山县</a>|
<a href="http://" target="_blank">宁蒗</a>|
<a href="http://" target="_blank">嫩江县</a>|
<a href="http://" target="_blank">武宁县</a>|
<a href="http://" target="_blank">广东省</a>|
<a href="http://" target="_blank">临清市</a>|
<a href="http://" target="_blank">天祝</a>|
<a href="http://" target="_blank">黄大仙区</a>|
<a href="http://" target="_blank">石家庄市</a>|
<a href="http://" target="_blank">二连浩特市</a>|
<a href="http://" target="_blank">常山县</a>|
<a href="http://" target="_blank">农安县</a>|
<a href="http://" target="_blank">台东市</a>|
<a href="http://" target="_blank">雅江县</a>|
<a href="http://" target="_blank">洪湖市</a>|
<a href="http://" target="_blank">黔东</a>|
<a href="http://" target="_blank">慈利县</a>|
<a href="http://" target="_blank">泊头市</a>|
<a href="http://" target="_blank">双流县</a>|
<a href="http://" target="_blank">盘山县</a>|
<a href="http://" target="_blank">德江县</a>|
<a href="http://" target="_blank">龙江县</a>|
<a href="http://" target="_blank">德庆县</a>|
<a href="http://" target="_blank">当涂县</a>|
<a href="http://" target="_blank">冷水江市</a>|
<a href="http://" target="_blank">靖宇县</a>|
<a href="http://" target="_blank">七台河市</a>|
<a href="http://" target="_blank">桂阳县</a>|
<a href="http://" target="_blank">雷波县</a>|
<a href="http://" target="_blank">师宗县</a>|
<a href="http://" target="_blank">砚山县</a>|
<a href="http://" target="_blank">长宁区</a>|
<script>
(function(){
    var bp = document.createElement('script');
    var curProtocol = window.location.protocol.split(':')[0];
    if (curProtocol === 'https') {
        bp.src = 'https://zz.bdstatic.com/linksubmit/push.js';
    }
    else {
        bp.src = 'http://push.zhanzhang.baidu.com/push.js';
    }
    var s = document.getElementsByTagName("script")[0];
    s.parentNode.insertBefore(bp, s);
})();
</script>
</body>