�??xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:trackback="http://madskills.com/public/xml/rss/module/trackback/" xmlns:wfw="http://wellformedweb.org/CommentAPI/" xmlns:slash="http://purl.org/rss/1.0/modules/slash/"><channel><title>&#22269;&#20135;&#54;&#57;&#31934;&#21697;&#20037;&#20037;&#20037;&#20037;&#57;&#57;&#57;&#57;&#20154;&#44;&#22312;&#32447;&#35266;&#30475;&#20813;&#36153;&#22269;&#20135;&#23567;&#35270;&#39057;&#44;&#21487;&#20197;&#30452;&#25509;&#22312;&#32447;&#35266;&#30475;&#30340;&#97;&#118;</title><link>http://www.aygfsteel.com/vanadies10/category/48413.html</link><description /><language>zh-cn</language><lastBuildDate>Sun, 18 Sep 2011 21:39:44 GMT</lastBuildDate><pubDate>Sun, 18 Sep 2011 21:39:44 GMT</pubDate><ttl>60</ttl><item><title>参加IT168架构师大会�ȝ��</title><link>http://www.aygfsteel.com/vanadies10/archive/2011/09/18/358925.html</link><dc:creator>见习���仙_华黎</dc:creator><author>见习���仙_华黎</author><pubDate>Sun, 18 Sep 2011 13:23:00 GMT</pubDate><guid>http://www.aygfsteel.com/vanadies10/archive/2011/09/18/358925.html</guid><wfw:comment>http://www.aygfsteel.com/vanadies10/comments/358925.html</wfw:comment><comments>http://www.aygfsteel.com/vanadies10/archive/2011/09/18/358925.html#Feedback</comments><slash:comments>0</slash:comments><wfw:commentRss>http://www.aygfsteel.com/vanadies10/comments/commentRss/358925.html</wfw:commentRss><trackback:ping>http://www.aygfsteel.com/vanadies10/services/trackbacks/358925.html</trackback:ping><description><![CDATA[&nbsp; &nbsp; &nbsp; 9�?号和10号在北京参加了IT168��d��的架构师大会�Q�也很荣�q�做了淘宝Java中间件之路的分��n�Q�分享的PPT已经在大会的官网攑և�了。这�ơ两天的会议�Q�跟新老朋友有了不���线下的交流和沟通，感觉不错。也听了好几个Session�Q�有些没有听的，也是当时跟几个朋友在场外交流所致�?br />&nbsp; &nbsp; &nbsp; 下面�ȝ��一下自己听的几个Session<br />&nbsp;<br />&nbsp; &nbsp; &nbsp; 余沛-自动化运�l�关�pȝ���?br />&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;�q�里面提��C��几个阶段�Q�跟陈硕�?a >blog</a>里面讲的不同阶段的运�l�策略，理念上比较的�c�M���?br />&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;�W�一个阶�D?几台---几十�?&nbsp;手工�q�且是模块儿的视角。也���是看到的只是单个的部��v的��品等<br />&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;�W�二个阶�D?几百�?-几千�?�q�个阶段叫做�U�向自动化，用机器的�_�度看运�l�_��不过�q�维�q�是后置服务�Q�有一些脚本、工��L���Q�不�q�可能比较多的还是在做安装、维护、救火等工作<br />&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;�W�三个阶�D?几千�?-上万�?�q�维和开发��^行，看问题是按照服务的粒度，�q�维变成前置服务<br />&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;接着又着重介�l�依赖管理的部分。包括了��d��对�Q务的依赖�Q��Q务时间上的依赖，以及数据型的依赖�{��?br />&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;应该��_����M��来说比较�pȝ��的讲�q�C���q�维成长的过�E�。我们自��q��机器��C��不少了，�q�维斚w��的��^台、工兯���不是那么的完善，希望能够在明�q�年中之前，能够有比较大的改观�?br />&nbsp;<br />&nbsp; &nbsp; &nbsp; &nbsp;李�?癑ֺ�贴吧的技术介�l?br />&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; �q�里面记录了一些关键点<br />&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 癑ֺ�贴吧有上百亿的帖子，热门的帖子有上千万的回复�Q�高峰是每秒的PV���过10万。那么在存储斚w���Q�做了不���事情。同�Ӟ��对于快速开发、可用性、安全方面考虑的也很多�?br /><br />&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 在WebSever上，用了异步和集���技术，静态文件的获取�Q�可以跑满网卡，大于单机支撑5k-1w的qps�Q�这个取决于单个文�g的大����?br /><br />&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 采用Php开发框�Ӟ���l�一开发模式，在性能斚w��也做了优化。内部实行组件式开发，有公共库以及一些通用�l��g�?br /><br />&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 在存储方面，分�ؓ了两块儿�Q�一块儿是轻量��的存储，主要采用的是Mysql以及使用了cache技术。数据量���于1T�Q�支撑几百qps-几k qps�Q�加入cache解决���览的性能问题�?br />&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 引入了分区，使用MQ来进行处�?br />&nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;<br />&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 另外�Q���用KV存储视频文�g�Q�大概在P的量�U��?br /><br />&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; �q�个session�Q�主要了解学习了baidu贴吧的一些相��x��术架构，也了解了一下数据�?br /><br />&nbsp; &nbsp; &nbsp; &nbsp; �z�涛-虎扑�|�的架构升��之�\<br />&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; �q�哥们儿看上去非常爷们儿�Q�讲话也比较逗。谈��C��虎扑�|�从成立到现在的发展之�\�Q�这个是可以�l�到一些中���网站一些参考。在�q�个�q�程中，用到了一些开源��Y�Ӟ��包括但不限于memcached、TT、Redis、RabbitMQ�{�。后面也会自建机�ѝ��这里面�Q�他提到会用����g负蝲均衡代替LVS�Q�这个地�Ҏ��不是很明白，当时也没有能抓住�z�涛问下�Q�后面有��Z��再请教下�?br /><br />&nbsp; &nbsp; &nbsp; &nbsp; 陈炜-无状态运�l�管�?br />&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; �q�个家伙跟我住一个屋的，他要讲的东东在讲之前我就看了一下，应该��_��他们真的构徏了一个相对完善的监管控的�pȝ���Q�也许没有哪个部分的技术本�w�特别高深，但是能够�q�用技术，真正把那么多的机器和应用���理��h���Q�能最�l�落圎ͼ�我觉得还是非�怸��Ҏ��的。不�q�这厮还�Ơ我一个东西没�l�我�Q�明天上班找他要�?br /><br />&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;�D늂�-Defeat Plubic DNS<br />&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; �q�里面首先讲��C��使用Google DNS以及OpenDNS的问题，然后提到了如何去解决�q�些个问题。其中对于如何知道用��h��在ISP以及使用的Local DNS�Q�采用了不同的方式来处理。也提到了通过跌��{、修改返回的HTML�{�方式来解决跨运营商讉K��的问题。在�q�个斚w���Q�自�׃��前确实没有太多经验，也没有考虑很多。不�q�说到底�Q�这都是被天朝特色的ISP�l�搞的。sigh�?br /><br />&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;白金-从流量统计、识别出发，看网�l�出口带宽优�?br />&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; �q�个演讲嘉宾的名字挺��P��他讲的东西很全面�Q�也提到一些探���网�l�流量等信息的工��P��不过�q�个部分�Q�跟我现在关注的点不太脓合，���当扩充知识面了�?br /><br />&nbsp; &nbsp; &nbsp; &nbsp; 陈尔�?新浪的私有云�q�_��<br />&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; �q�哥们儿真的很帅�Q�讲的也很好�Q�新���的SAE和内部的�U�有云还是不错的�Q?0月䆾他们会来杭州参加QConHangzhou�Q�到时候再好好聊聊�?br />&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 我记录了一些数�?br />&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; �U�有云有4000+机器<div><div>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;每日100亿动态请�?/div><div>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;每日200亿的数据库请�?/div><div>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;��d���q�行�?00个项�?nbsp;</div></div>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;马如�?Hadoop@Baidu&nbsp;<br /><div><div>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 一个非常实在憨厚的哥们儿，我也是记录了一些数�?&nbsp; &nbsp;&nbsp;<br />&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;目前Hadoop集群�?.5w node�Q?�q�底大概3-4w収ͼ� 明年会到�?0w�?/div><div>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;整个集群input data/per day &gt;10PB &nbsp;google &nbsp;1,20万机器，30PB</div><div>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;Hadoop一共分�?0个clusters</div><div>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;最大的cluster 3000 nodes</div><div>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;1.5亿文�?1.5亿块+2000个节点：重启��p��40分钟</div><div>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;baidu-hdfs2-arch 把namespace跟文件管理分开�Q�上面的相当�?一个规则服务器</div><div>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;针对不同的需求分来处理，比如throughtput 、realtime �{�；�q�求不同�Q�侧重点���p��不同</div><div></div></div>&nbsp; &nbsp; &nbsp; &nbsp; ��M��来说�Q�IT168架构师大会，和QConBeijing以及���要丑֊�的QConHangzhou�q�有Velocity China相比�Q�我感觉整体质量�E�微�׃��。当�Ӟ���q�仅仅是从我个�h的角度来��_��从内心来��_��希望IT168架构师大会越办越好，提供一个好的��^台给技术�h员交���、提高�?br /><br /><br /><br /><br />&nbsp; &nbsp; &nbsp;&nbsp;<img src ="http://www.aygfsteel.com/vanadies10/aggbug/358925.html" width = "1" height = "1" /><br><br><div align=right><a style="text-decoration:none;" href="http://www.aygfsteel.com/vanadies10/" target="_blank">见习���仙_华黎</a> 2011-09-18 21:23 <a href="http://www.aygfsteel.com/vanadies10/archive/2011/09/18/358925.html#Feedback" target="_blank" style="text-decoration:none;">发表评论</a></div>]]></description></item><item><title>北京之行�Q�收获很�?/title><link>http://www.aygfsteel.com/vanadies10/archive/2011/04/15/348343.html</link><dc:creator>见习���仙_华黎</dc:creator><author>见习���仙_华黎</author><pubDate>Fri, 15 Apr 2011 04:42:00 GMT</pubDate><guid>http://www.aygfsteel.com/vanadies10/archive/2011/04/15/348343.html</guid><wfw:comment>http://www.aygfsteel.com/vanadies10/comments/348343.html</wfw:comment><comments>http://www.aygfsteel.com/vanadies10/archive/2011/04/15/348343.html#Feedback</comments><slash:comments>0</slash:comments><wfw:commentRss>http://www.aygfsteel.com/vanadies10/comments/commentRss/348343.html</wfw:commentRss><trackback:ping>http://www.aygfsteel.com/vanadies10/services/trackbacks/348343.html</trackback:ping><description><![CDATA[<div style="color: #000000; font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 12px; margin-top: 8px; margin-right: 8px; margin-bottom: 8px; margin-left: 8px; background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: #ffffff; background-position: initial initial; background-repeat: initial initial; ">
<p style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; ">&nbsp; &nbsp; &nbsp;�q�周一到周三三天，在北京。感谢团队的伏威同学的组�l�安排，到北京的多家业内的公司进行了交流�Q�也在betacafe和北京的做了沟通。北京的交流的氛围确实很好，从交���中也感觉到淘宝在Java斚w���Q�确实做得还是比较多、比较深的。今后如果有��Z���Q�是能够跟大家再更多的交���，周二晚上的时间很有限�?/p>
<p style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; ">&nbsp; &nbsp; &nbsp;�q�次拜访了飞信、豆瓣、谷歌、新���微博、创新工场，也跟癑ֺ�的朋友有所交流�Q�也认识了新朋友�Q�收获很多。今后还要多出去走走看看�?/p>
<p style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; ">&nbsp; &nbsp; &nbsp;另外�Q�也有一个广告，淘宝会在今年�?月䆾在杭州�D办淘宝技术嘉�q�华�Q�希望到时候有更多的业内朋友来参加�?/p>
</div>
<img src ="http://www.aygfsteel.com/vanadies10/aggbug/348343.html" width = "1" height = "1" /><br><br><div align=right><a style="text-decoration:none;" href="http://www.aygfsteel.com/vanadies10/" target="_blank">见习���仙_华黎</a> 2011-04-15 12:42 <a href="http://www.aygfsteel.com/vanadies10/archive/2011/04/15/348343.html#Feedback" target="_blank" style="text-decoration:none;">发表评论</a></div>]]></description></item></channel></rss>                                                       <footer>
<div class="friendship-link">
<a href="http://www.aygfsteel.com/" title="&#29408;&#29408;&#20037;&#20037;&#20122;&#27954;&#27431;&#32654;&#19987;&#21306;&#95;&#20013;&#25991;&#23383;&#24149;&#20122;&#27954;&#32508;&#21512;&#20037;&#20037;&#50;&#48;&#50;&#95;&#22269;&#20135;&#31934;&#21697;&#20122;&#27954;&#31532;&#20116;&#21306;&#22312;&#32447;&#95;&#26085;&#26412;&#20813;&#36153;&#32593;&#31449;&#35270;&#39057;">&#29408;&#29408;&#20037;&#20037;&#20122;&#27954;&#27431;&#32654;&#19987;&#21306;&#95;&#20013;&#25991;&#23383;&#24149;&#20122;&#27954;&#32508;&#21512;&#20037;&#20037;&#50;&#48;&#50;&#95;&#22269;&#20135;&#31934;&#21697;&#20122;&#27954;&#31532;&#20116;&#21306;&#22312;&#32447;&#95;&#26085;&#26412;&#20813;&#36153;&#32593;&#31449;&#35270;&#39057;</a>

</div>

</footer>


��վ֩���ģ�壺
<a href="http://" target="_blank">ľ��</a>|
<a href="http://" target="_blank">����������</a>|
<a href="http://" target="_blank">̩˳��</a>|
<a href="http://" target="_blank">������</a>|
<a href="http://" target="_blank">������</a>|
<a href="http://" target="_blank">��Ϫ��</a>|
<a href="http://" target="_blank">ũ����</a>|
<a href="http://" target="_blank">��ī��</a>|
<a href="http://" target="_blank">����</a>|
<a href="http://" target="_blank">�����</a>|
<a href="http://" target="_blank">������</a>|
<a href="http://" target="_blank">��˳��</a>|
<a href="http://" target="_blank">ͭ����</a>|
<a href="http://" target="_blank">���</a>|
<a href="http://" target="_blank">������</a>|
<a href="http://" target="_blank">��Ʊ��</a>|
<a href="http://" target="_blank">������</a>|
<a href="http://" target="_blank">����</a>|
<a href="http://" target="_blank">���п�ǰ��</a>|
<a href="http://" target="_blank">�ְ���</a>|
<a href="http://" target="_blank">��Ϫ��</a>|
<a href="http://" target="_blank">¤����</a>|
<a href="http://" target="_blank">����</a>|
<a href="http://" target="_blank">ʯ����</a>|
<a href="http://" target="_blank">�����</a>|
<a href="http://" target="_blank">������</a>|
<a href="http://" target="_blank">��ɽ��</a>|
<a href="http://" target="_blank">�����</a>|
<a href="http://" target="_blank">�鴨��</a>|
<a href="http://" target="_blank">����</a>|
<a href="http://" target="_blank">ͭ����</a>|
<a href="http://" target="_blank">ʯ��</a>|
<a href="http://" target="_blank">������</a>|
<a href="http://" target="_blank">ƽ����</a>|
<a href="http://" target="_blank">ƽɽ��</a>|
<a href="http://" target="_blank">�°Ͷ�����</a>|
<a href="http://" target="_blank">�����</a>|
<a href="http://" target="_blank">������</a>|
<a href="http://" target="_blank">������������</a>|
<a href="http://" target="_blank">��˼��</a>|
<a href="http://" target="_blank">������</a>|
<script>
(function(){
    var bp = document.createElement('script');
    var curProtocol = window.location.protocol.split(':')[0];
    if (curProtocol === 'https') {
        bp.src = 'https://zz.bdstatic.com/linksubmit/push.js';
    }
    else {
        bp.src = 'http://push.zhanzhang.baidu.com/push.js';
    }
    var s = document.getElementsByTagName("script")[0];
    s.parentNode.insertBefore(bp, s);
})();
</script>
</body>