javajohn

          金色年華

          漢字(中文)還是unicode

          漢字與 unicode 編碼相互轉化

          (2006年7月17日? 11:07:58 )

          一、???????????? 概述:

          ?????? 如果項目采用了 GBK 的編碼,那么漢字轉化就不是問題了。但是如果采用了 utf-8 的編碼,漢字的處理就相對比較麻煩一些。

          二、???????????? 功能實現:

          ??????

          代碼如下:

          ?

          ?1 ???? // ?轉為unicode
          ?2 ???? public ? static ? void ?writeUnicode( final ?DataOutputStream?out,
          ?3 ???????????? final ?String?value)? {
          ?4 ???????? try ? {
          ?5 ???????????? final ?String?unicode? = ?gbEncoding(value);
          ?6 ???????????? final ? byte []?data? = ?unicode.getBytes();
          ?7 ???????????? final ? int ?dataLength? = ?data.length;
          ?8
          ?9 ????????????System.out.println( " Data?Length?is:? " ? + ?dataLength);
          10 ????????????System.out.println( " Data?is:? " ? + ?value);
          11 ????????????out.writeInt(dataLength);? // ?先寫出字符串的長度
          12 ????????????out.write(data,? 0 ,?dataLength);? // ?然后寫出轉化后的字符串
          13 ????????}
          ? catch ?(IOException?e)? {
          14
          15 ????????}

          16 ????}

          17
          18 ???? public ? static ?String?gbEncoding( final ?String?gbString)? {
          19 ???????? char []?utfBytes? = ?gbString.toCharArray();
          20 ????????String?unicodeBytes? = ? "" ;
          21 ???????? for ?( int ?byteIndex? = ? 0 ;?byteIndex? < ?utfBytes.length;?byteIndex ++ )? {
          22 ????????????String?hexB? = ?Integer.toHexString(utfBytes[byteIndex]);
          23 ???????????? if ?(hexB.length()? <= ? 2 )? {
          24 ????????????????hexB? = ? " 00 " ? + ?hexB;
          25 ????????????}

          26 ????????????unicodeBytes? = ?unicodeBytes? + ? " \\u " ? + ?hexB;
          27 ????????}

          28 ???????? // ?System.out.println("unicodeBytes?is:?"?+?unicodeBytes);
          29 ???????? return ?unicodeBytes;
          30 ????}

          31
          32 ???? /**
          33 ?????*?This?method?will?decode?the?String?to?a?recognized?String?in?ui.
          34 ?????*?功能:將unicod碼轉為需要的格式(utf-8)
          35 ?????*? @author ?javajohn
          36 ?????*? @param ?dataStr
          37 ?????*? @return
          38 ????? */

          39 ???? public ? static ?StringBuffer?decodeUnicode( final ?String?dataStr)? {
          40 ???????? final ?StringBuffer?buffer? = ? new ?StringBuffer();
          41 ????????String?tempStr? = ? "" ;
          42 ????????String?operStr? = ?dataStr;
          43 ???????? if (operStr? != ? null ? && ?operStr.indexOf( " \\u " )? == ? - 1 )? return ?buffer.append(operStr); //
          44 ???????? if (operStr? != ? null ? && ? ! operStr.equals( "" )? && ? ! operStr.startsWith( " \\u " )) { //
          45 ????????????tempStr? = ?operStr.substring( 0 ,operStr.indexOf( " \\u " )); //?
          46????????????operStr?=?operStr.substring(operStr.indexOf("\\u"),operStr.length());//operStr字符一定是以unicode編碼字符打頭的字符串
          47????????}

          48 ????????buffer.append(tempStr);
          49 ???????? while ?(operStr? != ? null ? && ? ! operStr.equals( "" )? && ?operStr.startsWith( " \\u " )) { // 循環處理,處理對象一定是以unicode編碼字符打頭的字符串
          50 ????????????tempStr? = ?operStr.substring( 0 , 6 );
          51 ????????????operStr? = ?operStr.substring( 6 ,operStr.length());
          52 ????????????String?charStr? = ? "" ;
          53 ????????????charStr? = ?tempStr.substring( 2 ,?tempStr.length());
          54 ???????????? char ?letter? = ?( char )?Integer.parseInt(charStr,? 16 );? // ?16進制parse整形字符串。
          55 ????????????buffer.append( new ?Character(letter).toString());
          56 ???????????? if (operStr.indexOf( " \\u " )? == ? - 1 ) { //?
          57????????????????buffer.append(operStr);
          58????????????}
          else { // 處理operStr使其打頭字符為unicode字符
          59 ????????????????tempStr? = ?operStr.substring( 0 ,operStr.indexOf( " \\u " ));
          60 ????????????????operStr? = ?operStr.substring(operStr.indexOf( " \\u " ),operStr.length());
          61 ????????????????buffer.append(tempStr);
          62 ????????????}

          63 ????????}

          64 ???????? return ?buffer;
          65 ????}

          一、???????????? 結尾:

          posted on 2006-07-17 11:07 javajohn 閱讀(5551) 評論(1)  編輯  收藏 所屬分類: 我的記憶

          Feedback

          # re: 漢字(中文)還是unicode 2006-07-18 17:11 小豬

          關于代碼單元和代碼點的理解:
          1、一個代碼點可能包含一個或兩個代碼單元。
          2、在我的測試程序中,“我 ”也只占用一個代碼單元。即代碼點數等于代碼單元數。
          下面是在unicode的官方網站上找到的關于unicode的中文,韓文,日文的一些說明:
          Q: I have heard that UTF-8 does not support some Japanese characters. Is this correct?

          A: There is a lot of misinformation floating around about the support of Chinese, Japanese and Korean (CJK) characters. The Unicode Standard supports all of the CJK characters from JIS X 0208, JIS X 0212, JIS X 0221, or JIS X 0213, for example, and many more. This is true no matter which encoding form of Unicode is used: UTF-8, UTF-16, or UTF-32.

          Unicode supports over 70,000 CJK characters right now, and work is underway to encode further additions. The International Standard ISO/IEC 10646 and the Unicode Standard are completely synchronized in repertoire and content. And that means that Unicode has the same repertoire as GB 18030, since that also is synchronized with ISO 10646 — although with a different ordering and byte format.
          無論是那個編碼方式(UTF-8, UTF-16, or UTF-32)都可以對中文全面支持?


          我的測試程序如下:
          public class test0 {
          public static void main(String[] args)
          {String a="我 ";
          int cuCount=a.length();
          System.out.println("the number of code units required for string \"test\" in the UTF-16 encoding is "+cuCount);
          int cpCount=a.codePointCount(0, a.length());
          System.out.println("the number of code points is "+cpCount);
          System.out.println("the end of string \"我 \" is "+a.charAt(a.length()-1));

          }

          }

          輸出結果為:
          the number of code units required for string "test" in the UTF-16 encoding is 2
          the number of code points is 2
          the end of string "我 " is [空格]

          在eclipse里面找到了set encoding選項,在里面可以設置編碼方式。  回復  更多評論   


          My Links

          Blog Stats

          常用鏈接

          留言簿(7)

          隨筆分類(36)

          隨筆檔案(39)

          classmate

          good blog

          企業管理網站

          好友

          站點收藏

          搜索

          最新評論

          閱讀排行榜

          評論排行榜

          主站蜘蛛池模板: 屯留县| 津南区| 丰台区| 新建县| 库伦旗| 子长县| 营山县| 平山县| 济宁市| 昌黎县| 汝城县| 兴文县| 玛多县| 油尖旺区| 和龙市| 侯马市| 枣强县| 托克逊县| 历史| 石家庄市| 宽甸| 罗定市| 昆明市| 花垣县| 襄樊市| 无锡市| 康乐县| 罗定市| 安新县| 德阳市| 鄂温| 胶南市| 石屏县| 肥乡县| 图木舒克市| 红河县| 福贡县| 乌苏市| 安庆市| 南安市| 双峰县|