GB2312 en unicode

Bonjour,

Je suis actuellement en train de faire un stage en informatique dans une entreprise chinoise dans laquelle il n'y a aucun informaticien pour me renseigner sur un problème bien particulier.

Les utilisateurs du site web que je dois créer écriront en chinois et auront des noms d'utilisateurs chinois. J'ai donc encodé, dans phpmyadmin, les champs concernés en gb2312_chinese_ci. Le problème que je rencontre est dans le script php.

Après avoir cherché sur internet, j'ai tenté d'utiliser la fonction unicode_encode($string) et unicode_decode($string). Malheureusement, le navigateur m'annonce que ces méthodes n'existent pas, alors que l'on peut trouver de nombreuses informations sur celles-ci sur le web.

J'ai donc essayé une autre solution. J'ai trouvé la fonction suivante créée par un programmeur qui permettrait de faire ce que je désire :

Code:

---

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27

function gb2unicode($gb) { if(!trim($gb)) return $gb; $filename="gb2312.txt"; $tmp=file($filename); $codetable=array(); while(list($key,$value)=each($tmp)) $codetable[hexdec(substr($value,0,6))]=substr($value,9,4); $utf=""; while($gb) { if (ord(substr($gb,0,1))>127) { $th=substr($gb,0,2); $gb=substr($gb,2,strlen($gb)); $utf.="&#x".$codetable[hexdec(bin2hex($th))-0x8080].";"; } else { $gb=substr($gb,1,strlen($gb)); $utf.=substr($gb,0,1); } } return $utf; }

---

et voici le fichier gb2312.txt qu'elle utilise :

Code:

---

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 801 802 803 804 805 806 807 808 809 810 811 812 813 814 815 816 817 818 819 820 821 822 823 824 825 826 827 828 829 830 831 832 833 834 835 836 837 838 839 840 841 842 843 844 845 846 847 848 849 850 851 852 853 854 855 856 857 858 859 860 861 862 863 864 865 866 867 868 869 870 871 872 873 874 875 876 877 878 879 880 881 882 883 884 885 886 887 888 889 890 891 892 893 894 895 896 897 898 899 900 901 902 903 904 905 906 907 908 909 910 911 912 913 914 915 916 917 918 919 920 921 922 923 924 925

# gb2312.txt -- # # GB2312 to Unicode table (modified) # from: # http://tcl.apache.org/sources/tcl/tools/encoding/gb2312.txt # ftp://ftp.unicode.org/Public/MAPPINGS/OBSOLETE/EASTASIA/GB/GB2312.TXT # # Copyright (c) 1998-1999 by Scriptics Corporation. # # See the file "license.terms" for information on usage and redistribution # of this file, and for a DISCLAIMER OF ALL WARRANTIES. # # RCS: @(#) $Id: gb2312.txt,v 1.2 1999/04/16 00:47:55 stanton Exp $ # # NOTE: this table has been modified to include the 7-bit ASCII # characters that are allowed in GB2312 files. # # # Name: GB2312-80 to Unicode table (complete, hex format) # Unicode version: 1.1 # Table version: 0.0d2 # Table format: Format A # Date: 6 December 1993 # Author: Glenn Adams <glenn@metis.com> # John H. Jenkins <John_Jenkins@taligent.com> # # Copyright (c) 1991-1994 Unicode, Inc. All Rights reserved. # # This file is provided as-is by Unicode, Inc. (The Unicode Consortium). # No claims are made as to fitness for any particular purpose. No # warranties of any kind are expressed or implied. The recipient # agrees to determine applicability of information provided. If this # file has been provided on magnetic media by Unicode, Inc., the sole # remedy for any claim will be exchange of defective media within 90 # days of receipt. # # Recipient is granted the right to make copies in any form for # internal distribution and to freely use the information supplied # in the creation of products supporting Unicode. Unicode, Inc. # specifically excludes the right to re-distribute this file directly # to third parties or other organizations whether for profit or not. # # General notes: # # This table contains the data Metis and Taligent currently have on how # GB2312-80 characters map into Unicode. # # Format: Three tab-separated columns # Column #1 is the GB2312 code (in hex as 0xXXXX) # Column #2 is the Unicode (in hex as 0xXXXX) # Column #3 the Unicode name (follows a comment sign, '#') # The official names for Unicode characters U+4E00 # to U+9FA5, inclusive, is "CJK UNIFIED IDEOGRAPH-XXXX", # where XXXX is the code point. Including all these # names in this file increases its size substantially # and needlessly. The token "<CJK>" is used for the # name of these characters. If necessary, it can be # expanded algorithmically by a parser or editor. # # The entries are in GB2312 order # # The following algorithms can be used to change the hex form # of GB2312 to other standard forms: # # To change hex to EUC form, add 0x8080 # To change hex to kuten form, first subtract 0x2020. Then # the high and low bytes correspond to the ku and ten of # the kuten form. For example, 0x2121 -> 0x0101 -> 0101; # 0x777E -> 0x575E -> 8794 # # Any comments or problems, contact <John_Jenkins@taligent.com> # # 0x2121=>0x3000, # IDEOGRAPHIC SPACE 0x2122=>0x3001, # IDEOGRAPHIC COMMA 0x2123=>0x3002, # IDEOGRAPHIC FULL STOP 0x2124=>0x30FB, # KATAKANA MIDDLE DOT 0x2125=>0x02C9, # MODIFIER LETTER MACRON (Mandarin Chinese first tone) 0x2126=>0x02C7, # CARON (Mandarin Chinese third tone) 0x2127=>0x00A8, # DIAERESIS 0x2128=>0x3003, # DITTO MARK 0x2129=>0x3005, # IDEOGRAPHIC ITERATION MARK 0x212A=>0x2015, # HORIZONTAL BAR 0x212B=>0xFF5E, # FULLWIDTH TILDE 0x212C=>0x2225, # PARALLEL TO 0x212D=>0x2026, # HORIZONTAL ELLIPSIS 0x212E=>0x2018, # LEFT SINGLE QUOTATION MARK 0x212F=>0x2019, # RIGHT SINGLE QUOTATION MARK 0x2130=>0x201C, # LEFT DOUBLE QUOTATION MARK 0x2131=>0x201D, # RIGHT DOUBLE QUOTATION MARK 0x2132=>0x3014, # LEFT TORTOISE SHELL BRACKET 0x2133=>0x3015, # RIGHT TORTOISE SHELL BRACKET 0x2134=>0x3008, # LEFT ANGLE BRACKET 0x2135=>0x3009, # RIGHT ANGLE BRACKET 0x2136=>0x300A, # LEFT DOUBLE ANGLE BRACKET 0x2137=>0x300B, # RIGHT DOUBLE ANGLE BRACKET 0x2138=>0x300C, # LEFT CORNER BRACKET 0x2139=>0x300D, # RIGHT CORNER BRACKET 0x213A=>0x300E, # LEFT WHITE CORNER BRACKET 0x213B=>0x300F, # RIGHT WHITE CORNER BRACKET 0x213C=>0x3016, # LEFT WHITE LENTICULAR BRACKET 0x213D=>0x3017, # RIGHT WHITE LENTICULAR BRACKET 0x213E=>0x3010, # LEFT BLACK LENTICULAR BRACKET 0x213F=>0x3011, # RIGHT BLACK LENTICULAR BRACKET 0x2140=>0x00B1, # PLUS-MINUS SIGN 0x2141=>0x00D7, # MULTIPLICATION SIGN 0x2142=>0x00F7, # DIVISION SIGN 0x2143=>0x2236, # RATIO 0x2144=>0x2227, # LOGICAL AND 0x2145=>0x2228, # LOGICAL OR 0x2146=>0x2211, # N-ARY SUMMATION 0x2147=>0x220F, # N-ARY PRODUCT 0x2148=>0x222A, # UNION 0x2149=>0x2229, # INTERSECTION 0x214A=>0x2208, # ELEMENT OF 0x214B=>0x2237, # PROPORTION 0x214C=>0x221A, # SQUARE ROOT 0x214D=>0x22A5, # UP TACK 0x214E=>0x2225, # PARALLEL TO 0x214F=>0x2220, # ANGLE 0x2150=>0x2312, # ARC 0x2151=>0x2299, # CIRCLED DOT OPERATOR 0x2152=>0x222B, # INTEGRAL 0x2153=>0x222E, # CONTOUR INTEGRAL 0x2154=>0x2261, # IDENTICAL TO 0x2155=>0x224C, # ALL EQUAL TO 0x2156=>0x2248, # ALMOST EQUAL TO 0x2157=>0x223D, # REVERSED TILDE 0x2158=>0x221D, # PROPORTIONAL TO 0x2159=>0x2260, # NOT EQUAL TO 0x215A=>0x226E, # NOT LESS-THAN 0x215B=>0x226F, # NOT GREATER-THAN 0x215C=>0x2264, # LESS-THAN OR EQUAL TO 0x215D=>0x2265, # GREATER-THAN OR EQUAL TO 0x215E=>0x221E, # INFINITY 0x215F=>0x2235, # BECAUSE 0x2160=>0x2234, # THEREFORE 0x2161=>0x2642, # MALE SIGN 0x2162=>0x2640, # FEMALE SIGN 0x2163=>0x00B0, # DEGREE SIGN 0x2164=>0x2032, # PRIME 0x2165=>0x2033, # DOUBLE PRIME 0x2166=>0x2103, # DEGREE CELSIUS 0x2167=>0xFF04, # FULLWIDTH DOLLAR SIGN 0x2168=>0x00A4, # CURRENCY SIGN 0x2169=>0xFFE0, # FULLWIDTH CENT SIGN 0x216A=>0xFFE1, # FULLWIDTH POUND SIGN 0x216B=>0x2030, # PER MILLE SIGN 0x216C=>0x00A7, # SECTION SIGN 0x216D=>0x2116, # NUMERO SIGN 0x216E=>0x2606, # WHITE STAR 0x216F=>0x2605, # BLACK STAR 0x2170=>0x25CB, # WHITE CIRCLE 0x2171=>0x25CF, # BLACK CIRCLE 0x2172=>0x25CE, # BULLSEYE 0x2173=>0x25C7, # WHITE DIAMOND 0x2174=>0x25C6, # BLACK DIAMOND 0x2175=>0x25A1, # WHITE SQUARE 0x2176=>0x25A0, # BLACK SQUARE 0x2177=>0x25B3, # WHITE UP-POINTING TRIANGLE 0x2178=>0x25B2, # BLACK UP-POINTING TRIANGLE 0x2179=>0x203B, # REFERENCE MARK 0x217A=>0x2192, # RIGHTWARDS ARROW 0x217B=>0x2190, # LEFTWARDS ARROW 0x217C=>0x2191, # UPWARDS ARROW 0x217D=>0x2193, # DOWNWARDS ARROW 0x217E=>0x3013, # GETA MARK 0x2231=>0x2488, # DIGIT ONE FULL STOP 0x2232=>0x2489, # DIGIT TWO FULL STOP 0x2233=>0x248A, # DIGIT THREE FULL STOP 0x2234=>0x248B, # DIGIT FOUR FULL STOP 0x2235=>0x248C, # DIGIT FIVE FULL STOP 0x2236=>0x248D, # DIGIT SIX FULL STOP 0x2237=>0x248E, # DIGIT SEVEN FULL STOP 0x2238=>0x248F, # DIGIT EIGHT FULL STOP 0x2239=>0x2490, # DIGIT NINE FULL STOP 0x223A=>0x2491, # NUMBER TEN FULL STOP 0x223B=>0x2492, # NUMBER ELEVEN FULL STOP 0x223C=>0x2493, # NUMBER TWELVE FULL STOP 0x223D=>0x2494, # NUMBER THIRTEEN FULL STOP 0x223E=>0x2495, # NUMBER FOURTEEN FULL STOP 0x223F=>0x2496, # NUMBER FIFTEEN FULL STOP 0x2240=>0x2497, # NUMBER SIXTEEN FULL STOP 0x2241=>0x2498, # NUMBER SEVENTEEN FULL STOP 0x2242=>0x2499, # NUMBER EIGHTEEN FULL STOP 0x2243=>0x249A, # NUMBER NINETEEN FULL STOP 0x2244=>0x249B, # NUMBER TWENTY FULL STOP 0x2245=>0x2474, # PARENTHESIZED DIGIT ONE 0x2246=>0x2475, # PARENTHESIZED DIGIT TWO 0x2247=>0x2476, # PARENTHESIZED DIGIT THREE 0x2248=>0x2477, # PARENTHESIZED DIGIT FOUR 0x2249=>0x2478, # PARENTHESIZED DIGIT FIVE 0x224A=>0x2479, # PARENTHESIZED DIGIT SIX 0x224B=>0x247A, # PARENTHESIZED DIGIT SEVEN 0x224C=>0x247B, # PARENTHESIZED DIGIT EIGHT 0x224D=>0x247C, # PARENTHESIZED DIGIT NINE 0x224E=>0x247D, # PARENTHESIZED NUMBER TEN 0x224F=>0x247E, # PARENTHESIZED NUMBER ELEVEN 0x2250=>0x247F, # PARENTHESIZED NUMBER TWELVE 0x2251=>0x2480, # PARENTHESIZED NUMBER THIRTEEN 0x2252=>0x2481, # PARENTHESIZED NUMBER FOURTEEN 0x2253=>0x2482, # PARENTHESIZED NUMBER FIFTEEN 0x2254=>0x2483, # PARENTHESIZED NUMBER SIXTEEN 0x2255=>0x2484, # PARENTHESIZED NUMBER SEVENTEEN 0x2256=>0x2485, # PARENTHESIZED NUMBER EIGHTEEN 0x2257=>0x2486, # PARENTHESIZED NUMBER NINETEEN 0x2258=>0x2487, # PARENTHESIZED NUMBER TWENTY 0x2259=>0x2460, # CIRCLED DIGIT ONE 0x225A=>0x2461, # CIRCLED DIGIT TWO 0x225B=>0x2462, # CIRCLED DIGIT THREE 0x225C=>0x2463, # CIRCLED DIGIT FOUR 0x225D=>0x2464, # CIRCLED DIGIT FIVE 0x225E=>0x2465, # CIRCLED DIGIT SIX 0x225F=>0x2466, # CIRCLED DIGIT SEVEN 0x2260=>0x2467, # CIRCLED DIGIT EIGHT 0x2261=>0x2468, # CIRCLED DIGIT NINE 0x2262=>0x2469, # CIRCLED NUMBER TEN 0x2265=>0x3220, # PARENTHESIZED IDEOGRAPH ONE 0x2266=>0x3221, # PARENTHESIZED IDEOGRAPH TWO 0x2267=>0x3222, # PARENTHESIZED IDEOGRAPH THREE 0x2268=>0x3223, # PARENTHESIZED IDEOGRAPH FOUR 0x2269=>0x3224, # PARENTHESIZED IDEOGRAPH FIVE 0x226A=>0x3225, # PARENTHESIZED IDEOGRAPH SIX 0x226B=>0x3226, # PARENTHESIZED IDEOGRAPH SEVEN 0x226C=>0x3227, # PARENTHESIZED IDEOGRAPH EIGHT 0x226D=>0x3228, # PARENTHESIZED IDEOGRAPH NINE 0x226E=>0x3229, # PARENTHESIZED IDEOGRAPH TEN 0x2271=>0x2160, # ROMAN NUMERAL ONE 0x2272=>0x2161, # ROMAN NUMERAL TWO 0x2273=>0x2162, # ROMAN NUMERAL THREE 0x2274=>0x2163, # ROMAN NUMERAL FOUR 0x2275=>0x2164, # ROMAN NUMERAL FIVE 0x2276=>0x2165, # ROMAN NUMERAL SIX 0x2277=>0x2166, # ROMAN NUMERAL SEVEN 0x2278=>0x2167, # ROMAN NUMERAL EIGHT 0x2279=>0x2168, # ROMAN NUMERAL NINE 0x227A=>0x2169, # ROMAN NUMERAL TEN 0x227B=>0x216A, # ROMAN NUMERAL ELEVEN 0x227C=>0x216B, # ROMAN NUMERAL TWELVE 0x2321=>0xFF01, # FULLWIDTH EXCLAMATION MARK 0x2322=>0xFF02, # FULLWIDTH QUOTATION MARK 0x2323=>0xFF03, # FULLWIDTH NUMBER SIGN 0x2324=>0xFFE5, # FULLWIDTH YEN SIGN 0x2325=>0xFF05, # FULLWIDTH PERCENT SIGN 0x2326=>0xFF06, # FULLWIDTH AMPERSAND 0x2327=>0xFF07, # FULLWIDTH APOSTROPHE 0x2328=>0xFF08, # FULLWIDTH LEFT PARENTHESIS 0x2329=>0xFF09, # FULLWIDTH RIGHT PARENTHESIS 0x232A=>0xFF0A, # FULLWIDTH ASTERISK 0x232B=>0xFF0B, # FULLWIDTH PLUS SIGN 0x232C=>0xFF0C, # FULLWIDTH COMMA 0x232D=>0xFF0D, # FULLWIDTH HYPHEN-MINUS 0x232E=>0xFF0E, # FULLWIDTH FULL STOP 0x232F=>0xFF0F, # FULLWIDTH SOLIDUS 0x2330=>0xFF10, # FULLWIDTH DIGIT ZERO 0x2331=>0xFF11, # FULLWIDTH DIGIT ONE 0x2332=>0xFF12, # FULLWIDTH DIGIT TWO 0x2333=>0xFF13, # FULLWIDTH DIGIT THREE 0x2334=>0xFF14, # FULLWIDTH DIGIT FOUR 0x2335=>0xFF15, # FULLWIDTH DIGIT FIVE 0x2336=>0xFF16, # FULLWIDTH DIGIT SIX 0x2337=>0xFF17, # FULLWIDTH DIGIT SEVEN 0x2338=>0xFF18, # FULLWIDTH DIGIT EIGHT 0x2339=>0xFF19, # FULLWIDTH DIGIT NINE 0x233A=>0xFF1A, # FULLWIDTH COLON 0x233B=>0xFF1B, # FULLWIDTH SEMICOLON 0x233C=>0xFF1C, # FULLWIDTH LESS-THAN SIGN 0x233D=>0xFF1D, # FULLWIDTH EQUALS SIGN 0x233E=>0xFF1E, # FULLWIDTH GREATER-THAN SIGN 0x233F=>0xFF1F, # FULLWIDTH QUESTION MARK 0x2340=>0xFF20, # FULLWIDTH COMMERCIAL AT 0x2341=>0xFF21, # FULLWIDTH LATIN CAPITAL LETTER A 0x2342=>0xFF22, # FULLWIDTH LATIN CAPITAL LETTER B 0x2343=>0xFF23, # FULLWIDTH LATIN CAPITAL LETTER C 0x2344=>0xFF24, # FULLWIDTH LATIN CAPITAL LETTER D 0x2345=>0xFF25, # FULLWIDTH LATIN CAPITAL LETTER E 0x2346=>0xFF26, # FULLWIDTH LATIN CAPITAL LETTER F 0x2347=>0xFF27, # FULLWIDTH LATIN CAPITAL LETTER G 0x2348=>0xFF28, # FULLWIDTH LATIN CAPITAL LETTER H 0x2349=>0xFF29, # FULLWIDTH LATIN CAPITAL LETTER I 0x234A=>0xFF2A, # FULLWIDTH LATIN CAPITAL LETTER J 0x234B=>0xFF2B, # FULLWIDTH LATIN CAPITAL LETTER K 0x234C=>0xFF2C, # FULLWIDTH LATIN CAPITAL LETTER L 0x234D=>0xFF2D, # FULLWIDTH LATIN CAPITAL LETTER M 0x234E=>0xFF2E, # FULLWIDTH LATIN CAPITAL LETTER N 0x234F=>0xFF2F, # FULLWIDTH LATIN CAPITAL LETTER O 0x2350=>0xFF30, # FULLWIDTH LATIN CAPITAL LETTER P 0x2351=>0xFF31, # FULLWIDTH LATIN CAPITAL LETTER Q 0x2352=>0xFF32, # FULLWIDTH LATIN CAPITAL LETTER R 0x2353=>0xFF33, # FULLWIDTH LATIN CAPITAL LETTER S 0x2354=>0xFF34, # FULLWIDTH LATIN CAPITAL LETTER T 0x2355=>0xFF35, # FULLWIDTH LATIN CAPITAL LETTER U 0x2356=>0xFF36, # FULLWIDTH LATIN CAPITAL LETTER V 0x2357=>0xFF37, # FULLWIDTH LATIN CAPITAL LETTER W 0x2358=>0xFF38, # FULLWIDTH LATIN CAPITAL LETTER X 0x2359=>0xFF39, # FULLWIDTH LATIN CAPITAL LETTER Y 0x235A=>0xFF3A, # FULLWIDTH LATIN CAPITAL LETTER Z 0x235B=>0xFF3B, # FULLWIDTH LEFT SQUARE BRACKET 0x235C=>0xFF3C, # FULLWIDTH REVERSE SOLIDUS 0x235D=>0xFF3D, # FULLWIDTH RIGHT SQUARE BRACKET 0x235E=>0xFF3E, # FULLWIDTH CIRCUMFLEX ACCENT 0x235F=>0xFF3F, # FULLWIDTH LOW LINE 0x2360=>0xFF40, # FULLWIDTH GRAVE ACCENT 0x2361=>0xFF41, # FULLWIDTH LATIN SMALL LETTER A 0x2362=>0xFF42, # FULLWIDTH LATIN SMALL LETTER B 0x2363=>0xFF43, # FULLWIDTH LATIN SMALL LETTER C 0x2364=>0xFF44, # FULLWIDTH LATIN SMALL LETTER D 0x2365=>0xFF45, # FULLWIDTH LATIN SMALL LETTER E 0x2366=>0xFF46, # FULLWIDTH LATIN SMALL LETTER F 0x2367=>0xFF47, # FULLWIDTH LATIN SMALL LETTER G 0x2368=>0xFF48, # FULLWIDTH LATIN SMALL LETTER H 0x2369=>0xFF49, # FULLWIDTH LATIN SMALL LETTER I 0x236A=>0xFF4A, # FULLWIDTH LATIN SMALL LETTER J 0x236B=>0xFF4B, # FULLWIDTH LATIN SMALL LETTER K 0x236C=>0xFF4C, # FULLWIDTH LATIN SMALL LETTER L 0x236D=>0xFF4D, # FULLWIDTH LATIN SMALL LETTER M 0x236E=>0xFF4E, # FULLWIDTH LATIN SMALL LETTER N 0x236F=>0xFF4F, # FULLWIDTH LATIN SMALL LETTER O 0x2370=>0xFF50, # FULLWIDTH LATIN SMALL LETTER P 0x2371=>0xFF51, # FULLWIDTH LATIN SMALL LETTER Q 0x2372=>0xFF52, # FULLWIDTH LATIN SMALL LETTER R 0x2373=>0xFF53, # FULLWIDTH LATIN SMALL LETTER S 0x2374=>0xFF54, # FULLWIDTH LATIN SMALL LETTER T 0x2375=>0xFF55, # FULLWIDTH LATIN SMALL LETTER U 0x2376=>0xFF56, # FULLWIDTH LATIN SMALL LETTER V 0x2377=>0xFF57, # FULLWIDTH LATIN SMALL LETTER W 0x2378=>0xFF58, # FULLWIDTH LATIN SMALL LETTER X 0x2379=>0xFF59, # FULLWIDTH LATIN SMALL LETTER Y 0x237A=>0xFF5A, # FULLWIDTH LATIN SMALL LETTER Z 0x237B=>0xFF5B, # FULLWIDTH LEFT CURLY BRACKET 0x237C=>0xFF5C, # FULLWIDTH VERTICAL LINE 0x237D=>0xFF5D, # FULLWIDTH RIGHT CURLY BRACKET 0x237E=>0xFFE3, # FULLWIDTH MACRON 0x2421=>0x3041, # HIRAGANA LETTER SMALL A 0x2422=>0x3042, # HIRAGANA LETTER A 0x2423=>0x3043, # HIRAGANA LETTER SMALL I 0x2424=>0x3044, # HIRAGANA LETTER I 0x2425=>0x3045, # HIRAGANA LETTER SMALL U 0x2426=>0x3046, # HIRAGANA LETTER U 0x2427=>0x3047, # HIRAGANA LETTER SMALL E 0x2428=>0x3048, # HIRAGANA LETTER E 0x2429=>0x3049, # HIRAGANA LETTER SMALL O 0x242A=>0x304A, # HIRAGANA LETTER O 0x242B=>0x304B, # HIRAGANA LETTER KA 0x242C=>0x304C, # HIRAGANA LETTER GA 0x242D=>0x304D, # HIRAGANA LETTER KI 0x242E=>0x304E, # HIRAGANA LETTER GI 0x242F=>0x304F, # HIRAGANA LETTER KU 0x2430=>0x3050, # HIRAGANA LETTER GU 0x2431=>0x3051, # HIRAGANA LETTER KE 0x2432=>0x3052, # HIRAGANA LETTER GE 0x2433=>0x3053, # HIRAGANA LETTER KO 0x2434=>0x3054, # HIRAGANA LETTER GO 0x2435=>0x3055, # HIRAGANA LETTER SA 0x2436=>0x3056, # HIRAGANA LETTER ZA 0x2437=>0x3057, # HIRAGANA LETTER SI 0x2438=>0x3058, # HIRAGANA LETTER ZI 0x2439=>0x3059, # HIRAGANA LETTER SU 0x243A=>0x305A, # HIRAGANA LETTER ZU 0x243B=>0x305B, # HIRAGANA LETTER SE 0x243C=>0x305C, # HIRAGANA LETTER ZE 0x243D=>0x305D, # HIRAGANA LETTER SO 0x243E=>0x305E, # HIRAGANA LETTER ZO 0x243F=>0x305F, # HIRAGANA LETTER TA 0x2440=>0x3060, # HIRAGANA LETTER DA 0x2441=>0x3061, # HIRAGANA LETTER TI 0x2442=>0x3062, # HIRAGANA LETTER DI 0x2443=>0x3063, # HIRAGANA LETTER SMALL TU 0x2444=>0x3064, # HIRAGANA LETTER TU 0x2445=>0x3065, # HIRAGANA LETTER DU 0x2446=>0x3066, # HIRAGANA LETTER TE 0x2447=>0x3067, # HIRAGANA LETTER DE 0x2448=>0x3068, # HIRAGANA LETTER TO 0x2449=>0x3069, # HIRAGANA LETTER DO 0x244A=>0x306A, # HIRAGANA LETTER NA 0x244B=>0x306B, # HIRAGANA LETTER NI 0x244C=>0x306C, # HIRAGANA LETTER NU 0x244D=>0x306D, # HIRAGANA LETTER NE 0x244E=>0x306E, # HIRAGANA LETTER NO 0x244F=>0x306F, # HIRAGANA LETTER HA 0x2450=>0x3070, # HIRAGANA LETTER BA 0x2451=>0x3071, # HIRAGANA LETTER PA 0x2452=>0x3072, # HIRAGANA LETTER HI 0x2453=>0x3073, # HIRAGANA LETTER BI 0x2454=>0x3074, # HIRAGANA LETTER PI 0x2455=>0x3075, # HIRAGANA LETTER HU 0x2456=>0x3076, # HIRAGANA LETTER BU 0x2457=>0x3077, # HIRAGANA LETTER PU 0x2458=>0x3078, # HIRAGANA LETTER HE 0x2459=>0x3079, # HIRAGANA LETTER BE 0x245A=>0x307A, # HIRAGANA LETTER PE 0x245B=>0x307B, # HIRAGANA LETTER HO 0x245C=>0x307C, # HIRAGANA LETTER BO 0x245D=>0x307D, # HIRAGANA LETTER PO 0x245E=>0x307E, # HIRAGANA LETTER MA 0x245F=>0x307F, # HIRAGANA LETTER MI 0x2460=>0x3080, # HIRAGANA LETTER MU 0x2461=>0x3081, # HIRAGANA LETTER ME 0x2462=>0x3082, # HIRAGANA LETTER MO 0x2463=>0x3083, # HIRAGANA LETTER SMALL YA 0x2464=>0x3084, # HIRAGANA LETTER YA 0x2465=>0x3085, # HIRAGANA LETTER SMALL YU 0x2466=>0x3086, # HIRAGANA LETTER YU 0x2467=>0x3087, # HIRAGANA LETTER SMALL YO 0x2468=>0x3088, # HIRAGANA LETTER YO 0x2469=>0x3089, # HIRAGANA LETTER RA 0x246A=>0x308A, # HIRAGANA LETTER RI 0x246B=>0x308B, # HIRAGANA LETTER RU 0x246C=>0x308C, # HIRAGANA LETTER RE 0x246D=>0x308D, # HIRAGANA LETTER RO 0x246E=>0x308E, # HIRAGANA LETTER SMALL WA 0x246F=>0x308F, # HIRAGANA LETTER WA 0x2470=>0x3090, # HIRAGANA LETTER WI 0x2471=>0x3091, # HIRAGANA LETTER WE 0x2472=>0x3092, # HIRAGANA LETTER WO 0x2473=>0x3093, # HIRAGANA LETTER N 0x2521=>0x30A1, # KATAKANA LETTER SMALL A 0x2522=>0x30A2, # KATAKANA LETTER A 0x2523=>0x30A3, # KATAKANA LETTER SMALL I 0x2524=>0x30A4, # KATAKANA LETTER I 0x2525=>0x30A5, # KATAKANA LETTER SMALL U 0x2526=>0x30A6, # KATAKANA LETTER U 0x2527=>0x30A7, # KATAKANA LETTER SMALL E 0x2528=>0x30A8, # KATAKANA LETTER E 0x2529=>0x30A9, # KATAKANA LETTER SMALL O 0x252A=>0x30AA, # KATAKANA LETTER O 0x252B=>0x30AB, # KATAKANA LETTER KA 0x252C=>0x30AC, # KATAKANA LETTER GA 0x252D=>0x30AD, # KATAKANA LETTER KI 0x252E=>0x30AE, # KATAKANA LETTER GI 0x252F=>0x30AF, # KATAKANA LETTER KU 0x2530=>0x30B0, # KATAKANA LETTER GU 0x2531=>0x30B1, # KATAKANA LETTER KE 0x2532=>0x30B2, # KATAKANA LETTER GE 0x2533=>0x30B3, # KATAKANA LETTER KO 0x2534=>0x30B4, # KATAKANA LETTER GO 0x2535=>0x30B5, # KATAKANA LETTER SA 0x2536=>0x30B6, # KATAKANA LETTER ZA 0x2537=>0x30B7, # KATAKANA LETTER SI 0x2538=>0x30B8, # KATAKANA LETTER ZI 0x2539=>0x30B9, # KATAKANA LETTER SU 0x253A=>0x30BA, # KATAKANA LETTER ZU 0x253B=>0x30BB, # KATAKANA LETTER SE 0x253C=>0x30BC, # KATAKANA LETTER ZE 0x253D=>0x30BD, # KATAKANA LETTER SO 0x253E=>0x30BE, # KATAKANA LETTER ZO 0x253F=>0x30BF, # KATAKANA LETTER TA 0x2540=>0x30C0, # KATAKANA LETTER DA 0x2541=>0x30C1, # KATAKANA LETTER TI 0x2542=>0x30C2, # KATAKANA LETTER DI 0x2543=>0x30C3, # KATAKANA LETTER SMALL TU 0x2544=>0x30C4, # KATAKANA LETTER TU 0x2545=>0x30C5, # KATAKANA LETTER DU 0x2546=>0x30C6, # KATAKANA LETTER TE 0x2547=>0x30C7, # KATAKANA LETTER DE 0x2548=>0x30C8, # KATAKANA LETTER TO 0x2549=>0x30C9, # KATAKANA LETTER DO 0x254A=>0x30CA, # KATAKANA LETTER NA 0x254B=>0x30CB, # KATAKANA LETTER NI 0x254C=>0x30CC, # KATAKANA LETTER NU 0x254D=>0x30CD, # KATAKANA LETTER NE 0x254E=>0x30CE, # KATAKANA LETTER NO 0x254F=>0x30CF, # KATAKANA LETTER HA 0x2550=>0x30D0, # KATAKANA LETTER BA 0x2551=>0x30D1, # KATAKANA LETTER PA 0x2552=>0x30D2, # KATAKANA LETTER HI 0x2553=>0x30D3, # KATAKANA LETTER BI 0x2554=>0x30D4, # KATAKANA LETTER PI 0x2555=>0x30D5, # KATAKANA LETTER HU 0x2556=>0x30D6, # KATAKANA LETTER BU 0x2557=>0x30D7, # KATAKANA LETTER PU 0x2558=>0x30D8, # KATAKANA LETTER HE 0x2559=>0x30D9, # KATAKANA LETTER BE 0x255A=>0x30DA, # KATAKANA LETTER PE 0x255B=>0x30DB, # KATAKANA LETTER HO 0x255C=>0x30DC, # KATAKANA LETTER BO 0x255D=>0x30DD, # KATAKANA LETTER PO 0x255E=>0x30DE, # KATAKANA LETTER MA 0x255F=>0x30DF, # KATAKANA LETTER MI 0x2560=>0x30E0, # KATAKANA LETTER MU 0x2561=>0x30E1, # KATAKANA LETTER ME 0x2562=>0x30E2, # KATAKANA LETTER MO 0x2563=>0x30E3, # KATAKANA LETTER SMALL YA 0x2564=>0x30E4, # KATAKANA LETTER YA 0x2565=>0x30E5, # KATAKANA LETTER SMALL YU 0x2566=>0x30E6, # KATAKANA LETTER YU 0x2567=>0x30E7, # KATAKANA LETTER SMALL YO 0x2568=>0x30E8, # KATAKANA LETTER YO 0x2569=>0x30E9, # KATAKANA LETTER RA 0x256A=>0x30EA, # KATAKANA LETTER RI 0x256B=>0x30EB, # KATAKANA LETTER RU 0x256C=>0x30EC, # KATAKANA LETTER RE 0x256D=>0x30ED, # KATAKANA LETTER RO 0x256E=>0x30EE, # KATAKANA LETTER SMALL WA 0x256F=>0x30EF, # KATAKANA LETTER WA 0x2570=>0x30F0, # KATAKANA LETTER WI 0x2571=>0x30F1, # KATAKANA LETTER WE 0x2572=>0x30F2, # KATAKANA LETTER WO 0x2573=>0x30F3, # KATAKANA LETTER N 0x2574=>0x30F4, # KATAKANA LETTER VU 0x2575=>0x30F5, # KATAKANA LETTER SMALL KA 0x2576=>0x30F6, # KATAKANA LETTER SMALL KE 0x2621=>0x0391, # GREEK CAPITAL LETTER ALPHA 0x2622=>0x0392, # GREEK CAPITAL LETTER BETA 0x2623=>0x0393, # GREEK CAPITAL LETTER GAMMA 0x2624=>0x0394, # GREEK CAPITAL LETTER DELTA 0x2625=>0x0395, # GREEK CAPITAL LETTER EPSILON 0x2626=>0x0396, # GREEK CAPITAL LETTER ZETA 0x2627=>0x0397, # GREEK CAPITAL LETTER ETA 0x2628=>0x0398, # GREEK CAPITAL LETTER THETA 0x2629=>0x0399, # GREEK CAPITAL LETTER IOTA 0x262A=>0x039A, # GREEK CAPITAL LETTER KAPPA 0x262B=>0x039B, # GREEK CAPITAL LETTER LAMDA 0x262C=>0x039C, # GREEK CAPITAL LETTER MU 0x262D=>0x039D, # GREEK CAPITAL LETTER NU 0x262E=>0x039E, # GREEK CAPITAL LETTER XI 0x262F=>0x039F, # GREEK CAPITAL LETTER OMICRON 0x2630=>0x03A0, # GREEK CAPITAL LETTER PI 0x2631=>0x03A1, # GREEK CAPITAL LETTER RHO 0x2632=>0x03A3, # GREEK CAPITAL LETTER SIGMA 0x2633=>0x03A4, # GREEK CAPITAL LETTER TAU 0x2634=>0x03A5, # GREEK CAPITAL LETTER UPSILON 0x2635=>0x03A6, # GREEK CAPITAL LETTER PHI 0x2636=>0x03A7, # GREEK CAPITAL LETTER CHI 0x2637=>0x03A8, # GREEK CAPITAL LETTER PSI 0x2638=>0x03A9, # GREEK CAPITAL LETTER OMEGA 0x2641=>0x03B1, # GREEK SMALL LETTER ALPHA 0x2642=>0x03B2, # GREEK SMALL LETTER BETA 0x2643=>0x03B3, # GREEK SMALL LETTER GAMMA 0x2644=>0x03B4, # GREEK SMALL LETTER DELTA 0x2645=>0x03B5, # GREEK SMALL LETTER EPSILON 0x2646=>0x03B6, # GREEK SMALL LETTER ZETA 0x2647=>0x03B7, # GREEK SMALL LETTER ETA 0x2648=>0x03B8, # GREEK SMALL LETTER THETA 0x2649=>0x03B9, # GREEK SMALL LETTER IOTA 0x264A=>0x03BA, # GREEK SMALL LETTER KAPPA 0x264B=>0x03BB, # GREEK SMALL LETTER LAMDA 0x264C=>0x03BC, # GREEK SMALL LETTER MU 0x264D=>0x03BD, # GREEK SMALL LETTER NU 0x264E=>0x03BE, # GREEK SMALL LETTER XI 0x264F=>0x03BF, # GREEK SMALL LETTER OMICRON 0x2650=>0x03C0, # GREEK SMALL LETTER PI 0x2651=>0x03C1, # GREEK SMALL LETTER RHO 0x2652=>0x03C3, # GREEK SMALL LETTER SIGMA 0x2653=>0x03C4, # GREEK SMALL LETTER TAU 0x2654=>0x03C5, # GREEK SMALL LETTER UPSILON 0x2655=>0x03C6, # GREEK SMALL LETTER PHI 0x2656=>0x03C7, # GREEK SMALL LETTER CHI 0x2657=>0x03C8, # GREEK SMALL LETTER PSI 0x2658=>0x03C9, # GREEK SMALL LETTER OMEGA 0x2721=>0x0410, # CYRILLIC CAPITAL LETTER A 0x2722=>0x0411, # CYRILLIC CAPITAL LETTER BE 0x2723=>0x0412, # CYRILLIC CAPITAL LETTER VE 0x2724=>0x0413, # CYRILLIC CAPITAL LETTER GHE 0x2725=>0x0414, # CYRILLIC CAPITAL LETTER DE 0x2726=>0x0415, # CYRILLIC CAPITAL LETTER IE 0x2727=>0x0401, # CYRILLIC CAPITAL LETTER IO 0x2728=>0x0416, # CYRILLIC CAPITAL LETTER ZHE 0x2729=>0x0417, # CYRILLIC CAPITAL LETTER ZE 0x272A=>0x0418, # CYRILLIC CAPITAL LETTER I 0x272B=>0x0419, # CYRILLIC CAPITAL LETTER SHORT I 0x272C=>0x041A, # CYRILLIC CAPITAL LETTER KA 0x272D=>0x041B, # CYRILLIC CAPITAL LETTER EL 0x272E=>0x041C, # CYRILLIC CAPITAL LETTER EM 0x272F=>0x041D, # CYRILLIC CAPITAL LETTER EN 0x2730=>0x041E, # CYRILLIC CAPITAL LETTER O 0x2731=>0x041F, # CYRILLIC CAPITAL LETTER PE 0x2732=>0x0420, # CYRILLIC CAPITAL LETTER ER 0x2733=>0x0421, # CYRILLIC CAPITAL LETTER ES 0x2734=>0x0422, # CYRILLIC CAPITAL LETTER TE 0x2735=>0x0423, # CYRILLIC CAPITAL LETTER U 0x2736=>0x0424, # CYRILLIC CAPITAL LETTER EF 0x2737=>0x0425, # CYRILLIC CAPITAL LETTER HA 0x2738=>0x0426, # CYRILLIC CAPITAL LETTER TSE 0x2739=>0x0427, # CYRILLIC CAPITAL LETTER CHE 0x273A=>0x0428, # CYRILLIC CAPITAL LETTER SHA 0x273B=>0x0429, # CYRILLIC CAPITAL LETTER SHCHA 0x273C=>0x042A, # CYRILLIC CAPITAL LETTER HARD SIGN 0x273D=>0x042B, # CYRILLIC CAPITAL LETTER YERU 0x273E=>0x042C, # CYRILLIC CAPITAL LETTER SOFT SIGN 0x273F=>0x042D, # CYRILLIC CAPITAL LETTER E 0x2740=>0x042E, # CYRILLIC CAPITAL LETTER YU 0x2741=>0x042F, # CYRILLIC CAPITAL LETTER YA 0x2751=>0x0430, # CYRILLIC SMALL LETTER A 0x2752=>0x0431, # CYRILLIC SMALL LETTER BE 0x2753=>0x0432, # CYRILLIC SMALL LETTER VE 0x2754=>0x0433, # CYRILLIC SMALL LETTER GHE 0x2755=>0x0434, # CYRILLIC SMALL LETTER DE 0x2756=>0x0435, # CYRILLIC SMALL LETTER IE 0x2757=>0x0451, # CYRILLIC SMALL LETTER IO 0x2758=>0x0436, # CYRILLIC SMALL LETTER ZHE 0x2759=>0x0437, # CYRILLIC SMALL LETTER ZE 0x275A=>0x0438, # CYRILLIC SMALL LETTER I 0x275B=>0x0439, # CYRILLIC SMALL LETTER SHORT I 0x275C=>0x043A, # CYRILLIC SMALL LETTER KA 0x275D=>0x043B, # CYRILLIC SMALL LETTER EL 0x275E=>0x043C, # CYRILLIC SMALL LETTER EM 0x275F=>0x043D, # CYRILLIC SMALL LETTER EN 0x2760=>0x043E, # CYRILLIC SMALL LETTER O 0x2761=>0x043F, # CYRILLIC SMALL LETTER PE 0x2762=>0x0440, # CYRILLIC SMALL LETTER ER 0x2763=>0x0441, # CYRILLIC SMALL LETTER ES 0x2764=>0x0442, # CYRILLIC SMALL LETTER TE 0x2765=>0x0443, # CYRILLIC SMALL LETTER U 0x2766=>0x0444, # CYRILLIC SMALL LETTER EF 0x2767=>0x0445, # CYRILLIC SMALL LETTER HA 0x2768=>0x0446, # CYRILLIC SMALL LETTER TSE 0x2769=>0x0447, # CYRILLIC SMALL LETTER CHE 0x276A=>0x0448, # CYRILLIC SMALL LETTER SHA 0x276B=>0x0449, # CYRILLIC SMALL LETTER SHCHA 0x276C=>0x044A, # CYRILLIC SMALL LETTER HARD SIGN 0x276D=>0x044B, # CYRILLIC SMALL LETTER YERU 0x276E=>0x044C, # CYRILLIC SMALL LETTER SOFT SIGN 0x276F=>0x044D, # CYRILLIC SMALL LETTER E 0x2770=>0x044E, # CYRILLIC SMALL LETTER YU 0x2771=>0x044F, # CYRILLIC SMALL LETTER YA 0x2821=>0x0101, # LATIN SMALL LETTER A WITH MACRON 0x2822=>0x00E1, # LATIN SMALL LETTER A WITH ACUTE 0x2823=>0x01CE, # LATIN SMALL LETTER A WITH CARON 0x2824=>0x00E0, # LATIN SMALL LETTER A WITH GRAVE 0x2825=>0x0113, # LATIN SMALL LETTER E WITH MACRON 0x2826=>0x00E9, # LATIN SMALL LETTER E WITH ACUTE 0x2827=>0x011B, # LATIN SMALL LETTER E WITH CARON 0x2828=>0x00E8, # LATIN SMALL LETTER E WITH GRAVE 0x2829=>0x012B, # LATIN SMALL LETTER I WITH MACRON 0x282A=>0x00ED, # LATIN SMALL LETTER I WITH ACUTE 0x282B=>0x01D0, # LATIN SMALL LETTER I WITH CARON 0x282C=>0x00EC, # LATIN SMALL LETTER I WITH GRAVE 0x282D=>0x014D, # LATIN SMALL LETTER O WITH MACRON 0x282E=>0x00F3, # LATIN SMALL LETTER O WITH ACUTE 0x282F=>0x01D2, # LATIN SMALL LETTER O WITH CARON 0x2830=>0x00F2, # LATIN SMALL LETTER O WITH GRAVE 0x2831=>0x016B, # LATIN SMALL LETTER U WITH MACRON 0x2832=>0x00FA, # LATIN SMALL LETTER U WITH ACUTE 0x2833=>0x01D4, # LATIN SMALL LETTER U WITH CARON 0x2834=>0x00F9, # LATIN SMALL LETTER U WITH GRAVE 0x2835=>0x01D6, # LATIN SMALL LETTER U WITH DIAERESIS AND MACRON 0x2836=>0x01D8, # LATIN SMALL LETTER U WITH DIAERESIS AND ACUTE 0x2837=>0x01DA, # LATIN SMALL LETTER U WITH DIAERESIS AND CARON 0x2838=>0x01DC, # LATIN SMALL LETTER U WITH DIAERESIS AND GRAVE 0x2839=>0x00FC, # LATIN SMALL LETTER U WITH DIAERESIS 0x283A=>0x00EA, # LATIN SMALL LETTER E WITH CIRCUMFLEX 0x2845=>0x3105, # BOPOMOFO LETTER B 0x2846=>0x3106, # BOPOMOFO LETTER P 0x2847=>0x3107, # BOPOMOFO LETTER M 0x2848=>0x3108, # BOPOMOFO LETTER F 0x2849=>0x3109, # BOPOMOFO LETTER D 0x284A=>0x310A, # BOPOMOFO LETTER T 0x284B=>0x310B, # BOPOMOFO LETTER N 0x284C=>0x310C, # BOPOMOFO LETTER L 0x284D=>0x310D, # BOPOMOFO LETTER G 0x284E=>0x310E, # BOPOMOFO LETTER K 0x284F=>0x310F, # BOPOMOFO LETTER H 0x2850=>0x3110, # BOPOMOFO LETTER J 0x2851=>0x3111, # BOPOMOFO LETTER Q 0x2852=>0x3112, # BOPOMOFO LETTER X 0x2853=>0x3113, # BOPOMOFO LETTER ZH 0x2854=>0x3114, # BOPOMOFO LETTER CH 0x2855=>0x3115, # BOPOMOFO LETTER SH 0x2856=>0x3116, # BOPOMOFO LETTER R 0x2857=>0x3117, # BOPOMOFO LETTER Z 0x2858=>0x3118, # BOPOMOFO LETTER C 0x2859=>0x3119, # BOPOMOFO LETTER S 0x285A=>0x311A, # BOPOMOFO LETTER A 0x285B=>0x311B, # BOPOMOFO LETTER O 0x285C=>0x311C, # BOPOMOFO LETTER E 0x285D=>0x311D, # BOPOMOFO LETTER EH 0x285E=>0x311E, # BOPOMOFO LETTER AI 0x285F=>0x311F, # BOPOMOFO LETTER EI 0x2860=>0x3120, # BOPOMOFO LETTER AU 0x2861=>0x3121, # BOPOMOFO LETTER OU 0x2862=>0x3122, # BOPOMOFO LETTER AN 0x2863=>0x3123, # BOPOMOFO LETTER EN 0x2864=>0x3124, # BOPOMOFO LETTER ANG 0x2865=>0x3125, # BOPOMOFO LETTER ENG 0x2866=>0x3126, # BOPOMOFO LETTER ER 0x2867=>0x3127, # BOPOMOFO LETTER I 0x2868=>0x3128, # BOPOMOFO LETTER U 0x2869=>0x3129, # BOPOMOFO LETTER IU 0x2924=>0x2500, # BOX DRAWINGS LIGHT HORIZONTAL 0x2925=>0x2501, # BOX DRAWINGS HEAVY HORIZONTAL 0x2926=>0x2502, # BOX DRAWINGS LIGHT VERTICAL 0x2927=>0x2503, # BOX DRAWINGS HEAVY VERTICAL 0x2928=>0x2504, # BOX DRAWINGS LIGHT TRIPLE DASH HORIZONTAL 0x2929=>0x2505, # BOX DRAWINGS HEAVY TRIPLE DASH HORIZONTAL 0x292A=>0x2506, # BOX DRAWINGS LIGHT TRIPLE DASH VERTICAL 0x292B=>0x2507, # BOX DRAWINGS HEAVY TRIPLE DASH VERTICAL 0x292C=>0x2508, # BOX DRAWINGS LIGHT QUADRUPLE DASH HORIZONTAL 0x292D=>0x2509, # BOX DRAWINGS HEAVY QUADRUPLE DASH HORIZONTAL 0x292E=>0x250A, # BOX DRAWINGS LIGHT QUADRUPLE DASH VERTICAL 0x292F=>0x250B, # BOX DRAWINGS HEAVY QUADRUPLE DASH VERTICAL 0x2930=>0x250C, # BOX DRAWINGS LIGHT DOWN AND RIGHT 0x2931=>0x250D, # BOX DRAWINGS DOWN LIGHT AND RIGHT HEAVY 0x2932=>0x250E, # BOX DRAWINGS DOWN HEAVY AND RIGHT LIGHT 0x2933=>0x250F, # BOX DRAWINGS HEAVY DOWN AND RIGHT 0x2934=>0x2510, # BOX DRAWINGS LIGHT DOWN AND LEFT 0x2935=>0x2511, # BOX DRAWINGS DOWN LIGHT AND LEFT HEAVY 0x2936=>0x2512, # BOX DRAWINGS DOWN HEAVY AND LEFT LIGHT 0x2937=>0x2513, # BOX DRAWINGS HEAVY DOWN AND LEFT 0x2938=>0x2514, # BOX DRAWINGS LIGHT UP AND RIGHT 0x2939=>0x2515, # BOX DRAWINGS UP LIGHT AND RIGHT HEAVY 0x293A=>0x2516, # BOX DRAWINGS UP HEAVY AND RIGHT LIGHT 0x293B=>0x2517, # BOX DRAWINGS HEAVY UP AND RIGHT 0x293C=>0x2518, # BOX DRAWINGS LIGHT UP AND LEFT 0x293D=>0x2519, # BOX DRAWINGS UP LIGHT AND LEFT HEAVY 0x293E=>0x251A, # BOX DRAWINGS UP HEAVY AND LEFT LIGHT 0x293F=>0x251B, # BOX DRAWINGS HEAVY UP AND LEFT 0x2940=>0x251C, # BOX DRAWINGS LIGHT VERTICAL AND RIGHT 0x2941=>0x251D, # BOX DRAWINGS VERTICAL LIGHT AND RIGHT HEAVY 0x2942=>0x251E, # BOX DRAWINGS UP HEAVY AND RIGHT DOWN LIGHT 0x2943=>0x251F, # BOX DRAWINGS DOWN HEAVY AND RIGHT UP LIGHT 0x2944=>0x2520, # BOX DRAWINGS VERTICAL HEAVY AND RIGHT LIGHT 0x2945=>0x2521, # BOX DRAWINGS DOWN LIGHT AND RIGHT UP HEAVY 0x2946=>0x2522, # BOX DRAWINGS UP LIGHT AND RIGHT DOWN HEAVY 0x2947=>0x2523, # BOX DRAWINGS HEAVY VERTICAL AND RIGHT 0x2948=>0x2524, # BOX DRAWINGS LIGHT VERTICAL AND LEFT 0x2949=>0x2525, # BOX DRAWINGS VERTICAL LIGHT AND LEFT HEAVY 0x294A=>0x2526, # BOX DRAWINGS UP HEAVY AND LEFT DOWN LIGHT 0x294B=>0x2527, # BOX DRAWINGS DOWN HEAVY AND LEFT UP LIGHT 0x294C=>0x2528, # BOX DRAWINGS VERTICAL HEAVY AND LEFT LIGHT 0x294D=>0x2529, # BOX DRAWINGS DOWN LIGHT AND LEFT UP HEAVY 0x294E=>0x252A, # BOX DRAWINGS UP LIGHT AND LEFT DOWN HEAVY 0x294F=>0x252B, # BOX DRAWINGS HEAVY VERTICAL AND LEFT 0x2950=>0x252C, # BOX DRAWINGS LIGHT DOWN AND HORIZONTAL 0x2951=>0x252D, # BOX DRAWINGS LEFT HEAVY AND RIGHT DOWN LIGHT 0x2952=>0x252E, # BOX DRAWINGS RIGHT HEAVY AND LEFT DOWN LIGHT 0x2953=>0x252F, # BOX DRAWINGS DOWN LIGHT AND HORIZONTAL HEAVY 0x2954=>0x2530, # BOX DRAWINGS DOWN HEAVY AND HORIZONTAL LIGHT 0x2955=>0x2531, # BOX DRAWINGS RIGHT LIGHT AND LEFT DOWN HEAVY 0x2956=>0x2532, # BOX DRAWINGS LEFT LIGHT AND RIGHT DOWN HEAVY 0x2957=>0x2533, # BOX DRAWINGS HEAVY DOWN AND HORIZONTAL 0x2958=>0x2534, # BOX DRAWINGS LIGHT UP AND HORIZONTAL 0x2959=>0x2535, # BOX DRAWINGS LEFT HEAVY AND RIGHT UP LIGHT 0x295A=>0x2536, # BOX DRAWINGS RIGHT HEAVY AND LEFT UP LIGHT 0x295B=>0x2537, # BOX DRAWINGS UP LIGHT AND HORIZONTAL HEAVY 0x295C=>0x2538, # BOX DRAWINGS UP HEAVY AND HORIZONTAL LIGHT 0x295D=>0x2539, # BOX DRAWINGS RIGHT LIGHT AND LEFT UP HEAVY 0x295E=>0x253A, # BOX DRAWINGS LEFT LIGHT AND RIGHT UP HEAVY 0x295F=>0x253B, # BOX DRAWINGS HEAVY UP AND HORIZONTAL 0x2960=>0x253C, # BOX DRAWINGS LIGHT VERTICAL AND HORIZONTAL 0x2961=>0x253D, # BOX DRAWINGS LEFT HEAVY AND RIGHT VERTICAL LIGHT 0x2962=>0x253E, # BOX DRAWINGS RIGHT HEAVY AND LEFT VERTICAL LIGHT 0x2963=>0x253F, # BOX DRAWINGS VERTICAL LIGHT AND HORIZONTAL HEAVY 0x2964=>0x2540, # BOX DRAWINGS UP HEAVY AND DOWN HORIZONTAL LIGHT 0x2965=>0x2541, # BOX DRAWINGS DOWN HEAVY AND UP HORIZONTAL LIGHT 0x2966=>0x2542, # BOX DRAWINGS VERTICAL HEAVY AND HORIZONTAL LIGHT 0x2967=>0x2543, # BOX DRAWINGS LEFT UP HEAVY AND RIGHT DOWN LIGHT 0x2968=>0x2544, # BOX DRAWINGS RIGHT UP HEAVY AND LEFT DOWN LIGHT 0x2969=>0x2545, # BOX DRAWINGS LEFT DOWN HEAVY AND RIGHT UP LIGHT 0x296A=>0x2546, # BOX DRAWINGS RIGHT DOWN HEAVY AND LEFT UP LIGHT 0x296B=>0x2547, # BOX DRAWINGS DOWN LIGHT AND UP HORIZONTAL HEAVY 0x296C=>0x2548, # BOX DRAWINGS UP LIGHT AND DOWN HORIZONTAL HEAVY 0x296D=>0x2549, # BOX DRAWINGS RIGHT LIGHT AND LEFT VERTICAL HEAVY 0x296E=>0x254A, # BOX DRAWINGS LEFT LIGHT AND RIGHT VERTICAL HEAVY 0x296F=>0x254B, # BOX DRAWINGS HEAVY VERTICAL AND HORIZONTAL 0x3021=>0x554A, # <CJK> 0x3022=>0x963F, # <CJK> 0x3023=>0x57C3, # <CJK> 0x3024=>0x6328, # <CJK> 0x3025=>0x54CE, # <CJK> 0x3026=>0x5509, # <CJK> 0x3027=>0x54C0, # <CJK> 0x3028=>0x7691, # <CJK> 0x3029=>0x764C, # <CJK> 0x302A=>0x853C, # <CJK> 0x302B=>0x77EE, # <CJK> 0x302C=>0x827E, # <CJK> 0x302D=>0x788D, # <CJK> 0x302E=>0x7231, # <CJK> 0x302F=>0x9698, # <CJK> 0x3030=>0x978D, # <CJK> 0x3031=>0x6C28, # <CJK> 0x3032=>0x5B89, # <CJK> 0x3033=>0x4FFA, # <CJK> 0x3034=>0x6309, # <CJK> 0x3035=>0x6697, # <CJK> 0x3036=>0x5CB8, # <CJK> 0x3037=>0x80FA, # <CJK> 0x3038=>0x6848, # <CJK> 0x3039=>0x80AE, # <CJK> 0x303A=>0x6602, # <CJK> 0x303B=>0x76CE, # <CJK> 0x303C=>0x51F9, # <CJK> 0x303D=>0x6556, # <CJK> 0x303E=>0x71AC, # <CJK> 0x303F=>0x7FF1, # <CJK> 0x3040=>0x8884, # <CJK> 0x3041=>0x50B2, # <CJK> 0x3042=>0x5965, # <CJK> 0x3043=>0x61CA, # <CJK> 0x3044=>0x6FB3, # <CJK> 0x3045=>0x82AD, # <CJK> 0x3046=>0x634C, # <CJK> 0x3047=>0x6252, # <CJK> 0x3048=>0x53ED, # <CJK> 0x3049=>0x5427, # <CJK> 0x304A=>0x7B06, # <CJK> 0x304B=>0x516B, # <CJK> 0x304C=>0x75A4, # <CJK> 0x304D=>0x5DF4, # <CJK> 0x304E=>0x62D4, # <CJK> 0x304F=>0x8DCB, # <CJK> 0x3050=>0x9776, # <CJK> 0x3051=>0x628A, # <CJK> 0x3052=>0x8019, # <CJK> 0x3053=>0x575D, # <CJK> 0x3054=>0x9738, # <CJK> 0x3055=>0x7F62, # <CJK> 0x3056=>0x7238, # <CJK> 0x3057=>0x767D, # <CJK> 0x3058=>0x67CF, # <CJK> 0x3059=>0x767E, # <CJK> 0x305A=>0x6446, # <CJK> 0x305B=>0x4F70, # <CJK> 0x305C=>0x8D25, # <CJK> 0x305D=>0x62DC, # <CJK> 0x305E=>0x7A17, # <CJK> 0x305F=>0x6591, # <CJK> 0x3060=>0x73ED, # <CJK> 0x3061=>0x642C, # <CJK> 0x3062=>0x6273, # <CJK> 0x3063=>0x822C, # <CJK> 0x3064=>0x9881, # <CJK> 0x3065=>0x677F, # <CJK> 0x3066=>0x7248, # <CJK> 0x3067=>0x626E, # <CJK> 0x3068=>0x62CC, # <CJK> 0x3069=>0x4F34, # <CJK> 0x306A=>0x74E3, # <CJK> 0x306B=>0x534A, # <CJK> 0x306C=>0x529E, # <CJK> 0x306D=>0x7ECA, # <CJK> 0x306E=>0x90A6, # <CJK> 0x306F=>0x5E2E, # <CJK> 0x3070=>0x6886, # <CJK> 0x3071=>0x699C, # <CJK> 0x3072=>0x8180, # <CJK> 0x3073=>0x7ED1, # <CJK> 0x3074=>0x68D2, # <CJK> 0x3075=>0x78C5, # <CJK> 0x3076=>0x868C, # <CJK> 0x3077=>0x9551, # <CJK> 0x3078=>0x508D, # <CJK> 0x3079=>0x8C24, # <CJK> 0x307A=>0x82DE, # <CJK> 0x307B=>0x80DE, # <CJK> 0x307C=>0x5305, # <CJK> 0x307D=>0x8912, # <CJK> 0x307E=>0x5265, # <CJK> 0x3121=>0x8584, # <CJK> 0x3122=>0x96F9, # <CJK> 0x3123=>0x4FDD, # <CJK> 0x3124=>0x5821, # <CJK> 0x3125=>0x9971, # <CJK> 0x3126=>0x5B9D, # <CJK> 0x3127=>0x62B1, # <CJK> 0x3128=>0x62A5, # <CJK> 0x3129=>0x66B4, # <CJK> 0x312A=>0x8C79, # <CJK> 0x312B=>0x9C8D, # <CJK> 0x312C=>0x7206, # <CJK> 0x312D=>0x676F, # <CJK> 0x312E=>0x7891, # <CJK> 0x312F=>0x60B2, # <CJK> 0x3130=>0x5351, # <CJK> 0x3131=>0x5317, # <CJK> 0x3132=>0x8F88, # <CJK> 0x3133=>0x80CC, # <CJK> 0x3134=>0x8D1D, # <CJK> 0x3135=>0x94A1, # <CJK> 0x3136=>0x500D, # <CJK> 0x3137=>0x72C8, # <CJK> 0x3138=>0x5907, # <CJK> 0x3139=>0x60EB, # <CJK> 0x313A=>0x7119, # <CJK> 0x313B=>0x88AB, # <CJK> 0x313C=>0x5954, # <CJK> 0x313D=>0x82EF, # <CJK> 0x313E=>0x672C, # <CJK> 0x313F=>0x7B28, # <CJK> 0x3140=>0x5D29, # <CJK> 0x3141=>0x7EF7, # <CJK> 0x3142=>0x752D, # <CJK> 0x3143=>0x6CF5, # <CJK> 0x3144=>0x8E66, # <CJK> 0x3145=>0x8FF8, # <CJK> 0x3146=>0x903C, # <CJK> 0x3147=>0x9F3B, # <CJK> 0x3148=>0x6BD4, # <CJK> 0x3149=>0x9119, # <CJK> 0x314A=>0x7B14, # <CJK> 0x314B=>0x5F7C, # <CJK> 0x314C=>0x78A7, # <CJK> 0x314D=>0x84D6, # <CJK> 0x314E=>0x853D, # <CJK> 0x314F=>0x6BD5, # <CJK> 0x3150=>0x6BD9, # <CJK> 0x3151=>0x6BD6, # <CJK> 0x3152=>0x5E01, # <CJK> 0x3153=>0x5E87, # <CJK> 0x3154=>0x75F9, # <CJK> 0x3155=>0x95ED, # <CJK> 0x3156=>0x655D, # <CJK> 0x3157=>0x5F0A, # <CJK> 0x3158=>0x5FC5, # <CJK> 0x3159=>0x8F9F, # <CJK> 0x315A=>0x58C1, # <CJK> 0x315B=>0x81C2, # <CJK> 0x315C=>0x907F, # <CJK> 0x315D=>0x965B, # <CJK> 0x315E=>0x97AD, # <CJK> 0x315F=>0x8FB9, # <CJK> 0x3160=>0x7F16, # <CJK> 0x3161=>0x8D2C, # <CJK> 0x3162=>0x6241, # <CJK> 0x3163=>0x4FBF, # <CJK> 0x3164=>0x53D8, # <CJK> 0x3165=>0x535E, # <CJK> 0x3166=>0x8FA8, # <CJK> 0x3167=>0x8FA9, # <CJK> 0x3168=>0x8FAB, # <CJK> 0x3169=>0x904D, # <CJK> 0x316A=>0x6807, # <CJK> // etc etc jusqu'à la fin

---

J'ai trouvé le fichier sur un autre site car le lien que proposait le programmeur était corrompu. Le fichier gb2312.txt semble-t-il correct?

Si ces méthodes ne sont pas les bonnes, quelqu'un aurait-il une idée quant à la résolution de mon problème ?

Cordialement,

Christophe

Le developpement Unicode devait concerner PHP6.
Mais que cherches-tu a faire avec tes fonctions ?

En fait, mon site est un forum avec des utilisateurs. Dans ma base de données j'ai donc une table pour les utilisateurs. Leur pseudo peut être écris en chinois, et les messages dans le forum aussi.

Mon problème se pose lorsqu'un utilisateur va se logger ou pour toute requête dans laquelle je passe une variable dont le contenu est du chinois.

Lors de la création de l'utilisateur, son nom chinois se stocke dans la base de données en caractères unicodes (& # 23015; pour un caractère par exemple). Mais lorsque l'utilisateur tente de se logger, la variable post contient les caractères chinois (en ayant poussé mes recherches il me semble que dans la variable POST le caractère chinois se présente sous la forme : %E7%90%32 (par exemple)). Dans une requête vers la base de données, ce sont ces caractères qui sont envoyés donc étants différent de ce qui est stocké en base, le log ne fonctionne pas.

Je cherche donc à convertir ses caractères dans le format stocké en base qui à priori serait de l'unicode.

Christophe

Je viens de me rendre compte qu'il ne s'agît pas du gb2312 (du moins il me semble), mais que les caractères chinois que j'ai sont de l'UTF-8. Donc le problème change complètement il me semble. Je suis un peu perdu avec l'encodage des caractères 8O

Salut,

as tu essayé d'utiliser les fonctions mb_* et iconv ?

Tu peux tout faire en UTF8.

En effet tout doit pouvoir se faire en utf8. Ainsi je n'aurai pas besoin d'utiliser iconv, puisque toutes mes chaînes de caractères seront en utf8. J'ai changé les informations de ma base de données, entièrement en utf8_general_ci, mais le problème reste toujours le même. Pour débugger j'ai essayé d'afficher à chaque étape la chaîne de caractères envoyée et celle reçue. Celle reçue est bien la chaîne de caractères en chinois qui s'affiche correctement.

Aussi lors de son utilisation pour accéder à la base, je précise bien qu'il s'agît de l'utf8 comme ceci :

Code:

---

1 2 3 4

@$connex=mysql_connect(BDD_SERVER,BDD_LOGIN,BDD_PASS); @$ret = mysql_select_db(BDD_NAME,$connex); mysql_set_charset("utf8",$connex);

---

Voici à l'aide de Httpfox, le contenu de la variable login (3 caractères chinois tappés dans le formulaire) : login=%E5%94%90%E6%B5%B7%E9%9F%B5

Sur un autre forum, le problème a été résolu avec ca, mais pas pour moi ^^ Dommage :calim2:

Problème résolu avec la méthode suivante (en effet htmlentities ne gère que les caractères codés sur 2 bytes. Il fallait donc faire une méthode permettant de gérer sur 3 et 4 bytes comme c'est le cas pour les caractères chinois utf8) :

Code:

---

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44

// converts a UTF8-string into HTML entities // - $utf8: the UTF8-string to convert // - $encodeTags: booloean. TRUE will convert "<" to "&lt;" // - return: returns the converted HTML-string function utf8tohtml($utf8, $encodeTags) { $result = ''; for ($i = 0; $i < strlen($utf8); $i++) { $char = $utf8[$i]; $ascii = ord($char); if ($ascii < 128) { // one-byte character $result .= ($encodeTags) ? htmlentities($char) : $char; } else if ($ascii < 192) { // non-utf8 character or not a start byte } else if ($ascii < 224) { // two-byte character $result .= htmlentities(substr($utf8, $i, 2), ENT_QUOTES, 'UTF-8'); $i++; } else if ($ascii < 240) { // three-byte character $ascii1 = ord($utf8[$i+1]); $ascii2 = ord($utf8[$i+2]); $unicode = (15 & $ascii) * 4096 + (63 & $ascii1) * 64 + (63 & $ascii2); $result .= "&#$unicode;"; $i += 2; } else if ($ascii < 248) { // four-byte character $ascii1 = ord($utf8[$i+1]); $ascii2 = ord($utf8[$i+2]); $ascii3 = ord($utf8[$i+3]); $unicode = (15 & $ascii) * 262144 + (63 & $ascii1) * 4096 + (63 & $ascii2) * 64 + (63 & $ascii3); $result .= "&#$unicode;"; $i += 3; } } return $result; }

---

Merci encore

A bientôt :D

htmlentities sait gérer UTF8, il faut seulement lui indiquer l'encodage.