1# 2# Comments should be ignored 3# 4: Shell script launcher comment ignore 5@ DOS script launcher comment ignore 6 7 8-option key # end of line comment 9+reset imbedded#hash # <- not a comment, thought this is 10 11This\ is' a 'single" token" 12 13And\\\ \''even '\'\""more \""complex 14 15"Backslash chars \n are returned as is" 16'regardless \n of quoting' 17 18'Single quote escapes' 19\' "'" 20 21"Double quote escapes" 22\" '"' "\"" 23 24Back\ slash\ escapes 25\\ '\' "\\" # NOTE that backslash in single quotes are literial! 26 27'Space Character Escapes' 28\ ' ' " " 29 30'Empty Tokens, using quotes' 31'' "" 32 33"Unicode charcaters are handled" 34"° ' ² ³ ` ´" 35"µ ¶ ⨀ ⨁ ⨂" 36测试用的汉字 37 38Line__\ 39__Continuation 40 41"Double_Quoted_Line__\ 42__Continuation" 43 44'Single_Quoted_Line__\ 45__Continuation_NOT!' 46 47"double_quoted_newlines__ 48__are_part_of_token" 49 50'single_quoted_newlines__ 51__are_part_of_token' 52 53"Last Token before EOF" 54 55 56