1# Copyright 2009 the V8 project authors. All rights reserved. 2# Redistribution and use in source and binary forms, with or without 3# modification, are permitted provided that the following conditions are 4# met: 5# 6# * Redistributions of source code must retain the above copyright 7# notice, this list of conditions and the following disclaimer. 8# * Redistributions in binary form must reproduce the above 9# copyright notice, this list of conditions and the following 10# disclaimer in the documentation and/or other materials provided 11# with the distribution. 12# * Neither the name of Google Inc. nor the names of its 13# contributors may be used to endorse or promote products derived 14# from this software without specific prior written permission. 15# 16# THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS 17# "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT 18# LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR 19# A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT 20# OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, 21# SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT 22# LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, 23# DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY 24# THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT 25# (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE 26# OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. 27 28prefix es5conform 29def UNIMPLEMENTED = PASS || FAIL 30def FAIL_OK = FAIL, OKAY 31 32 33############################################################################## 34# Non UTF8 characters in test files. 35chapter10/10.4/10.4.2/10.4.2-3-c-2-s: FAIL_OK 36chapter10/10.4/10.4.2/10.4.2-3-c-1-s: FAIL_OK 37chapter10/10.4/10.4.2/10.4.2-2-c-1: FAIL_OK 38 39# We do not implement the error chekcs specified in the production rules 40# of 11.1.5 (Object initializer). 41# We are compatible with Safari and Firefox. 42chapter11/11.1/11.1.5: UNIMPLEMENTED 43 44# Our Function object has an "arguments" property which is used as a 45# non-property in the test. 46chapter15/15.2/15.2.3/15.2.3.3/15.2.3.3-4-183: FAIL_OK 47 48# Our Function object has a "caller" property which is used as a 49# non-property in in the test. 50chapter15/15.2/15.2.3/15.2.3.3/15.2.3.3-4-184: FAIL_OK 51 52# Our function object has a name property which is used as a 53# non-property in the test. 54chapter15/15.2/15.2.3/15.2.3.3/15.2.3.3-4-188: FAIL_OK 55 56# NOT IMPLEMENTED: RegExp.prototype.source 57chapter15/15.2/15.2.3/15.2.3.3/15.2.3.3-4-212: UNIMPLEMENTED 58 59# NOT IMPLEMENTED: RegExp.prototype.global 60chapter15/15.2/15.2.3/15.2.3.3/15.2.3.3-4-213: UNIMPLEMENTED 61 62# NOT IMPLEMENTED: RegExp.prototype.ignoreCase 63chapter15/15.2/15.2.3/15.2.3.3/15.2.3.3-4-214: UNIMPLEMENTED 64 65# NOT IMPLEMENTED: RegExp.prototype.multiline 66chapter15/15.2/15.2.3/15.2.3.3/15.2.3.3-4-215: UNIMPLEMENTED 67 68# All of the tests below marked SUBSETFAIL (in 15.2.3.4) fail because 69# the tests assumes that objects can not have more properties 70# than those described in the spec - but according to spec they can 71# have additional properties. 72# All compareArray calls in these tests could be exchanged with a 73# isSubsetOfArray call (I will upload a patch to the es5conform site). 74 75# SUBSETFAIL 76chapter15/15.2/15.2.3/15.2.3.4/15.2.3.4-4-1: FAIL_OK 77 78# SUBSETFAIL + we do not implement all methods on Object. 79chapter15/15.2/15.2.3/15.2.3.4/15.2.3.4-4-2: FAIL_OK 80 81# SUBSETFAIL 82chapter15/15.2/15.2.3/15.2.3.4/15.2.3.4-4-3: FAIL_OK 83 84# SUBSETFAIL 85chapter15/15.2/15.2.3/15.2.3.4/15.2.3.4-4-4: FAIL_OK 86 87# SUBSETFAIL 88chapter15/15.2/15.2.3/15.2.3.4/15.2.3.4-4-5: FAIL_OK 89 90# SUBSETFAIL 91chapter15/15.2/15.2.3/15.2.3.4/15.2.3.4-4-6: FAIL_OK 92 93# SUBSETFAIL 94chapter15/15.2/15.2.3/15.2.3.4/15.2.3.4-4-7: FAIL_OK 95 96# SUBSETFAIL 97chapter15/15.2/15.2.3/15.2.3.4/15.2.3.4-4-11: FAIL_OK 98 99# SUBSETFAIL 100chapter15/15.2/15.2.3/15.2.3.4/15.2.3.4-4-14: FAIL_OK 101 102# EvalError.prototype does not have message property. 103chapter15/15.2/15.2.3/15.2.3.4/15.2.3.4-4-15: FAIL 104 105# Rangeerror.prototype does not have message property. 106chapter15/15.2/15.2.3/15.2.3.4/15.2.3.4-4-16: FAIL 107 108# ReferenceError.prototype does not have message property. 109chapter15/15.2/15.2.3/15.2.3.4/15.2.3.4-4-17: FAIL 110 111# SyntaxError.prototype does not have message property. 112chapter15/15.2/15.2.3/15.2.3.4/15.2.3.4-4-18: FAIL 113 114# TypeError.prototype does not have message property. 115chapter15/15.2/15.2.3/15.2.3.4/15.2.3.4-4-19: FAIL 116 117# URIError.prototype does not have message property. 118chapter15/15.2/15.2.3/15.2.3.4/15.2.3.4-4-20: FAIL 119 120# SUBSETFAIL 121chapter15/15.2/15.2.3/15.2.3.4/15.2.3.4-4-22: FAIL_OK 122 123# SUBSETFAIL 124chapter15/15.2/15.2.3/15.2.3.4/15.2.3.4-4-23: FAIL_OK 125 126# SUBSETFAIL 127chapter15/15.2/15.2.3/15.2.3.4/15.2.3.4-4-24: FAIL_OK 128 129# SUBSETFAIL 130chapter15/15.2/15.2.3/15.2.3.4/15.2.3.4-4-25: FAIL_OK 131 132# SUBSETFAIL 133chapter15/15.2/15.2.3/15.2.3.4/15.2.3.4-4-26: FAIL_OK 134 135# SUBSETFAIL 136chapter15/15.2/15.2.3/15.2.3.4/15.2.3.4-4-27: FAIL_OK 137 138# SUBSETFAIL 139chapter15/15.2/15.2.3/15.2.3.4/15.2.3.4-4-28: FAIL_OK 140 141# SUBSETFAIL 142chapter15/15.2/15.2.3/15.2.3.4/15.2.3.4-4-29: FAIL_OK 143 144# SUBSETFAIL 145chapter15/15.2/15.2.3/15.2.3.4/15.2.3.4-4-30: FAIL_OK 146 147# SUBSETFAIL 148chapter15/15.2/15.2.3/15.2.3.4/15.2.3.4-4-31: FAIL_OK 149 150# SUBSETFAIL 151chapter15/15.2/15.2.3/15.2.3.4/15.2.3.4-4-32: FAIL_OK 152 153# SUBSETFAIL 154chapter15/15.2/15.2.3/15.2.3.4/15.2.3.4-4-33: FAIL_OK 155 156# SUBSETFAIL 157chapter15/15.2/15.2.3/15.2.3.4/15.2.3.4-4-34: FAIL_OK 158 159# SUBSETFAIL 160chapter15/15.2/15.2.3/15.2.3.4/15.2.3.4-4-35: FAIL_OK 161 162# Bad test - the test at the end should be "i === true". 163chapter15/15.4/15.4.4/15.4.4.17/15.4.4.17-8-10: FAIL_OK 164 165# Bad test - according to spec some returns a Boolean, not a number. 166chapter15/15.4/15.4.4/15.4.4.17/15.4.4.17-4-9: FAIL_OK 167 168# Bad test - uses unitialized variable a in precondition check. 169chapter15/15.4/15.4.4/15.4.4.19/15.4.4.19-9-3: FAIL_OK 170 171# We do not implement Array mapping functions correctly if array 172# entries are added for nonexistent entries smaller than length by 173# the callback function. We are compatible with JSC. 174# See http://code.google.com/p/v8/issues/detail?id=755 175chapter15/15.4/15.4.4/15.4.4.22/15.4.4.22-9-1: FAIL_OK 176 177# Bad tests, path in test file is wrong. This will crash the test 178# script so we mark it SKIP. 179chapter15/15.4/15.4.4/15.4.4.22/15.4.4.22-9-c-ii-4: SKIP 180chapter15/15.4/15.4.4/15.4.4.22/15.4.4.22-9-c-ii-4-s: SKIP 181 182# Bad test - deleting the property on o in callbackfn will 183# have no effect on the actual array on which reduceRight is called. 184chapter15/15.4/15.4.4/15.4.4.22/15.4.4.22-9-7: FAIL_OK 185 186############################################################################## 187# Unimplemented parts of strict mode 188# Setting expectations to fail only so that the tests trigger as soon as 189# the strict mode feature gets implemented 190 191# A directive preceeding an 'use strict' directive may not contain 192# an OctalEscapeSequence 193# Incorrect test - need double escape in eval. 194chapter07/7.8/7.8.4/7.8.4-1-s: FAIL 195 196# arguments.caller is non-configurable in strict mode 197# Invalid test case. Checks for "writable == true" and presence of "put".. 198chapter10/10.6/10.6-13-b-3-s: FAIL 199# arguments.callee is non-configurable in strict mode 200# Invalid test case. Checks for "put" property accessor. 201chapter10/10.6/10.6-13-c-3-s: FAIL 202 203# simple assignment throws TypeError if LeftHandSide is a property reference 204# with a primitive base value (this is undefined) 205chapter11/11.13/11.13.1/11.13.1-1-7-s: FAIL 206 207# simple assignment throws TypeError if LeftHandSide is a readonly property 208# in strict mode (Global.NaN) 209chapter11/11.13/11.13.1/11.13.1-4-2-s: FAIL 210# simple assignment throws TypeError if LeftHandSide is a readonly property 211# in strict mode (Global.Infinity) 212chapter11/11.13/11.13.1/11.13.1-4-3-s: FAIL 213# simple assignment throws TypeError if LeftHandSide is a readonly property 214# in strict mode (Global.length) 215chapter11/11.13/11.13.1/11.13.1-4-4-s: FAIL 216# simple assignment throws TypeError if LeftHandSide is a readonly property 217# in strict mode (Global.undefined) 218chapter11/11.13/11.13.1/11.13.1-4-27-s: FAIL 219 220# delete operator throws TypeError when when deleting a non-configurable 221# data property in strict mode (Global.NaN) 222# Invalid test case - "this" is not a global object within the test case. 223# (http://es5conform.codeplex.com/workitem/29151) 224chapter11/11.4/11.4.1/11.4.1-4.a-4-s: FAIL_OK 225 226# delete operator throws ReferenceError when deleting a direct reference 227# to a var in strict mode 228# Invalid test case. Test expects ReferenceError instead of SyntaxError. 229# http://es5conform.codeplex.com/workitem/29084 230chapter11/11.4/11.4.1/11.4.1-5-1-s: FAIL 231# delete operator throws ReferenceError when deleting a direct reference 232# to a function argument in strict mode 233# Invalid test case. Test expects ReferenceError instead of SyntaxError. 234# http://es5conform.codeplex.com/workitem/29084 235chapter11/11.4/11.4.1/11.4.1-5-2-s: FAIL 236# delete operator throws ReferenceError when deleting a direct reference 237# to a function name in strict mode 238# Invalid test case. Test expects ReferenceError instead of SyntaxError. 239# http://es5conform.codeplex.com/workitem/29084 240chapter11/11.4/11.4.1/11.4.1-5-3-s: FAIL 241 242# eval - a function declaring a var named 'eval' throws EvalError in strict mode 243# Invalid test case. SyntaxError should be expected instead of EvalError. 244chapter12/12.2/12.2.1/12.2.1-1-s: FAIL 245# eval - a function assigning into 'eval' throws EvalError in strict mode 246# Invalid test case. SyntaxError should be expected instead of EvalError. 247chapter12/12.2/12.2.1/12.2.1-2-s: FAIL 248# eval - a function expr declaring a var named 'eval' throws EvalError 249# in strict mode 250# Invalid test case. SyntaxError should be expected instead of EvalError. 251chapter12/12.2/12.2.1/12.2.1-3-s: FAIL 252# eval - a function expr assigning into 'eval' throws a EvalError in strict mode 253# Invalid test case. SyntaxError should be expected instead of EvalError. 254chapter12/12.2/12.2.1/12.2.1-4-s: FAIL 255# eval - a Function declaring var named 'eval' throws EvalError in strict mode 256# Invalid test case. SyntaxError should be expected instead of EvalError. 257chapter12/12.2/12.2.1/12.2.1-5-s: FAIL 258# eval - a Function assigning into 'eval' throws EvalError in strict mode 259# Invalid test case. SyntaxError should be expected instead of EvalError. 260chapter12/12.2/12.2.1/12.2.1-6-s: FAIL 261# eval - a direct eval declaring a var named 'eval' throws EvalError 262# in strict mode 263# Invalid test case. SyntaxError should be expected instead of EvalError. 264chapter12/12.2/12.2.1/12.2.1-7-s: FAIL 265# eval - a direct eval assigning into 'eval' throws EvalError in strict mode 266# Invalid test case. SyntaxError should be expected instead of EvalError. 267chapter12/12.2/12.2.1/12.2.1-8-s: FAIL 268# eval - an indirect eval declaring a var named 'eval' throws EvalError 269# in strict mode 270# Invalid test case. SyntaxError should be expected instead of EvalError. 271chapter12/12.2/12.2.1/12.2.1-9-s: FAIL 272# eval - an indirect eval assigning into 'eval' throws EvalError in strict mode 273# Invalid test case. SyntaxError should be expected instead of EvalError. 274chapter12/12.2/12.2.1/12.2.1-10-s: FAIL 275 276# SyntaxError if eval used as function identifier in function declaration 277# with strict body 278# Test fails to return true on success (invalid test case). 279chapter13/13.1/13.1-3-3-s: FAIL 280# SyntaxError if eval used as function identifier in function expression 281# with strict body 282# Test fails to return true on success (invalid test case). 283chapter13/13.1/13.1-3-4-s: FAIL 284# SyntaxError if eval used as function identifier in function declaration 285# in strict code 286# Test fails to return true on success (invalid test case). 287chapter13/13.1/13.1-3-5-s: FAIL 288# SyntaxError if eval used as function identifier in function expression 289# in strict code 290# Test fails to return true on success (invalid test case). 291chapter13/13.1/13.1-3-6-s: FAIL 292# SyntaxError if arguments used as function identifier in function declaration 293# with strict body 294# Test fails to return true on success (invalid test case). 295chapter13/13.1/13.1-3-9-s: FAIL 296# SyntaxError if arguments used as function identifier in function expression 297# with strict body 298# Test fails to return true on success (invalid test case). 299chapter13/13.1/13.1-3-10-s: FAIL 300# SyntaxError if arguments used as function identifier in function declaration 301# in strict code 302# Test fails to return true on success (invalid test case). 303chapter13/13.1/13.1-3-11-s: FAIL 304# SyntaxError if arguments used as function identifier in function expression 305# in strict code 306# Test fails to return true on success (invalid test case). 307chapter13/13.1/13.1-3-12-s: FAIL 308 309# Duplicate combined parameter name allowed in Function constructor called 310# in strict mode if body not strict 311# Test fails to return true on success (invalid test case). 312chapter15/15.3/15.3.2/15.3.2.1/15.3.2.1-11-6-s: FAIL 313 314# Array.prototype.reduce - null passed as thisValue to strict callbackfn 315# Invalid test case: http://es5conform.codeplex.com/workitem/29085 316chapter15/15.4/15.4.4/15.4.4.21/15.4.4.21-9-c-ii-4-s: FAIL 317