Skip to content
Snippets Groups Projects
  1. Oct 28, 2018
  2. Oct 07, 2018
    • Mike Pennisi's avatar
      Normalize coverage for `var` declarations · aac38cb3
      Mike Pennisi authored
      Add tests to mirror similar tests which were authored previously.
      aac38cb3
    • Mike Pennisi's avatar
      Rename and refactor tests · 6b00c8fb
      Mike Pennisi authored
      The tests for the parsing of variable declarations were expressed using
      eval. This made the tests more complex than necessary and also prevented
      the tests from providing value to ECMAScript parsers.
      
      Remove the use of eval and instead express the expectations with literal
      source text.
      6b00c8fb
  3. Jan 05, 2018
    • Mike Pennisi's avatar
      Rename negative test "phase" for parsing · 13611037
      Mike Pennisi authored
      Early errors may result from parsing the source text of a test file, but
      they may also result from parsing some other source text as referenced
      through the ES2015 module syntax. The latter form of early error is not
      necessarily detectable by ECMAScript parsers, however. Because of this,
      the label "early" is not sufficiently precise for all Test262 consumers
      to correctly interpret all tests.
      
      Update the "phase" name of "early" to "parse" for all those negative
      tests that describe errors resulting from parsing of the file's source
      text directly. A forthcoming commit will update the remaining tests to
      use a "phase" name that is more specific to module resolution.
      13611037
  4. Jun 28, 2017
  5. Oct 19, 2016
    • Mike Pennisi's avatar
      Remove "NotEarlyError" object · ade6d2e3
      Mike Pennisi authored
      Because expectations regarding error "phase" are now expressed via test
      meta-data, the test runner may now enforce this requirement on negative
      tests.
      
      Remove the "NotEarlyError" from the project source. This reduces the
      amount of domain knowledge required to author tests and lessens the
      potential for inconsistencies between tests.
      ade6d2e3
    • Mike Pennisi's avatar
      Re-format tests for SyntaxErrors · 7d4b1d28
      Mike Pennisi authored
      Authored via the following command:
      
         $ find test -type f -print0 | \
             xargs -0 sed \
               -i 's/^\(\s*\)negative:\s*SyntaxError\s*$/\1negative:\n\1  phase: early\n\1  type: SyntaxError/g'
      7d4b1d28
  6. Jul 17, 2015
  7. Jun 18, 2015
    • Mike Pennisi's avatar
      Update handling of directive prologues · 29ecced6
      Mike Pennisi authored
      Some tests specifically concern the application of the `use strict`
      directive as it appears in JavaScript source code. These tests should
      *not* be run with the `onlyStrict` flag because relying on the test
      runner to enable strict mode makes the semantics of the source code
      irrelevant. Update these tests to use the `noStrict` flag.
      
      Other tests concern language semantics that are only valid in strict
      mode, but the mechanism for enabling strictness is inconseqential.
      Update these tests to use the `onlyStrict` flag and remove any redundant
      `use strict` directive prologues contained within.
      
      Still other tests are valid both within and outside of strict mode.
      In keeping with the majority of other tests, do not specify any
      restrictions on the environments in which these tests may be run.
      29ecced6
  8. Dec 07, 2014
  9. Aug 12, 2014
    • Sam Mikes's avatar
      bestPractice: supply error names to negative · 6b7e5d77
      Sam Mikes authored
      pilot directory for replacing flags: [negative] with
      negative: errorname
      
      ch07-7.2,7.3: add error names
      ch07-rest: insert error names rest of ch07
      ch08: add expected error name
      ch11: add error name to negative
      ch12: put error name in negative
      
      ch13: add error name to negative
      only one test, did it manually
      
      ch15: add error name to negative:
      
      ch07: add error name to negative
      
      these tests used flags: \n - negative and so
      were not caught by the earlier naive grep for flags: [negative]
      
      --- changes suggested by @anba
      
      bestPractice - remove added NotEarlyError
      ch07,ch11 - expect ReferenceError (req'd by ES6)
      correct test descriptions to expect ReferenceError only
      enforce parsing as block statement by adding `;`
      remove needless include of $FAIL.js
      
      effectively, a rebase of all changes onto master
      
          Merge branch 'negative-addErrorName-work' into negative-addErrorName-bestPractice
      
          Merge branch 'saved-bestPractice-negative' into negative-addErrorName-work
      
          Conflicts:
          	test/suite/ch11/11.13/11.13.2/S11.13.2_A2.2_T2.js
          	test/suite/ch12/12.1/S12.1_A4_T1.js
          	test/suite/ch12/12.5/S12.5_A2.js
      
          incorporate changes made on PR branch
      
          re-remove added NotEarlyError
      
          Merge branch 'negative-addErrorName-work' into negative-addErrorName-bestPractice
      
          Conflicts:
          	test/suite/ch11/11.13/11.13.2/S11.13.2_A2.2_T2.js
          	test/suite/ch12/12.1/S12.1_A4_T1.js
          	test/suite/ch12/12.5/S12.5_A2.js
      
          ch15: correct negative regexes
      
          ch10: avoid use of not-NotEarlyError regex
      
          ch14 error regexps
      
          ch13 error regexps
      
          ch12: negative error matching
      
          Merge branch 'console-runner-checkError' into negative-addErrorName-work
      
          test262.py: check negative tests with regex
      
          implement checking of negative tests =>
      
          negative: SyntaxError
      
          means that /SyntaxError/ must match stderr
          or test is reported as failure
      
          Fixes #78
      
          expect real errors
      
          bestPractice: supply error names to negative
      
          pilot directory for replacing flags: [negative] with
          negative: errorname
      
          ch07-7.2,7.3: add error names
          ch07-rest: insert error names rest of ch07
          ch08: add expected error name
          ch11: add error name to negative
          ch12: put error name in negative
      
          ch13: add error name to negative
          only one test, did it manually
      
          ch15: add error name to negative:
      
          ch07: add error name to negative
      
          these tests used flags: \n - negative and so
          were not caught by the earlier naive grep for flags: [negative]
      
          --- changes suggested by @anba
      
          bestPractice - remove added NotEarlyError
          ch07,ch11 - expect ReferenceError (req'd by ES6)
          correct test descriptions to expect ReferenceError only
          enforce parsing as block statement by adding `;`
          remove needless include of $FAIL.js
      
          Merge branch 'negative-addErrorName-work' into negative-addErrorName-bestPractice
      
          resolved Conflicts:
          	test/suite/ch07/7.9/S7.9_A5.7_T1.js
          	test/suite/ch11/11.13/11.13.1/S11.13.1_A2.1_T3.js
          	test/suite/ch11/11.13/11.13.2/S11.13.2_A2.2_T1.js
          	test/suite/ch11/11.13/11.13.2/S11.13.2_A2.2_T10.js
          	test/suite/ch11/11.13/11.13.2/S11.13.2_A2.2_T11.js
          	test/suite/ch11/11.13/11.13.2/S11.13.2_A2.2_T2.js
          	test/suite/ch11/11.13/11.13.2/S11.13.2_A2.2_T3.js
          	test/suite/ch11/11.13/11.13.2/S11.13.2_A2.2_T4.js
          	test/suite/ch11/11.13/11.13.2/S11.13.2_A2.2_T5.js
          	test/suite/ch11/11.13/11.13.2/S11.13.2_A2.2_T6.js
          	test/suite/ch11/11.13/11.13.2/S11.13.2_A2.2_T7.js
          	test/suite/ch11/11.13/11.13.2/S11.13.2_A2.2_T8.js
          	test/suite/ch11/11.13/11.13.2/S11.13.2_A2.2_T9.js
          	test/suite/ch11/11.3/11.3.1/S11.3.1_A2.1_T3.js
          	test/suite/ch11/11.3/11.3.2/S11.3.2_A2.1_T3.js
          	test/suite/ch11/11.4/11.4.4/S11.4.4_A2.1_T3.js
          	test/suite/ch11/11.4/11.4.5/S11.4.5_A2.1_T3.js
          	test/suite/ch12/12.5/S12.5_A2.js
          	test/suite/ch12/12.6/12.6.3/S12.6.3_A4_T2.js
      
          negative: second half of @anba notes
      
          correct test descriptions to expect ReferenceError only
          enforce parse as block statement by adding `;`
          remove needless include of $FAIL.js
      
          ch12: specify type
      
          negative: @anba fixes
      
          bestPractice - remove added NotEarlyError
          ch07,ch11 - expect ReferenceError (req'd by ES6)
      
          bestPractice: supply error names to negative
      
          pilot directory for replacing flags: [negative] with
          negative: errorname
      
          ch07-7.2,7.3: add error names
          ch07-rest: insert error names rest of ch07
          ch08: add expected error name
          ch11: add error name to negative
          ch12: put error name in negative
      
          ch13: add error name to negative
          only one test, did it manually
      
          ch15: add error name to negative:
      
          ch07: add error name to negative
      
          these tests used flags: \n - negative and so
          were not caught by the earlier naive grep for flags: [negative]
      
          expect a SyntaxError
      
          ch07: add error name to negative
      
          these tests used flags: \n - negative and so
          were not caught by the earlier naive grep for flags: [negative]
      
          ch15: add error name to negative:
      
          ch13: add error name to negative
      
          only one test, did it manually
      
          ch12: put error name in negative
      
          ch11: add error name to negative
      
          ch08: add expected error name
          ch07-rest: insert error names rest of ch07
      
          ch07-7.2,7.3: add error names
      
          negative-errorname: pilot
      
          pilot directory for replacing flags: [negative] with
          negative: errorname
      
          bestPractice: supply error names to negative
      
      bestPractice: supply error names to negative
      
      pilot directory for replacing flags: [negative] with
      negative: errorname
      
      ch07-7.2,7.3: add error names
      ch07-rest: insert error names rest of ch07
      ch08: add expected error name
      ch11: add error name to negative
      ch12: put error name in negative
      
      ch13: add error name to negative
      only one test, did it manually
      
      ch15: add error name to negative:
      
      ch07: add error name to negative
      
      these tests used flags: \n - negative and so
      were not caught by the earlier naive grep for flags: [negative]
      
      bestPractice: supply error names to negative
      
      negative-errorname: pilot
      
      pilot directory for replacing flags: [negative] with
      negative: errorname
      
      ch07-7.2,7.3: add error names
      
      ch07-rest: insert error names rest of ch07
      
      ch08: add expected error name
      
      ch11: add error name to negative
      
      ch12: put error name in negative
      
      ch13: add error name to negative
      
      only one test, did it manually
      
      ch15: add error name to negative:
      
      ch07: add error name to negative
      
      these tests used flags: \n - negative and so
      were not caught by the earlier naive grep for flags: [negative]
      
      expect a SyntaxError
      
      negative: @anba fixes
      
      bestPractice - remove added NotEarlyError
      ch07,ch11 - expect ReferenceError (req'd by ES6)
      
      ch12: specify type
      
      negative: second half of @anba notes
      
      correct test descriptions to expect ReferenceError only
      enforce parse as block statement by adding `;`
      remove needless include of $FAIL.js
      
      expect real errors
      
      ch12: negative error matching
      
      ch13 error regexps
      
      ch14 error regexps
      
      add "description" header back
      
      remove now-unused includes
      
      remove needless include
      6b7e5d77
  10. Jul 30, 2014
    • Brian Terlson's avatar
      Add path attribute. · 0defa373
      Brian Terlson authored
      0defa373
    • Brian Terlson's avatar
      Normalize testcase format · d4354d14
      Brian Terlson authored
      This commit normalizes the test case format used across test262. It applies the following transformations:
      
      * Convert to YAML for frontmatter
      * Remove of trailing whitespace
      * Replace /r/n with /n except in chapters 6 and 7.
      * Copyright header always uses // comments
      * new includes attribute replaces $INCLUDE
      * No implicit assumptions about test environment other than $ERROR. Everything else appears in the include array. This includes "runTestCase" which is now included in a substantial number of tests.
      d4354d14
  11. Feb 29, 2012
  12. Feb 07, 2012
  13. Nov 04, 2011
  14. Sep 26, 2011
  15. Sep 25, 2011
  16. Sep 24, 2011
  17. Sep 23, 2011
  18. Sep 14, 2011
Loading