- Sep 09, 2011
-
-
Mark Miller authored
style to append runTestCase(funcName); rather than assertTrue(funcName.call(this)), giving the testing framework more control.
-
- Sep 08, 2011
-
-
Mark Miller authored
-
Mark Miller authored
morning. The rewrite of "function testcase()..." now puts the assertTrue at the bottom. Preconditions, names, and ids are removed. And the path in the file is ignored, and is instead set accurately according to where the file is found.
-
- Sep 07, 2011
-
-
Mark Miller authored
-
Mark Miller authored
-
- Jun 30, 2011
-
-
David Fugate authored
-
David Fugate authored
host objects (which make them invalid for test262). Using this, I found one benign 'alert' usage (it was never even called) and removed it.
-
- Jun 29, 2011
-
-
David Fugate authored
New Sputnik 'negative' metadata that included exception type was causing problems for SputnikConverter. Took the easy fix and split the metadata into two: 'negative' and 'errortype'.
-
- Jun 02, 2011
-
-
David Fugate authored
this module in two such that the configuration of the test case packaging tool is separate from the implementation.
-
- Apr 20, 2011
-
-
David Fugate authored
tests covering a given chapter, N, without delving into subsections. This in turn broken the Results page which was by default displaying individual results for chapters 13(.0) and 14(.0). Fixed.
-
David Fugate authored
'GlobalScope' directory.
-
David Fugate authored
directory next* SputnikConverter: - ES5TestCase.cs * Case of JSON-based property names was wrong. Fixed * Use the tests' 'id' instead of 'path' as the GlobalScopeTests keys * Added 'id' and 'path' as Global Scope test metadata. The correct/clean solution here is to simply use 'path' as the key to GlobalScopeTests, but this refactoring needs to be undertaken later when we can convert the 'normal' test cases over to use 'path' as the key as well * Turns out we cannot depend on the message received by window.onerror to have some form of "syntax" contained within it. Instead, we'll just rely on the regular expression ".", matches any one character, for the short term - SputnikTestCase.cs * Same case issue as for ES5TestCases.cs * Don't trust the Sputnik metadata for the ES5 section name or even test case id to be correct. Instead, generate this information from the file path of the test case TestCasePackager.py: - added a new global, GLOBAL_SCOPE_FILES, which is a list of JS files found directly under test\suite\*.js which include metadata for so-called globally scoped tests. These files are imported directly by the HTML test harness test\suite\*: - regenerated Sputnik tests based on new converter default.html: - import SputnikGlobalScope.js. Really TestCasePackager.py should generate the global scope imports to default.html automatically... website\resources\scripts\testcases\*: - test cases have shuffled from existing *.json files into globalscope.json
-
- Apr 19, 2011
-
-
David Fugate authored
- restructured the generated GlobalScope.js file such that the HTML test harness can import multiple such files without worrying about one blowing aways another's metadata - inline with the last change, GlobalScope.js has been renamed to SputnikGlobalScope.js and generated directly to test\suite\* - the path and ID properties for most entries in GlobalScope.js were incorrect. That is, they were based on the metadata contained in the original Sputnik tests and not the new test262 directories and filenames - generate global scope tests to test\suite\GlobalScope\* instead of test\suite\sputnik_converted\GlobalScope\*. Going forward we need to move towards integrating all test sources into test262 directories (e.g., "GlobalScope"===good; "Sputnik\GlobalScope"===not-so-good) - a few hacks to the sources (e.g., private vars to public vars) I'll fix in a refactoring later. Just trying to get everything working first
-
- Apr 08, 2011
-
-
David Fugate authored
Still needs a bit of integration work into the test harness. A number of Sputnik tests were written outside the context of a chapter's sections. E.g., "Chapter 13" versus "Chapter 13, Section 1". We now fake a section number ("13.0" for the example above) for such cases when generating test case metadata.
-
- Apr 07, 2011
-
-
David Fugate authored
Renamed move_test.py to FixTestCasePlacement.py. Still a work in progress.
-
- Mar 30, 2011
-
-
David Fugate authored
their test case objects. Created an automated tool, FixPathsAndIds.py, to fix these. TestCasePackager.py no longer throws when it encounters a non-*.js file where it expects test cases. Instead, it simply ignores it.
-
- Mar 23, 2011
-
-
David Fugate authored
-
David Fugate authored
-
David Fugate authored
module is now utilized.
-
David Fugate authored
rationale behind the addition of this file is it's meant to replace TestCasePackager.ps1 outright and will be runnable on all major operating systems. There's still a bit of cleanup work needed as the Python port was hardly optimized for the language. A few side effects of this change: - it now takes under ten seconds to generate the test262 website (PS version was taking over a minute) - generated *.json files are ~5% smaller in size (PS was forcing '\r\n' and the Python version preserves the tests' newlines whether they're '\r\n' or '\n')
-
- Mar 11, 2011
-
-
David Fugate authored
-
- Mar 02, 2011
-
-
David Fugate authored
to the following criteria: 1. If a test case directory directly contains *.js files at the root level, package the entire directory as an XML regardless of how many *.js files are in subdirectories 2. If the directory and subdirectories contain less than 1,000 test cases, package the entire directory as an XML. Otherwise... 3. Perform steps 1 and 2 on each subdirectory of the directory The net effect of this change is that no test case XMLs are larger than 1.5 megs any longer, although the total number of test XMLs has jumped from about a dozen to ~75. This should make running the test harness seem a little smoother across all browsers since we won't be blocked downloading 4 meg files for several seconds any longer.
-
- Feb 11, 2011
-
-
David Fugate authored
were actually unique across the test cases. This *was* needed prior to November as we weren't running each test case in it's own private global environment. The situation now is that we're running each test within it's own iframe => the modifications are no longer needed. Few small improvements to SputnikConverter: - App.config file locations have been fixed - template files get pushed alongside generated tool binaries - the root path for Sputnik conformance files is "Conformance", not "tests" - allow the main exe to throw exceptions so they can be properly debugged with VS
-
- Jan 14, 2011
-
-
David Fugate authored
-
- Nov 16, 2010
-
-
David Fugate authored
prior to the usage of "ES5Harness". Specifically in cases like: var abc = ...; ES5Harness.registerTest( { //...abc gets used here the declaration of "abc" would've been ripped out thereby corrupting the test. This change fixes the issue for all existing IE Test Center and Sputnik test cases. Note however that it could potentially fail for lines like this: "/*abc*/ /*". If we ever add cases including comments like this, the implementation of isTestStarted will need to be revisited. There were five such test cases that were being affected by this issue in IE Test Center's chapter 10 and 15 tests. These have all been fixed via the updated script.
-
David Fugate authored
- The only parameter required for this script is now the test suite version. All other parameters are generated relative to the location of this script - This script now generates the XML'ized test cases directly to website\resources\scripts\testcases\. Likewise, it copies the test harness taken from test\harness\* to website\resources\scripts\global\ - Added tons of error checking and we now emit the current generation status to stdout - Made the script more generic in the sense that it can take arbitrary directories under test\suite\* containing ES5 test chapters. Previous behavior was it was looking for test chapters directly under website\
-
David Fugate authored
website\* out to test\*: - Removed test\harness\ECMA-262-TOC.xml. The casing on this file was incorrect, but more importantly it's a static file not generated by the harness - Populated test\harness with the contents of website\resources\scripts\global\. In the future, we need to update test\harness\* and propagate these changes out to website\* - Test\suite\ietestcenter is now a verbatim copy of the IE Test Center tests that WERE under website\resources\scripts\testcases\* - Moved all Sputnik tests from website\resources\scripts\testcases\* out to test\suite\sputnik_converted - Moved website\resources\scripts\testcases\excludelist.xml out to test\config\*. This particular file was only used for the test conversion process to XML, and is not actually needed by the website as best as I can tell - Website\resources\scripts\testcases now only contains the XMLized test cases. This is the right thing to do as the *.js files here weren't actually being used by the website and the general public can now peruse the test cases directly via Mercurial
-
- Nov 12, 2010
-
-
David Fugate authored
which have resulted in it being able to run negative test cases which corrupt the global JavaScript environment. This lets us enable fifty plus more Sputnik test cases. Another positive result from this test harness refactoring is that Opera no longer hangs when running the tests.
-
- Nov 03, 2010
-
-
David Fugate authored
tools\TestCaseHTMLPackager\TestCasePacker.ps1: there were some improvements made to this script WRT to the processing of unicode-related test cases. tools\TestCaseHTMLPackager\TestUpdater.ps1: new script which preprocesses test cases (rips out comments, etc.) external\contributions\Microsoft\ietestcenter_ppb5\chapter11\11.4\11.4.1\11.4.1-4.a-10.js and website\resources\scripts\testcases\chapter11\11.4\11.4.1\11.4.1-4.a-10.js: cleaned up a code comment website\enginereports\sample.xml: removed website\resources\scripts\global\jquery-1.4.2.js: removed website\resources\scripts\*.ps1: moved into the tools\ directory website\Web.config: removed. This is only relevant for Windows-based hosting of test262 website\browserreport.html: removed
-
- Oct 19, 2010
-
-
David Fugate authored
- external\contributions\: test contributions to Test262 from external entities such as Microsoft and Google. This directory consists of the external tests without any modifications - test\harness\: test harness used to run Test262 tests. Presently web-based - test\suite\: suite of vendor-neutral ECMAScript test cases conforming to the ES5 spec - tools\: among other things this includes a set of tools used to convert various external test contributions to a format the Test262 test harness can consume - website\: an archived copy of the http://test262.ecmascript.org website
-