2018-06-08 Jon Lee [MotionMark] Rename Suits test files https://bugs.webkit.org/show_bug.cgi?id=186447 Reviewed by Said Abou-Hallawa. * MotionMark/resources/runner/tests.js: * MotionMark/tests/master/resources/suits.js: Renamed from PerformanceTests/MotionMark/tests/master/resources/svg-particles.js. * MotionMark/tests/master/suits.html: Renamed from PerformanceTests/MotionMark/tests/master/svg-particles.html. * MotionMark/tests/svg/suits.html: 2018-06-08 Jon Lee Add sub-tests based on Suits https://bugs.webkit.org/show_bug.cgi?id=186260 Reviewed by Said Abou-Hallawa. Add a new developer Suits suite with sub-tests that isolate parts of each particle. The sub-tests are: - Particles using only clip paths - Particles using only shapes - Particles that have no gradients - Particles that have no rotation - Particles that do not move around at all (but all of the physics calculations are still performed) * MotionMark/resources/debug-runner/tests.js: * MotionMark/tests/master/resources/svg-particles.js: Rename the stage, particle, and benchmark to "Suits" from "SVG". Change SuitsParticle so that we guarantee 50% clip and shape paths rather than relying on random chance. Wrap a check around creation of the gradient element, and use a simple fill color when we aren't using a gradient. * MotionMark/tests/svg/suits.html: Added. * MotionMark/tests/svg/suits.js: Added. Look for the query string and set the particle based on what is selected. 2018-06-06 Jon Lee Allow the ramp controller to run tests that take less time than the initial ramp-up phase https://bugs.webkit.org/show_bug.cgi?id=186257 Reviewed by Said Abou-Hallawa. * MotionMark/tests/resources/main.js: Extend the desired end timestamp when ramp-up occurs. Previously the controller assumed that the duration of the test was always longer than the time it took to figure out the order of magnitude of particles to render. When that range is determined, the end timestamp is then extended. If the duration is too short, the controller would throw an exception. The fix is to continue extending the timestamp every time the order of magnitude tiers up. In general testing with really short durations isn't practical, but sometimes it is desired for debugging. To avoid confusion of the private variables, I renamed Benchmark._startTimestamp to Benchmark._benchmarkStartTimestamp, to disambiguate from Controller._startTimestamp. Benchmark._startTimestamp is set once and never changed, after the initial 100ms warm-up. Controller._startTimestamp is initialized to 0 (which means "not initialized"), and then after the warm up is complete, set in Controller.start() to the same wall clock timestamp, and never changed afterwards. 2018-06-06 Jon Lee Remove unneeded data processing in MotionMark https://bugs.webkit.org/show_bug.cgi?id=186256 Reviewed by Said Abou-Hallawa. Remove calculation of average frame rate based on multiple samples at a given complexity. It is not used in the calculation of the score, and is just extra work to do at the end of a test. * MotionMark/developer.html: Remove options to show average data and regression based on that data. * MotionMark/resources/debug-runner/graph.js: Remove data. Update the time graph that shows the relationship between the break point in the regression against the complexity graph. * MotionMark/resources/debug-runner/motionmark.css: Make the confidence intervals easier to see. * MotionMark/resources/runner/motionmark.js: Simplify score calculation now that we are only calculating regressions on the raw data. We were calculating it based on the averages, but that was just for analysis, and not used in the actual score. Get rid of the |complexitySamples| local variable. * MotionMark/resources/strings.js: Remove unneeded string constant. * MotionMark/tests/resources/main.js: (processSamples): Refactor so that more of it can be shared between Controller and RampController. It also avoids processing the raw samples (controllerSamples) twice for the ramp controller. (_processComplexitySamples): Remove logic to calculate averages based on complexity. (_processMarks): Split this out from the old processSamples. (_processControllerSamples): Split this out from the old processSamples. 2018-06-06 Jon Lee Strip out more characters when creating permalinks https://bugs.webkit.org/show_bug.cgi?id=186259 Reviewed by Said Abou-Hallawa. Tests and suites may have names that make permalinks to the tests less readable when shared. Expand the set of characters that are stripped out of the names. * MotionMark/resources/debug-runner/motionmark.js: Refactor to call stripUnwantedCharactersForURL. For existing links, decode the suite and test names. * MotionMark/resources/extensions.js: (Utilities.stripUnwantedCharactersForURL): Rename from stripNonASCIICharacters. Remove any non-alphanumeric character. 2018-06-04 Jon Lee Remove unnecessary MotionMark controllers https://bugs.webkit.org/show_bug.cgi?id=186255 Reviewed by Said Abou-Hallawa. Get rid of the ramp30 and the fixed-with-a-step controllers, which aren't used for testing or debugging. * MotionMark/developer.html: Move the "ramp" option as first, since that is the default controller for the benchmark. * MotionMark/resources/debug-runner/motionmark.js: * MotionMark/resources/runner/motionmark.js: Added missing copyright notice. * MotionMark/tests/resources/main.js: 2018-05-25 Myles C. Maxfield Improve the performance of Font::canRenderCombiningCharacterSequence() https://bugs.webkit.org/show_bug.cgi?id=185933 Reviewed by Ryosuke Niwa. * Layout/ComplexLongUnique.html: Added. 2018-05-25 Saam Barati Have a memory test where we can validate JSCs mini memory mode https://bugs.webkit.org/show_bug.cgi?id=185932 Reviewed by Mark Lam. We add a directory here with the contents of the testmem benchmark. To run it, use `Tools/Scripts/run-testmem`. To add new tests in the future, you just need to add JS files to this directory. * testmem: Added. * testmem/air.js: Added. * testmem/base64.js: Added. * testmem/basic.js: Added. * testmem/box2d.js: Added. * testmem/crypto-md5.js: Added. * testmem/date-format-tofte.js: Added. * testmem/earley-boyer.js: Added. * testmem/hash-map.js: Added. * testmem/regex-dna.js: Added. * testmem/splay.js: Added. * testmem/tagcloud.js: Added. 2018-05-22 Ryan Haddad Unreviewed, rolling out r232052. Breaks internal builds. Reverted changeset: "Use more C++17" https://bugs.webkit.org/show_bug.cgi?id=185176 https://trac.webkit.org/changeset/232052 2018-05-21 Yusuke Suzuki Use more C++17 https://bugs.webkit.org/show_bug.cgi?id=185176 Reviewed by JF Bastien. * MallocBench/MallocBench.xcodeproj/project.pbxproj: * MediaTime/Configurations/Base.xcconfig: * MediaTime/MediaTime.xcodeproj/project.pbxproj: 2018-04-30 Myles C. Maxfield Improve the performance of FontCascadeDescription's effectiveFamilies https://bugs.webkit.org/show_bug.cgi?id=184720 Reviewed by Simon Fraser. This performance test calls SystemFontDatabase::systemFontCascadeList() around 2,000,000 times (before this patch is applied), which is roughly equivalent to the page we found the performance problem on. The calling pattern is roughly equivalent in this test. * Layout/system-ui.html: Added. 2018-03-08 Antti Koivisto Update StyleBench version number in page title to 0.3 * StyleBench/index.html: There has been a bunch of changes, most notably the addition of attribute selector test step. 2018-02-16 Dean Jackson Use OPENGL macros to be more clear about which OpenGL/ES WebGL uses on Cocoa https://bugs.webkit.org/show_bug.cgi?id=182894 Reviewed by Tim Horton. Rename OPENGL_ES_2 to OPENGL_ES. * StitchMarker/wtf/Platform.h: 2018-02-09 Ryosuke Niwa Make run-perf-tests work with Speedometer 2.0 and re-enable the test https://bugs.webkit.org/show_bug.cgi?id=182088 Reviewed by Antti Koivisto. This patch updates the test harness to report new metrics of Speedometer 2.0. Replaced the total time by the geometric mean of the time spent in each suite, and added scores as a metric in addition to time. Also, updated the PerfTestRunner harness and the results template to support "Score" metric with "pt" as its unit. * Skipped: Unskipped the test. * Speedometer/resources/benchmark-report.js: (window.benchmarkClient.willStartFirstIteration..createTest): Added the unit as an optional argument to report the score in addition to time. Also report the geomean of time instead of the total time. (window.benchmarkClient.willStartFirstIteration): Report the geomean of time. (window.benchmarkClient.didRunSuites): Record the entire measuredValues instead of just tests. (window.benchmarkClient.didFinishLastIteration): Report the scores. 2018-02-09 Ross Kirsling Use REQUEST_ANIMATION_FRAME_DISPLAY_MONITOR on any non-Windows port. https://bugs.webkit.org/show_bug.cgi?id=182623 Reviewed by Alex Christensen. * StitchMarker/wtf/Platform.h: Simplify #if. 2018-02-01 Antti Koivisto StyleBench: Attribute selectors and other improvements https://bugs.webkit.org/show_bug.cgi?id=182387 Reviewed by Joseph Pecoraro. - Add some attributes to elements in all tests - Add some attribute selectors to stylesheets in all tests - Also add some * selectors to all stylesheets. - Add attribute mutation step to all suites - Make test steps do more mutations (25->100) and reduce the number of steps to keep testing time in check. Too fast steps were running into timer resolution limits. * StyleBench/resources/style-bench.js: (defaultConfiguration): (prototype.randomAttributeName): (prototype.randomAttributeValue): (prototype.randomAttributeSelector): (prototype.makeCompoundSelector): (prototype.makeElement): (prototype.addClasses): (prototype.removeClasses): (prototype.mutateAttributes): (prototype.async.runForever): * StyleBench/resources/tests.js: (makeSteps): (makeSuite): 2018-02-01 Geoffrey Garen Make MallocBench easier for non-WebKit engineers to run https://bugs.webkit.org/show_bug.cgi?id=182415 Reviewed by Saam Barati. * MallocBench/MallocBench.xcodeproj/project.pbxproj: Use c++14 so we can make_unique. Specify that we support all Darwin platforms so you can test them. * MallocBench/run-malloc-benchmarks: Specify the path to MallocBench and libmbmalloc explicitly, rather than computing them implicitly using webkitdirs. Non-WebKit folks don't have the directory structure required by webkitdirs. Remove Linux-specific and cmake-specific behaviors because we only needed them in the world of implicit path computation. 2018-01-31 Ryosuke Niwa Make run-perf-tests work with StyleBench and re-enable it https://bugs.webkit.org/show_bug.cgi?id=182322 Reviewed by Antti Koivisto. This patch updates the test harness to report new metrics of StyleBench. Replaced the total time by the geometric mean of the time spent in each suite, and added scores as a metric in addition to time. Also, updated the PerfTestRunner harness and the results template to support "Score" metric with "pt" as its unit. * Skipped: Unskipped the test. * StyleBench/resources/benchmark-report.js: (window.benchmarkClient.willStartFirstIteration..createTest): Added the unit as an optional argument to report the score in addition to time. Also report the geomean of time instead of the total time. (window.benchmarkClient.willStartFirstIteration): Report the geomean of time. (window.benchmarkClient.didRunSuites): Record the entire measuredValues instead of just tests. (window.benchmarkClient.didFinishLastIteration): Report the scores. * resources/results-template.html: Added "Score" as a metric and "pt" as its unit. * resources/runner.js: (PerfTestRunner..finish): Ditto. 2018-01-30 Ryosuke Niwa StyleBench: Generate more mutation steps https://bugs.webkit.org/show_bug.cgi?id=182291 Rubber-stamped by Antti Koivisto Use zero-based index instead of one-based index. * StyleBench/resources/tests.js: (makeSteps): 2018-01-30 Antti Koivisto StyleBench: Generate more mutation steps https://bugs.webkit.org/show_bug.cgi?id=182291 Reviewed by Ryosuke Niwa. The test should be doing multiple rounds of mutations in a single document to test what is supposed to test (like it did before r227756). This also makes test results more stable and less dependent on possible first-time costs. * StyleBench/resources/benchmark-runner.js: Adjust correctionFactor to match the new steps count. With 1.5 Firefox is ~72rpm. * StyleBench/resources/tests.js: (makeSteps): Generate 10 rounds of class/element mutation steps. Give each generated step unique name so reporting works. Make individual steps do fewer mutations. 2018-01-29 Antti Koivisto StyleBench: Remove : from a test name https://bugs.webkit.org/show_bug.cgi?id=182258 Reviewed by Ryosuke Niwa. It breaks reporting. * StyleBench/resources/style-bench.js: (nthPseudoClassConfiguration): 2018-01-29 Ryosuke Niwa Temporarily skip StyleBench until webkit.org/b/182088 is fixed. * Skipped: 2018-01-29 Ryosuke Niwa Make StyleBench compatible with run-benchmark and run-perf-tests https://bugs.webkit.org/show_bug.cgi?id=182262 Reviewed by Antti Koivisto. Copied resource files referenced from Speedometer directory since run-benchmark needs to be able to checkout each benchmark separately. Removed the code to create tests of the same name five times in makeSteps since this won't be compatible with either run-benchmark or run-perf-tests. * StyleBench/index.html: Removed the code to show warnings for local files since run-benchmark doesn't use HTTP server in WebDriver mode. * StyleBench/resources/benchmark-report.js: Copied from resources/benchmark-report.js. * StyleBench/resources/benchmark-runner.js: Copied from resources/benchmark-runner.js. (BenchmarkRunner.prototype._finalize): Use the correction factor of 8 instead of 5 in StyleBench. * StyleBench/resources/gauge.png: Copied from resources/gauge.png. * StyleBench/resources/gauge@2x.png: Copied from resources/gauge@2x.png. * StyleBench/resources/main.css: Copied from resources/main.css. * StyleBench/resources/main.js: Copied from resources/main.js. * StyleBench/resources/tests.js: (makeSteps): Only make each test once. 2018-01-26 Chris Nardi Addressing post-review comments after r226614 https://bugs.webkit.org/show_bug.cgi?id=182151 Reviewed by Myles C. Maxfield. * StitchMarker/wtf/text/StringImpl.h: (WTF::isSpaceOrNewline): * StitchMarker/wtf/text/TextBreakIterator.cpp: (WTF::numCodeUnitsInGraphemeClusters): * StitchMarker/wtf/text/TextBreakIterator.h: 2018-01-22 Antti Koivisto StyleBench: Separate test for :nth pseudo classes https://bugs.webkit.org/show_bug.cgi?id=181932 Reviewed by Sam Weinig. Optimization strategies for nth are different from other structural pseudo classes (:first-child etc). Move them to a separate test. * StyleBench/resources/style-bench.js: (structuralPseudoClassConfiguration): (nthPseudoClassConfiguration): Add a new configuration. (predefinedConfigurations): (pseudoClassConfiguration): Deleted. 2018-01-17 Ryosuke Niwa Temporarily skip Speedometer until we fix the metrics. * Skipped: 2018-01-16 Alex Christensen Fix Mac CMake build after r222900 * MallocBench/MallocBench/CMakeLists.txt: The mbmalloc target doesn't exist if we're not in developer mode, so only use it if we are. 2018-01-09 Ryosuke Niwa Speedometer 2.0: Update the About page. https://bugs.webkit.org/show_bug.cgi?id=175918 Reviewed by Keith Miller. Updated the about page for Speedometer 2.0. * Speedometer/index.html: == Rolled over to ChangeLog-2018-01-01 ==