catchpoint / webpagetest Goto Github PK

Official repository for WebPageTest

License: Other

Shell 0.01% CSS 1.60% HTML 7.02% JavaScript 45.74% Python 0.03% PHP 45.16% XSLT 0.01% Dockerfile 0.01% NASL 0.01% SCSS 0.17% Hack 0.01% C++ 0.04% Blade 0.21% Smarty 0.01%

webpagetest's Introduction

WebPageTest

This is the official repository for the performance-testing code that runs at webpagetest.org.

🥡 Install your own instance
📕 Documentation
🕒 Changelog
🌐 Cross-platform browser agent
WPT website global header repo and documentation
💤 REST API examples:
- 🐘 /bulktest: A PHP command-line tool that can submit a bulk set of tests, gather the results, and aggregate analyses.
- 🐍 /batchtool: A Python tool that can submit a bulk set of tests and gather the results.

Troubleshooting private instances

If your instance runs, but you’re having issues configuring agents, navigate to http://{your_instance’s_ip}/install to check for a valid configuration.

Testing

WebPageTest uses PHPUnit for unit tests. To set up and run the unit tests:

Install Composer
Install apcu
Add the line apc.enable_cli='on' to your php.ini
Run composer install
Run composer test

Contributing

There are separate lines of development under different licenses (pull requests accepted to either):

The master branch where most active development occurs has the Polyform Shield 1.0.0 license
The apache branch has the more permissive Apache 2.0 license

Code style

WebPageTest uses PSR12 coding conventions for PHP linting and formatting. For JavaScript and CSS formatting we use Prettier with its default configuration. Additionally we use Stylelint for CSS linting.

Before you send a pull request please make sure to run: composer lint && composer format.

Alternatively you can run

composer lint:php && composer format:php if you only touched PHP code, or
composer lint:css && composer format:prettier if you only touched CSS or JavaScript code

VSCode integration

If you use VSCode you might find it helpful to install Prettier and PHP Intelephence plugins and use these in your "settings.json":

{
  "[php]": {
    "editor.tabSize": 4
  },

  // uncomment to reformat on every file save
  //"editor.formatOnSave": true,

  "phpcs.standard": "PSR12",

  "files.trimTrailingWhitespace": true,

  "files.eol": "\n",

  "files.associations": {
    "*.inc": "php"
  }
}

webpagetest's People

Contributors

Stargazers

Watchers

Forkers

sergeychernyshev trott luckyboost marcelduran rradez ljgeneral rmcloughlin kennydee johndorn jklein klepikov atmshop afterhill patbiti dlam26 junhochoi snow8261 mtab3000 layzie fgruntjes geografo260270 the1sky woodjo andreasdriesen automationconsultant rohannog vgno ablotny web5design ottok manishshukla jimaek qz267 auduny 0x524a4b gileswells jpvincent soohyunc gobezu muc abhinavsingh giovanisp arolleston rainn mikedamm geening ahlfors guypod jeffreychung kimberlylee diervo sunnybear kconsidine lizell n1marti kxws888 dl33 sundiyone xazzz hjafari sylnp0201 freeme349 jarrodconnolly codiak6335 thammin rviscomi xiongchiamiov shchavla acemood aroben alpar pganti indian2020 romali pashanitw hermione521 troland leonlee985 ceeaspb sethblanchard testerhome itmonitoring jayakumark gburiola katosun2 charanjeet2008 kmcintyre01 lmcro dirk420 itinao guomin fiverr luisxiaomai appdynamics open-party iteraspeed hsoerensen sylvainlasnier iteratec-hh ozbillwang

webpagetest's Issues

SPDY waterfalls miss resources loaded after onload

The waterfalls below are for the same page loaded with HTTP and SPDY.

The page contains several images that are lazyloaded using JS, they appear in the HTTP waterfall but not the SPDY one

HTTP
http://www.webpagetest.org/result/130517_BG_11df71dd27c2f03d6d5806f8de22ca7a/

SPDY
http://www.webpagetest.org/result/130517_3F_ee0485bff7680fdbb909c84995e136f2/

Edit test labels after the test completes

Test labels are very useful, but it's very common that you either forget to set them when submitting a test or only realize you want one after the fact.

It'll be great to allow users to edit the labels of tests submitted by them after the test is done, even multiple times.

https://code.google.com/p/webpagetest/issues/detail?id=74

Send script console messages from firefox so that a user can see why a script failed.

Each script command signals success or failure, and a user should see what failed on the results page.

https://code.google.com/p/webpagetest/issues/detail?id=66

Add video templates for up to 5x4 or 5x5 grids

Increase the number of simultaneous videos from 9 to 25

(moved from Google Code - https://code.google.com/p/webpagetest/issues/detail?id=8 )

Chrome starting measurement prematurely

First time I have seen it but the chrome agent appears to have started measurement a full 20 seconds before actually navigating: http://www.webpagetest.org/result/120330_GT_3SFPT/

Forum thread : http://www.webpagetest.org/forums/showthread.php?tid=10949

https://code.google.com/p/webpagetest/issues/detail?id=80

Add support for clicking on anchor tags

Chrome and Firefox script commands will not follow an href if clicked because the click event itself is not enough to trigger it. It works in IE because we use a different mechanism for triggering the click.

https://code.google.com/p/webpagetest/issues/detail?id=47

Add support for nslookup debugging

Similar to tracert

https://code.google.com/p/webpagetest/issues/detail?id=79

Add support for importing tcpdump captures

Allow for pcap files to be uploaded and automate converting them to HAR's

https://code.google.com/p/webpagetest/issues/detail?id=25

Migrate IE agent to use wptdriver

Migrate the legacy IE agent to the new agent platform (need to identify the remaining feature gaps).

Known gaps:

Page Speed analysis/score
A few of the page data fields
Some script commands
Video rendering (not necessary once we move it to the server)

https://code.google.com/p/webpagetest/issues/detail?id=30

Add an "Edit and Re-run Test" option

While the re-run option is very useful, a very common need (for me, at least) is to rerun the current test with a few modifications to the configuration.

Examples include:

Add more "debug" info (tcpdump, chrome dev timelines, etc)
Add video
Change network speed to help debug the source of a problem
Change the browser to see if a problem is browser specific
...

It'll be great if there was a button from a test result that opened the "New Test" screen, but pre-populated all the fields with the details from the original test.

https://code.google.com/p/webpagetest/issues/detail?id=108

Create nice looking "executive summery" of webpagetest output

Generate a document that explains what is done right and what can be improved based on a webpagetest run. The report should be comprehendible to management, so that someone improving performance can easily show the result of their work to their boss.

Deciding what to say in this report is tricky. Might test by showing a report to a project manager who understands the web, but is not a coder.

https://code.google.com/p/webpagetest/issues/detail?id=17

Add regex content validation

Add support for validating the returned document by running a regex against the HTML of the constructed DOM

https://code.google.com/p/webpagetest/issues/detail?id=109

SSL Cert ignore not working (IE)

http://www.webpagetest.org/forums/showthread.php?tid=11003

Looks like the current method may not work for Ajax requests.

https://code.google.com/p/webpagetest/issues/detail?id=86

Preconnect history cache not cleared on IE 10 on Windows 7

http://www.webpagetest.org/forums/showthread.php?tid=12382

Use HAR for internal storage of results

Migrate from the tab-delimited results files to HAR files for the test results (with all data from all of the runs in a single compressed HAR file).

This will significantly reduce the number of files for storing the results and should also reduce the disk space required.

Once we can natively operate on HAR files then importing them will also be trivial.

This will require extending the HAR spec to support the data that we capture that is not already part of the spec.

From the perspective of the code for loading the results, the loader routines are already centralized so we can make them capable of dealing with both file types.

https://code.google.com/p/webpagetest/issues/detail?id=24

Add HTTP/2 decode support

Add support for decoding SPDY streams into individual requests. Optimally this will also include enhancing the connection view to support concurrent streams on a given connection (possibly using connection.stream for the connection ID's)

https://code.google.com/p/webpagetest/issues/detail?id=28

Customize waterfall missing elipsis

Elipsis are missing from the middle of a waterfall if requests are omitted from the middle.

https://code.google.com/p/webpagetest/issues/detail?id=115

Multi-step script timing out

http://www.webpagetest.org/forums/showthread.php?tid=11141

Possibly a problem when the there is no top-level navigation.

https://code.google.com/p/webpagetest/issues/detail?id=94

Track "blocked" time for requests

Where possible, keep track of the time a request was waiting for an available connection before being issued.

https://code.google.com/p/webpagetest/issues/detail?id=105

Repeat View Data Not Showing Up

(reported by leizlmae on Google Code)

What steps will reproduce the problem?
Run test on http://www.trutv.com/video/most-shocking/worst-burglar-ever.html

What is the expected output? What do you see instead?
Occasionally the test runs as expected, but more often than not the test finishes and only has the first view data displayed.

What version of the product are you using? On what operating system?
I'm using the instance on WebPageTest.org

Please provide any additional information below.
I've re-run the test multiple times, probably 6 or 7 at this point, and only twice did I come up with the expected first and repeat view results.

https://code.google.com/p/webpagetest/issues/detail?id=72

Check AddHeader support in Chrome for https

http://www.webpagetest.org/forums/showthread.php?tid=11991&pid=20016#pid20016

https://code.google.com/p/webpagetest/issues/detail?id=134

Allow users to store custom settings

Allow logged-in users to store some customizations:

default test parameters
Custom connectivity options
Stored scripts
anything else that makes sense

https://code.google.com/p/webpagetest/issues/detail?id=71

Track socket errors

Add support for tracking socket-level connection errors to wptdriver. Right now only requests that make it far enough to send the http request out are being tracked.

https://code.google.com/p/webpagetest/issues/detail?id=19

Keep track of blocked resources

When resources are blocked by pagetest it would be helpful to be able to see what resources were blocked instead of them just disappearing from the waterfall.

(migrated from Google Code - https://code.google.com/p/webpagetest/issues/detail?id=5)

Fully loaded time in pagetest sometimes doesn't match waterfall data

http://bigqueri.es/t/whats-the-web-page-speed-in-kbps/42/9

The flv request for http://www.infinitydownline.com/ continues for 60 seconds but the fully loaded is reported as 11 seconds. See if it has something to do with the code that caps the stored data to no more than 1MB (activity should continue to be tracked).

Use API keys for bulk testing

Expose bulk testing on the public instance but have it require API keys for usage.

https://code.google.com/p/webpagetest/issues/detail?id=55

SPDY pushed resources missing from waterfalls

I was playing with server-push while doing some SPDY experiments and noticed that the pushed resources don't appear in the waterfall.

Waterfall without pushed resources:
http://www.webpagetest.org/result/130517_3F_ee0485bff7680fdbb909c84995e136f2/

Waterfall with CSS resources pushed
http://www.webpagetest.org/result/130518_6H_03bfb4a119d760d564519705b425feb8/

Unclear whether this is due to Chrome Debugger API or WPT but will dig into it a bit more.

Auto-hide relay locations that haven't checked in in a while

WPT has a great feature that automatically hides devices that haven't connected in a while, to keep them from accumulating a large backlog and frustrate users.
Relayed locations don't benefit from that, and will show as live even if they've been dead for a while.

The auto-hide functionality should be expanded to include relayed locations.
On a similar note, the "time since last check" for relayed locations should also be available through the checklocations.php and other scripts to allow users of the API identify a location is inactive too.

Implementation note: Periodically in the getwork.php cron support we should connect to all remote locations and fetch the "last check" information and populate the local .tm files. Everything else should automatically work once that is in place.

Update frequency does not need to be more than every 15 minutes since the threshold is 30-60 minutes but it wouldn't be a bad idea to do it a little more frequently (say every 5 minutes). We could potentially grab the backlog at the same time so we can provide some feedback on overloaded locations.

https://code.google.com/p/webpagetest/issues/detail?id=75

Add reporting of DNS TTLs

http://www.stevesouders.com/blog/2012/10/09/webperfdays-performance-tools/

https://code.google.com/p/webpagetest/issues/detail?id=119

Diff two measurements, taken at different times, to see what changed

Suppose I ran webpagetest a month ago, and run it again today. I want to see what changed, so that I can fix any regressions.

https://code.google.com/p/webpagetest/issues/detail?id=16

setCookie fails for cookies with &'s

http://www.webpagetest.org/forums/showthread.php?tid=12008

https://code.google.com/p/webpagetest/issues/detail?id=139

Add IPV6 suport

Add support for IPV6 sockets/addresses

https://code.google.com/p/webpagetest/issues/detail?id=21

Check gzip compression ratio

Apache provides an option to control gzip compression level:

http://httpd.apache.org/docs/2.0/mod/mod_deflate.html#deflatecompressionlevel

DeflateCompressionLevel 1 (fastest compression) - 9 (best compression) - default is 6.

I think we could add a test to check if resources are gzip using highest possible level. Believe or not, but someone in my team changed the config to 1 and this issue existed not noticed for around 2 years!

The different for an example javascript file minified using yui is:

478969 original.js
182607 original.js-fast.gz
157171 original.js-6.gz
156894 original.js-best.gz

So the diff between 6 and 9 is not much (277b, 0.2%), the diff between 1 and 9 is significant (25k, 14%).

https://code.google.com/p/webpagetest/issues/detail?id=104

Investigate browser hang

http://www.webpagetest.org/forums/showthread.php?tid=11231

This page will reliably hang the test agents: http://quicktrip.brusselsairlines.com/SN/search.html?CityName2=&KMINewsletterSmall1%24txtEmail=My%20e-mail&KMINewsletterSmall1%24txtLastname=My%20Last%20Name&NumAdult2=1&NumChild2=0&NumRooms2=1&bookingClass=S&cabinClassFareLogicalName=ANY&dateSearchType=flexible&ddlFromAirportCheckin=BRU&depDate=10%2F7%2F2012&departDateDay=10&departDateMonth=7&departDateRange=0&departDateYear=2012&departureDate=2012-7-10&destination=LHR&footer%24select_otherwebsite=Other%20websites&&journeySpan=RT&landingPage=http%3A%2F%2Fwww.brusselsairlines.com%2Fcom%2Fbook%2Fflights%2Fc%E2%80%8Bonfirmation.aspx&lang=EN&numAdults=1&numChildren=0&numInfants=0&numSeniors=0&numYouths=0&origin=BRU&panel_type=lnkDetails&pickup_city_vibe=&promotion=&retDate=17%2F7%2F2012&returnDate=2012-7-17&returnDateDay=17&returnDateMonth=7&returnDateRange=0&returnDateYear=2012&returnJourneySpan=true&searchType=NORMAL&serviceType=Lowest%2Bfare%2Bavailable&topnavigation%24txtLogin=Email&topnavigation%24txtPin=Password&trip_default_promotion_code=&trip_departure_day3=15%2F06%2F2012&trip_return_day3=16%2F06%2F2012&txtBooknr=&txtBooknr2=&txtLastname=&txtLastnameCheckin=&type_of_flight=return

Probably some shared code in the optimization checking that is crashing.

Here's fresh URL with updated date params:

ignoreErrors 1
setTimeout 120
http://quicktrip.brusselsairlines.com/SN/search.html?CityName2=&KMINewsletterSmall1%24txtEmail=My%20e-mail&KMINewsletterSmall1%24txtLastname=My%20Last%20Name&NumAdult2=1&NumChild2=0&NumRooms2=1&bookingClass=S&cabinClassFareLogicalName=ANY&dateSearchType=flexible&ddlFromAirportCheckin=BRU&depDate=10%2F7%2F2012&departDateDay=10&departDateMonth=9&departDateRange=0&departDateYear=2012&departureDate=2012-9-10&destination=LHR&footer%24select_otherwebsite=Other%20websites&&journeySpan=RT&landingPage=http%3A%2F%2Fwww.brusselsairlines.com%2Fcom%2Fbook%2Fflights%2Fc%E2%80%8Bonfirmation.aspx&lang=EN&numAdults=1&numChildren=0&numInfants=0&numSeniors=0&numYouths=0&origin=BRU&panel_type=lnkDetails&pickup_city_vibe=&promotion=&retDate=17%2F7%2F2012&returnDate=2012-9-17&returnDateDay=17&returnDateMonth=9&returnDateRange=0&returnDateYear=2012&returnJourneySpan=true&searchType=NORMAL&serviceType=Lowest%2Bfare%2Bavailable&topnavigation%24txtLogin=Email&topnavigation%24txtPin=Password&trip_default_promotion_code=&trip_departure_day3=15%2F06%2F2012&trip_return_day3=16%2F06%2F2012&txtBooknr=&txtBooknr2=&txtLastname=&txtLastnameCheckin=&type_of_flight=return

https://code.google.com/p/webpagetest/issues/detail?id=100

HTTP Auth fails

HTTP Auth is behaving inconsistently - http://www.webpagetest.org/forums/showthread.php?tid=12358

Calculate resource age vs expires

Add a check to the expires check that sees when a resource was last modified relative to the expires.

From webperfdays London 2012 - http://www.stevesouders.com/blog/2012/10/09/webperfdays-performance-tools/

https://code.google.com/p/webpagetest/issues/detail?id=117

Add SPOF detection

Particularly for scripts where known async snippets are available.

https://code.google.com/p/webpagetest/issues/detail?id=118

Implement video rendering on the server

Right now videos are rendered on client machines using a combination of avisynth and x264. This allows for a lot of flexibility in creating video templates but it is largely unused. Instead, we can render the individual video frames as png files on the server and use ffmpeg (or x264) directly and render the videos 100% on the server.

Would probably make sense to spawn it as a background process that writes progress information so that the UI could update the user as the video is rendered.

https://code.google.com/p/webpagetest/issues/detail?id=52

Ability to get fullpage screenshots

We harvest screen shots from WPT and then visually compare them. It would be nice if we could specify an arbitrary aspect ratio for the browser. We would then use this to be able to get full page screen shots so there is no "below the fold".

https://code.google.com/p/webpagetest/issues/detail?id=136

HTTPS measurement in Firefox broke post-18

Somewhere after Firefox 18 the ability to inspect HTTPS traffic stopped working (looks like nspr is no longer being used)

Add pipelining support

Add support for processing pipelined HTTP requests. It is on in Firefox by default and Coming in Chrome.

An HTTP parser: https://github.com/joyent/http-parser

https://code.google.com/p/webpagetest/issues/detail?id=99

Allow request canceling for relayed tests

Cancel requests are not currently relayed to the remote server.

https://code.google.com/p/webpagetest/issues/detail?id=54

Ability to get JS errors for firefox

FYI if you want to extend your ability to collect js-errors to firefox there is and extentsion to do so.

http://mguillem.wordpress.com/2011/10/11/webdriver-capture-js-errors-while-running-tests/
https://github.com/mguillem/JSErrorCollector

https://code.google.com/p/webpagetest/issues/detail?id=137

Add HAR import UI/API

After we support HAR files natively, add support for importing existing HAR files through the UI and API.

https://code.google.com/p/webpagetest/issues/detail?id=29

workdone.php failing on centos

So far there have been 2 (possibly 3) reports of tests completing without successful results on machines that have zlib and php 5.3 (the only expected possible conflicts). Possible that the zip code isn't working correctly on all platforms?

One user switched from centos to ubuntu and it started working.

https://code.google.com/p/webpagetest/issues/detail?id=73

Create an extenstion for testing scripts

Create a Chrome extension for interactively testing WPT scripts (mostly just the navigation and form filling commands).

https://code.google.com/p/webpagetest/issues/detail?id=22

Navigation Timing reporting broke for chrome

The latest wptdriver which included the change in end state reporting for user timing support appears to have broken the navigation timing reporting.

Create site spider

Crawl full site looking for resources and provide aggregate report that focuses on biggest wins across pages.

Probably limited to private instances

https://code.google.com/p/webpagetest/issues/detail?id=120

HTTPS Data broken in Firefox for multi-step scripts

Request data is missing for HTTPS requests for steps other than the first step in a multi-step test. http://www.webpagetest.org/forums/showthread.php?tid=12298

Add support for running agents on Azure

Azure provides locations that largely do not overlap with EC2 so adding support for running on Azure will open up more geographic locations for testing. The main thing to investigate is if Azure has a similar concept for user data so the agents can self-configure.

https://code.google.com/p/webpagetest/issues/detail?id=35