How credible are WebDriver tests?



  • We have recently encountered a bug that we are able to reproduce manually in Internet Explorer, without any significant effort.

    Same bug we have tried to reproduce also automatically, with WebDriver on Internet Explorer 8. However, even after looping the test and repeating it 100 times does not reproduce the bug, the test goes green.

    I wonder what caused such a difference?

    Possible reasons:

    • timing of GUI events in automated tests is different than in our manual tests (to fast, to slow, etc.)
    • WebDriver is operating on a different level of a browser API and than a user, making WebDriver less credible in simulating user behavior.


  • I have seen this sort of thing before and the problem ended up being in how the page was coded: onmouseover vs onchange in our case.

    You may want to look at the the javascript events for the page, as it sounds very possible that the human interaction is causing some method to run whereas the web driver is changing objects in the DOM, and allowing web driver to push through the page without triggering the rogue javascript.



Suggested Topics

  • 2
  • 3
  • 2
  • 2
  • 2
  • 2
  • 2
  • 2