I am just thinking - ISO 9001, of course, say you need to have some quality control and quality assurance activities but it is up to you to define it and document it.

CMMI is not mandatory (it does tell you to do validation and verification to achieve Level 3).

But are there any norms/standards that actually prescribe to perform testing on software? I believe this might be just the SIL for low-level SW controlling hardware in cars etc. But, to be honest, I do not know if ISO 61508, defining SIL, actually dictates the testing must be done - for SIL levels, it is under "recommended" or "highly recommended".

EDIT: The title edit was not correct, there are many standards for software testing itself.

Can anyone provide actual data or scientific studies that show developers are (or are not) less effective at testing their own code than "independent" testers? I've seen many opinions but little hard data.

EDIT: A few followup clarifications:

1. This is referring to system/e2e tests.
2. There are also two interpretations of "developers testing their own code": an individual developer testing the code they authored, or more generally developers testing code that may have been written by other developers. Data for either one would be instructive and I think there are different considerations for each. We currently do both.
3. We use team inspections in most cases for requirements, code, system/e2e tests, etc., with the exception of unit tests. In my opinion this does mitigate at least some of the risk of the test author being "blind" to gaps in what is being tested.

Background:

I'm part of a team of around 20 developers, and until recently we had no dedicated test team. On my first project I was the "software test lead" while still doing actual development, and the expectation was that when you implemented a feature, you didn't merge it until you had also written the tests related to it. We also have a very good culture of celebrating finding (and fixing) bugs, egoless reviews, etc., and to top it all off we have produced very high quality results. In my opinion, it is possible for developers to be just as enthusiastic about breaking their own code as independent testers can be, if you have that kind of culture in place.

I just started reading How Google Tests Software and it seems we aren't the only ones who have had good results when developers are responsible for testing their own code. I haven't even gotten past the introduction yet but the whole idea of having a "Engineering Productivity" group rather than a group labeled "QA" or "Testing", and those people working to enable developers to test faster and better actually sound very similar to my experience: though we didn't have separate titles there are people in our group that are known for writing tools to increase productivity, whether in testing or otherwise, which combined with the culture of quality mentioned above has proven successful.

Our management is pushing for creating a dedicated testing team. They've given a number of reasons, and I've seen many of these reasons/opinions offered in answers to questions like How does a tester's perspective towards software differ from a developer's? and Can developer do automation test for the feature that he has implemented?, but while I've seen lots of opinions (many from experience, and I do respect them as such), I've yet to see any hard evidence or data that developers are inherently less effective at testing their own code than an "independent" party. My biggest concern with moving from our current model to a "separate test team" model is that developers will no longer view quality as their responsibility, and I've seen some of this mentality start to set in on a project where we had a test team. It was an offshore team that proved utterly incapable of writing quality tests, but because we didn't ditch them until a year into the project, we built up a lot of quality debt while also allowing many devs to get out of the mindset of also being testers.

I'd like to push back on this idea of separating development and testing but want to do my homework first. There are opinions and anecdotal/experiential evidence that support both viewpoints, but I'm interested in knowing if there's any actual data to support one or the other (or "it depends").

Rather than observed response time, I prefer this limit: The maximum acceptable response time. This may differ for different requests.

This becomes trickier, of course, when the test code and test environment inject delays over and above the system response time. So I sometimes (grudgingly) increase the wait times to account for those. And put in a lot of effort to reduce those test-induced delays.

If “maximum acceptable response time” is too painful to tolerate in tests, that’s a sign to reconsider what is acceptable.

Your Regular Expression Extractor configuration is a little bit incorrect:

1. You should change "Field to check" of your Regular Expression Extractor to URL
2. You should amend your Regular Expression to something like: /en/book/confirm/(.*)

In your current setup your Regular Expression looks into the Response Message (which is OK for HTTP Status Code 200) and extracts the first letter only from it, which is 0

Example Regular Expression Configuration:

Demo:

References:

• Apache JMeter - User's Manual: Regular Expressions
• Using RegEx (Regular Expression Extractor) with JMeter
• Perl 5 Regex Cheat sheet

If you see this

Unlock Jenkins To ensure Jenkins is securely set up by the administrator, a password has been written to the log (not sure where to find it?) and this file on the server:

/Users/Shared/Jenkins/Home/secrets/initialAdminPassword

Please copy the password from either location and paste it below.

or something like this, then you need to get the initialAdminPassword and then login and then set a password. Please see the steps here to do so

Also, sudo passwd jenkins should prompt you to set a password.

I have tried to calculate price difference of product, but I am not able to calculate the difference for a product who doesn't have any discount on it.

My code is:

package Tekbakertest;

import java.util.ArrayList;
import java.util.HashMap;
import java.util.List;
import java.util.Map;

import org.openqa.selenium.By;
import org.openqa.selenium.JavascriptExecutor;
import org.openqa.selenium.WebDriver;
import org.openqa.selenium.WebElement;
import org.openqa.selenium.chrome.ChromeDriver;
import org.openqa.selenium.chrome.ChromeOptions;
import org.openqa.selenium.interactions.Actions;
import org.openqa.selenium.support.ui.ExpectedConditions;
import org.openqa.selenium.support.ui.WebDriverWait;

import com.relevantcodes.extentreports.LogStatus;

public class Ted_sale 
{
    static WebDriver driver;

    public static void main(String[] args) throws InterruptedException 
    {
        // TODO Auto-generated method stub
        System.setProperty("webdriver.chrome.driver","C:\\Chrome\\chromedriver_win32\\chromedriver.exe");
        //System.setProperty("org.apache.commons.logging.Log", "org.apache.commons.logging.impl.Jdk14Logger");
        Thread.sleep(2000);
        ChromeOptions options = new ChromeOptions();
        Map prefs = new HashMap();
        prefs.put("credentials_enable_service", false);
        prefs.put("password_manager_enabled", false); 
        options.setExperimentalOption("prefs", prefs);
        options.addArguments("start-maximized");
        options.addArguments("disable-infobars");
        driver = new ChromeDriver(options);
        driver.get("http://www.tedbaker.com/");
        WebDriverWait wait = new WebDriverWait(driver, 40);
        wait.until(ExpectedConditions.presenceOfElementLocated(By.xpath("html/body/div[3]/div[2]/div/div/ul/li[1]/a")));

        if(driver.findElement(By.xpath("html/body/div[3]/div[2]/div/div/ul/li[1]/a")).isDisplayed())
        {

            driver.findElement(By.xpath("html/body/div[3]/div[2]/div/div/ul/li[1]/a")).click();

        }
        Actions act=new Actions(driver);
        WebElement Category=driver.findElement(By.xpath(".//*[@id='categories_nav']/li[1]/a"));
        WebElement Sales_clothng=driver.findElement(By.xpath(".//*[@id='categories_nav']/li[1]/nav/div[1]/div[3]/ul[1]/li[3]/a"));
        act.moveToElement(Category).moveToElement(Sales_clothng).click().build().perform();
        Thread.sleep(2000);

        List Product_list=driver.findElements(By.xpath(".//*[@class='name']"));

        System.out.println(Product_list.size());

        for(int i=0;i Product_list_lst = new ArrayList();
            Product_list_lst.add(Product_list.get(i).getText());
            System.out.println(Product_list.get(i).getText());
        }

        for (WebElement items_product : Product_list)
        {
            System.out.println(items_product.getText());
        }
        System.out.println("Originanal Price of items");

        List Original_price=driver.findElements(By.xpath(".//*[@class='price previous']"));

        System.out.println(Original_price.size());

        for(int i=0;i Original_price_lst = new ArrayList();
            Original_price_lst.add(Original_price.get(i).getText());
            System.out.println(Original_price.get(i).getText());
        }
        System.out.println("Discounted Price of items");

        List Discounted_price=driver.findElements(By.xpath(".//*[@class='price unit']"));

        System.out.println(Discounted_price.size());

        for(int i=0;i Discounted_price_lst = new ArrayList();

            Discounted_price_lst.add(Discounted_price.get(i).getText());
            System.out.println(Discounted_price.get(i).getText());
        }

        for(int i=0;i Original_price_lst_1 = new ArrayList();
            List Discounted_price_lst_1 = new ArrayList();
            String original_price_removecurrencysymbol = Original_price.get(i).getText().substring(1,Original_price.get(i).getText().length());
            String discount_price_removecurrencysymbol = Discounted_price.get(i).getText().substring(1,Discounted_price.get(i).getText().length());
            System.out.println(original_price_removecurrencysymbol);
            System.out.println(discount_price_removecurrencysymbol);
            int difference = Integer.parseInt(original_price_removecurrencysymbol) -Integer.parseInt(discount_price_removecurrencysymbol);
            System.out.println("Difference is:"+difference);
            if(difference>=50)
            {

                Product_list.get(i).click();
                // driver.findElement(By.xpath("//input[contains(@class,'add_to_cart')]")).click();
            }
        }
    }       
}        
```


The error is:

```
    Exception in thread "main" java.lang.IndexOutOfBoundsException: Index: 59, Size: 59
        at java.util.ArrayList.rangeCheck(Unknown Source)
        at java.util.ArrayList.get(Unknown Source)
        at Tekbakertest.Ted_sale.main(Ted_sale.java:92)
```


Screenshot:

From what I see, BrowserStack does not support the browsers you've mentioned, here is a full table of supported systems and browsers.

Same goes for Sauce Labs, here is a full list of what the service supports.

I guess you should explore the option of having your own selenium server with selenium nodes for your desired browsers, assuming these browsers can be automated with selenium - meaning, have available drivers.

There could be a number of other ways but the best I could found is to follow these steps:

1. Launch MTM and navigate to "Analyze Test Runs".
2. Select tests based on "View" and "Start date range".
3. Use Ctrl+c to copy the records.
4. Open Excel and use Ctrl+v to paste the records.

You should be able to select additional columns by right clicking the header row before step 3 above.

I hope it is helpful.

Inspired by this question, which was closed because (and I agree) was not asked correctly and is not answerable.

What are the criteria to convert code smell to a bug?

Code smell is a hint that something has gone wrong somewhere in your code (not a certainty, not a bug).

So what would be good process/criteria to decide which smell is a bug, and which is not a bug yet?

Linked page gives many examples of code smells (excellent introductory reading), and c2.com wiki - the first, original wiki (since 1995, and still around) -- is great learning resource overall about design patterns, extreme programming, and all stuff related to programming.

This is a version incompatibility problem - your Firefox browser version is too old for Selenium3. Update your browser.

My current setup which works for me:

• selenium 3.4.0
• Firefox 54
• geckodriver 0.17

All currently latest stable.