AMA: Trunk Guardian Service?

Sue asks…

I read a LinkedIn blog post from 2015 by Keqiu Hu from LinkedIn about flaky UI tests. He explains how they fixed their flaky UI tests for the LinkedIn app. Among other things they implemented what they called the “Trunk Guardian service” which runs automated UI tests on the last known good build twice and if the test passes on the first run but fails on the second it is marked as ‘flaky’ and disabled and the owner is notified to fix it or get rid of it. I wondered what your thoughts were on such a “Trunk Guardian service” – if the culture / process was in place to solve the other issues that create flaky tests, could such a thing be worth the effort to implement? Article: Test Stability – How We Make UI Tests Stable

My response…

Continue reading “AMA: Trunk Guardian Service?”

AMA: IE11 Button Clicking in Selenium

Anthony asks…

I have coded to click buttons on IE11/Win7 but the latest version of Selenium IE doesn’t click the buttons correctly most of times. Most of times, it clicks one button below. I thought it might be loading time so added some waiting but still click one button below or two buttons below sometimes. I googled this and found several posting saying Selenium IE doesn’t click buttons well. Now I have moved it to FF but I am still wondering why IE is not accurate. I know a lot of Selenium test developers in the field but they are having the same issue or they know a workaround. What do you think of this issue on IE11? Are you aware of this issue? FYI, the buttons are not regular HTML tag. The menu system with clickable tag is created by javascript. Thank you!

My Response…

We actually don’t run any tests in Internet Explorer any more since these weren’t finding any browser specific bugs (we do exploratory testing in Internet Explorer instead).

But, I have heard of problems generally with the IEDriver tool. If you’re working on a JavaScript generated app I think the best thing for you to do would instead of using a native click in Selenium is instead execute a JavaScript click event. The exact syntax will depend on which language you’re using Selenium in, but it should look something like this:

this.driver.executeScript( 'return arguments[0].click();', webElement );

I hope this solution helps!

AMA: What sets exceptional QA testers apart?

Dayana asks…

I wondered if you could tell me what sets exceptional QA testers apart? Not just personality or work ethic traits, but specific skills and programming knowledge that will be very valuable to a team?

My response…

I think exceptional QA testers, as explained recently, aren’t people who are exceptional at just one thing, eg. testing, but good at lots of things.

So an exceptional QA tester, in my opinion, will typically have (at least good) skills in the following things:

  1. Skills in human exploratory testing: an exceptional QA tester has the ability to effectively find the most important bugs fast. Whilst this skill can be developed, I have found it’s mostly a mindset.
  2. Skills in developing automated tests: an exceptional QA tester will have programming skills needed to develop automated tests and I would recommend these to typically match the programming language(s) that programmers in your organization use. For example, skills in automated testing in .NET if your company primarily uses Microsoft .NET. Although, someone with strong programming skills in one language (eg. ruby) should be able to transfer these skills to another language (eg. python).
  3. Knowledge/Experience in your business domain: an exceptional QA tester will fully understand your business domain and keep this context in mind whilst testing a product and raising issues. An exceptional tester is always testing your system – just as I am testing WordPress.com publishing this post.
  4. An empathetic mindset: we design and develop software for real people and real life. An exceptional QA tester will test with this in mind.

Update on ‘Ask Me Anything’

I’ve had an excellent response to my Ask Me Anything (AMA) post so far.

  • I have received 47 different questions in total
  • I have answered 15 so far on this site
  • I have answered 2 offline/in person as they were from local testers; and
  • I have 30 remaining which I will answer in time.

I am answering every question received on a FCFS basis, but it will take me some time to get through the remaining questions as I like to think about my answer to ensure it is helpful.

Can I ask something of you? If you wish to discuss any of the responses then please do so on the article itself here on watirmelon.com. I like having all the questions/discussion here alongside the original article so everyone can join in rather than scattered over twitter (which I don’t check) or LinkedIn.

Thanks for that, oh, and if you don’t mind the wait, keep the questions coming.

 

WatirMelon AMA: Ask Me Anything

WatirMelon AMAThere comes a time in one’s blogging life when one decides to conduct an ‘Ask Me Anything’ (AMA). That time is now. Feel free to submit the contact form below with your question(s) and I’ll collate these over the next week or so and (try to) answer as many as I can, either in group form for short questions or as individual posts for more meaty ones.

Feel free to ask me anything, whether it be an automated test strategy or approach question, or what it’s like to live in Australia and work remotely for one of the world’s largest blogging/content platforms.

Your name, email and website are all optional, if you choose to provide your name and/website I will put this against the original question when answering it (I won’t include your email). Any toxic or inappropriate questions will be politely ignored.