I read a LinkedIn blog post from 2015 by Keqiu Hu from LinkedIn about flaky UI tests. He explains how they fixed their flaky UI tests for the LinkedIn app. Among other things they implemented what they called the “Trunk Guardian service” which runs automated UI tests on the last known good build twice and if the test passes on the first run but fails on the second it is marked as ‘flaky’ and disabled and the owner is notified to fix it or get rid of it. I wondered what your thoughts were on such a “Trunk Guardian service” – if the culture / process was in place to solve the other issues that create flaky tests, could such a thing be worth the effort to implement? Article: Test Stability – How We Make UI Tests Stable
Continue reading “AMA: Trunk Guardian Service?”
We actually don’t run any tests in Internet Explorer any more since these weren’t finding any browser specific bugs (we do exploratory testing in Internet Explorer instead).
this.driver.executeScript( 'return arguments.click();', webElement );
I hope this solution helps!
I wondered if you could tell me what sets exceptional QA testers apart? Not just personality or work ethic traits, but specific skills and programming knowledge that will be very valuable to a team?
I think exceptional QA testers, as explained recently, aren’t people who are exceptional at just one thing, eg. testing, but good at lots of things.
So an exceptional QA tester, in my opinion, will typically have (at least good) skills in the following things:
- Skills in human exploratory testing: an exceptional QA tester has the ability to effectively find the most important bugs fast. Whilst this skill can be developed, I have found it’s mostly a mindset.
- Skills in developing automated tests: an exceptional QA tester will have programming skills needed to develop automated tests and I would recommend these to typically match the programming language(s) that programmers in your organization use. For example, skills in automated testing in .NET if your company primarily uses Microsoft .NET. Although, someone with strong programming skills in one language (eg. ruby) should be able to transfer these skills to another language (eg. python).
- Knowledge/Experience in your business domain: an exceptional QA tester will fully understand your business domain and keep this context in mind whilst testing a product and raising issues. An exceptional tester is always testing your system – just as I am testing WordPress.com publishing this post.
- An empathetic mindset: we design and develop software for real people and real life. An exceptional QA tester will test with this in mind.
It’s been a while since I wrote something on this blog as you could say my life has been a bit complicated.
Continue reading “A brief update & AMA II”
I’ve had an excellent response to my Ask Me Anything (AMA) post so far.
- I have received 47 different questions in total
- I have answered 15 so far on this site
- I have answered 2 offline/in person as they were from local testers; and
- I have 30 remaining which I will answer in time.
I am answering every question received on a FCFS basis, but it will take me some time to get through the remaining questions as I like to think about my answer to ensure it is helpful.
Can I ask something of you? If you wish to discuss any of the responses then please do so on the article itself here on watirmelon.com. I like having all the questions/discussion here alongside the original article so everyone can join in rather than scattered over twitter (which I don’t check) or LinkedIn.
Thanks for that, oh, and if you don’t mind the wait, keep the questions coming.
There comes a time in one’s blogging life when one decides to conduct an ‘Ask Me Anything’ (AMA). That time is now. Feel free to submit the contact form below with your question(s) and I’ll collate these over the next week or so and (try to) answer as many as I can, either in group form for short questions or as individual posts for more meaty ones.
Feel free to ask me anything, whether it be an automated test strategy or approach question, or what it’s like to live in Australia and work remotely for one of the world’s largest blogging/content platforms.
Your name, email and website are all optional, if you choose to provide your name and/website I will put this against the original question when answering it (I won’t include your email). Any toxic or inappropriate questions will be politely ignored.