Skip to main content

The miseducation of Exploratory Testing


I've been noticing a phenomenon lately, that is the over/misuse of the term Exploratory testing. As many testers seems to have kind of settled for the Exploratory testing paradigm and have moved to new frontiers like checking vs testing, it seems many other parties are really getting into it, and of course understanding it in different ways.

Couple of examples of this phenomena:
1. In my final days as a consultant one of our sales people, had visited a customer who had no experiences about testing, but specifically requested the sales man to give a offer on Exploratory testing
2. I just looked at the program of Agile testing days 2013, and really many of the testing related talks were labeled about Exploratory testing, although to me many seemed to talk/practice testing in generally

It's nice that the Exploratory testing is gaining momentum, but I am also a bit worried about it. The examples listed above could be supported by many others, which kind of give me the impression that ET is becoming another buzzword, (just like Agile).

I think talking&learning about Exploratory testing is a great thing, and if you are involved with testing and are not that familiar with the concept I definitely suggest to start learning about it. Reading stuff from James Bach and Michael Bolton is not a bad start at all. But whilst getting into it, I would want to remind you about a couple of things I had to learn the hard way.
1. Exploratory testing != unplanned testing
2. There is no such thing as unexploratory testing
3. Exploratory testing != good testing

If you want good testing to be done, or if you want to talk about good testing, I think there's nothing wrong in calling it by the name of Good testing. In case everybody might not still agree on what Exploratory testing means.

Just a thought.

Comments

  1. Hi, Anssi...

    I'm glad you've raised this point. The idea of exploratory testing is no longer prohibited speech, which it used to be in certain circles. At the same time, the idea shouldn't be watered down, either.

    I agree when you say that exploratory testing doesn't mean "testing", or "good testing". It means something more specific. I've written some things about that here and here. Cem Kaner, who coined the term, has reflections here. Citing what James Bach has written would take too much time, but this post—an interesting challenge to your remarks—is a highlight from this list.

    The conversation continues. I'd encourage you to keep posting your own reflections on the subject.

    ---Michael B.



    ReplyDelete
    Replies
    1. Hi Michael,

      Thanks for the (requested :) ) comment.

      There's a lot of stuff to read from you guys, stuff which I already have read before, but I still seem to find new stuff when reading it. Thinking either you constantly change your articles, or then I have changed in the mean time..

      Problem I see, when talking with bloated terms like Agile or (not perhaps so bloated but perhaps in danger of becoming one) Exploratory testing, is that people may have their own idea on their meaning, which often may be really different from other people's ideas. Which again leads to many other problems.

      I'm slowly giving up using that phrase, but most definitely will not give up asking what other people mean when they use it.

      I also took the challenge you referred to and commented on James' blog post.

      Delete

Post a Comment

Popular posts from this blog

Periodical retrospectives are lame

  "You got nothing, not a single thing?! Well lets just end this here then." I remember well when I said this, being very frustrated. About ten years ago I had been working as a Scrum master for a team some months, and putting quite a lot of effort into planning our scrum teams sprint retrospectives. Lot of work also because I felt we were not getting too much out from them; not very good discussions, very few actions, and even the few actions we did come up with did not stick.  And then it happened: a retro where none of the participants came up with anything to say about the sprint. Regardless of the retro topic boxes, reading of books on retrospectives, getting inspiration from tools like retromat.org, having them in different places, using all kinds of different formats and rainbow coloured post-it notes. Not a single thing. Blank.  So then I said the words, out of frustration, mainly to myself. Why couldn't I get this thing everyone is so hyped about to work? After t

I don't report bugs

I don't report bugs . Bug is such a loaded word that people understand very differently, that instead of using it and explaining what I mean by it I rather just use other words. Like observations, thoughts, surprises, ideas, alternatives, or something similar. (And no I don't use fault, defect, or error either). Bug has also quite a negative connotation. "Reporting a bug" is kind of like telling someone that they've been served. And as we are actually giving away the gift of information, why wrap it in such a nasty package? And maybe more importantly it is very likely that whatever you might have to say is wrong. If not plain wrong, then at least incomplete. So I like to approach the kind of situations with the assumption that I am probably wrong. Cutting off anything that might sound arrogant makes stuff quite a lot easier. Especially after you realise later on that you have been wrong. I leave plenty of observations unreported . I don't want to waste

Testing drunk

(My first blog writing ever.) I've been thinking a long time that it's funny how many bugs I find by accident. Try to do something, make a mistake and boom - a bug is found.  Making the mistakes intentionally doesn't quite work - that's why they are called accidents I guess.. So I've thought of ways to make myself more prone to accidents, coming up with an apparent one; testing drunk. TUI (testing under the influence). So this I gotta try. More to come on that later.