Comments on: My Testing Proposal http://www.oneofthewolves.com/2008/02/11/my-testing-proposal/ Me, rebranded. Sun, 04 Jul 2010 04:12:17 +0000 hourly 1 http://wordpress.org/?v=3.0 By: One of the Wolves » Keeping my hands clean http://www.oneofthewolves.com/2008/02/11/my-testing-proposal/comment-page-1/#comment-113 One of the Wolves » Keeping my hands clean Sun, 25 May 2008 05:23:40 +0000 http://www.oneofthewolves.com/2008/02/11/my-testing-proposal/#comment-113 [...] different than before. Last time we did this, I kept a close watch of the people I was managing, had long and detailed debriefings, [...] [...] different than before. Last time we did this, I kept a close watch of the people I was managing, had long and detailed debriefings, [...]

]]> By: One of the Wolves » The First Week: A Play-by-Play http://www.oneofthewolves.com/2008/02/11/my-testing-proposal/comment-page-1/#comment-112 One of the Wolves » The First Week: A Play-by-Play Tue, 19 Feb 2008 23:42:40 +0000 http://www.oneofthewolves.com/2008/02/11/my-testing-proposal/#comment-112 [...] wrote a proposal, which detailed a scaled-down version of SBTM with less bureaucracy (ie., metrics) and less [...] [...] wrote a proposal, which detailed a scaled-down version of SBTM with less bureaucracy (ie., metrics) and less [...]

]]> By: Adam White http://www.oneofthewolves.com/2008/02/11/my-testing-proposal/comment-page-1/#comment-111 Adam White Mon, 11 Feb 2008 18:59:08 +0000 http://www.oneofthewolves.com/2008/02/11/my-testing-proposal/#comment-111 Tim, Congratulations on making lead so early in your career. The process you've outlined is a great explanation of SBTM - I think I'll even use part of it to explain what we do at PlateSpin. It's great to see you adopting SBTM. I have to ask what are the advantages to using SBTM over some other method? Why use SBTM at all? Why not just go completely ad-hoc? Why not go completely scripted? One aspect in your plan is a little light - reporting of the results of testing. How you are going to present your findings to the stakeholders. Are you going to use the dashboard from RST? Maybe a modified version of it for your context? Something extremely powerful I do is keep a written summary throught the release called "Top 10 things a critic might say". If we released this software today and gave it to a critic - what might they say about it" This way I draw attention to the things I think should get fixed. Most of the time I can get what I want. Be careful though -you can lose credibility by fighting for the wrong things. I did this a lot in my early career and learned the lesson the hard way. Any idea if you need to provide metrics? Metrics are popular and I'm sure you've heard many debates on the subject. Life can be different in the real world where people want the metrics regardless of the "usefulness" of them and opinions in the testing world. Good luck with your team! Adam <em>[Tim's reply: Hey Adam, thanks for your input. To answer your question about reporting, the answer is, really... I don't know. :) I'm not sure of a good way to report this stuff. Management wants me to be the arbiter for all bugs that come through my testing team, and make sure they're actually bugs before sending them off to development. Although this doesn't scale, they primarily want me to write Trac tickets and communicate informally (but at least once a day, and more toward the end of it). All this is up in the air, however, as it's really been, "We need a testing group. Tim knows a thing or two about testing. He says he likes it. Let's throw him in." I wasn't aware of the dashboard from RST; I'll give that a look. As far as SBTM vs. other methods goes, I had a big long response for you, but finally realized your questions were rhetorical -- they were only asked to show possible additions to my proposal. Thank you for those. I've got answers for you if you'd like to know, but for now, I'll just assume that's what they were intended for. As far as metrics, my impression is that they don't want them. Well... they haven't <strong>asked</strong> for them, at least. I think I'll use SBTM's metrics as a model for ours -- just to cover my butt if they ask for them later -- but my guess is metrics aren't their first priority. My take is that metrics can be abused and easily misconstrued, so I'm going to avoid them if I can. Thanks for your response. It gave me a lot to think about.]</em> Tim,

Congratulations on making lead so early in your career. The process you’ve outlined is a great explanation of SBTM – I think I’ll even use part of it to explain what we do at PlateSpin.

It’s great to see you adopting SBTM. I have to ask what are the advantages to using SBTM over some other method? Why use SBTM at all? Why not just go completely ad-hoc? Why not go completely scripted?

One aspect in your plan is a little light – reporting of the results of testing. How you are going to present your findings to the stakeholders. Are you going to use the dashboard from RST? Maybe a modified version of it for your context?

Something extremely powerful I do is keep a written summary throught the release called
“Top 10 things a critic might say”. If we released this software today and gave it to a critic – what might they say about it” This way I draw attention to the things I think should get fixed. Most of the time I can get what I want. Be careful though -you can lose credibility by fighting for the wrong things. I did this a lot in my early career and learned the lesson the hard way.

Any idea if you need to provide metrics? Metrics are popular and I’m sure you’ve heard many debates on the subject. Life can be different in the real world where people want the metrics regardless of the “usefulness” of them and opinions in the testing world.

Good luck with your team!

Adam

[Tim's reply: Hey Adam, thanks for your input. To answer your question about reporting, the answer is, really... I don't know. :) I'm not sure of a good way to report this stuff. Management wants me to be the arbiter for all bugs that come through my testing team, and make sure they're actually bugs before sending them off to development. Although this doesn't scale, they primarily want me to write Trac tickets and communicate informally (but at least once a day, and more toward the end of it). All this is up in the air, however, as it's really been, "We need a testing group. Tim knows a thing or two about testing. He says he likes it. Let's throw him in." I wasn't aware of the dashboard from RST; I'll give that a look.

As far as SBTM vs. other methods goes, I had a big long response for you, but finally realized your questions were rhetorical -- they were only asked to show possible additions to my proposal. Thank you for those. I've got answers for you if you'd like to know, but for now, I'll just assume that's what they were intended for.

As far as metrics, my impression is that they don't want them. Well... they haven't asked for them, at least. I think I'll use SBTM's metrics as a model for ours -- just to cover my butt if they ask for them later -- but my guess is metrics aren't their first priority. My take is that metrics can be abused and easily misconstrued, so I'm going to avoid them if I can.

Thanks for your response. It gave me a lot to think about.]

]]>