Nikki Shechtman (6e66b6ac) at 12 Mar 16:57

Nikki Shechtman (30d6038f) at 12 Mar 14:24

Nikki Shechtman (9c0f148a) at 11 Mar 20:28

Nikki Shechtman (7b67871e) at 11 Mar 20:28

Nikki Shechtman (5b5208bd) at 11 Mar 20:28

@sayobittencourt Sounds good! If you're using Usertesting's panel and you haven't used those questions before, you're probably fine. If you have any questions about recruitment on Usertesting, the best resource is ReOps.

Nikki Shechtman (308cd0ab) at 10 Mar 19:51

Nikki Shechtman (0f480ad1) at 10 Mar 17:06

Nikki Shechtman (65bb5d91) at 10 Mar 17:03

Hi @sayobittencourt - This looks great! I just have a few comments / questions.

Notes on research design:

• I want us to be crystal clear what decision you are making and how you will use the data. It looks like you want to use this to decide between those two places for the tokens, though I don’t think it states that explicitly. This is mostly in the “Success Criteria” section, but I think it would be helpful to:
  • Add a section called “Design Decision” - Specify the decision you want to make and the criteria you will use. Are you aiming for a simple majority? Is there a possible set of responses where you’d choose neither or do further testing (e.g., more than 7-9)?
  • It would also be helpful to add a research question about this, such as, “Are users more likely to look for the Feed/Incoming email tokens in the Integration Accounts Page or the Personal Access Token Page?”
• Just something to consider – Now that I see that logic laid out, it makes me wonder if you might learn more by splitting this up and running this two times, once with one workflow and once with the other workflow (each with n=5). You would still be able to find out where everyone looks first, and then you would ALSO see what would happen if they didn’t find it where they expected it. 
• For the instructions, rather than telegraphing this is about finding something, maybe make it more task oriented, like this: “You are now at your GitLab homepage. Reset the access granted to your RSS feed. Please think out loud as you go.”

For the screener, I know you’ve done this before, and you must be coordinating with ReOps for the incentive – but just to double check -

• Doesn’t ReOps need the qualifying questions for an incentive (e.g., not in government / non-profit)?
• How about a question or two to help screen out bad actors (e.g., ask for LinkedIn)? Maybe ReOps advises against this because it’s not a big incentive?

Nikki Shechtman (5b63f5f7) at 09 Mar 21:11

Nikki Shechtman (68036e56) at 09 Mar 21:11

Nikki Shechtman (2577b878) at 09 Mar 21:10

Nikki Shechtman (8242397e) at 09 Mar 21:08

Nikki Shechtman (498fea3d) at 09 Mar 15:01

Nikki Shechtman (ed26b35b) at 09 Mar 14:58

Nikki Shechtman (0e1335fd) at 09 Mar 14:53

Nikki Shechtman (c81eaa50) at 09 Mar 14:53