Back to blog

How to Choose Pilot Users Who Can Test Your Product’s Core Task

Choose pilot users by real task, access to inputs and working conditions. Use a recruitment worksheet that exposes gaps in your first cohort.

Luka Abramovic3 min read

Different account cards selected into a focused pilot testing group.

Choose pilot users who have the task your product is designed to help with and can supply the inputs it requires. Enthusiasm alone does not make someone a useful tester. A person who likes the idea but has no current task can comment on the interface without testing the promised outcome.

A domain expert’s network is a useful starting point. Record how each participant knows the founder, because prior knowledge and personal help can make the product easier to use than it will be for a new customer.

Recruit against a concrete task description

Write the intended task in ordinary language. For example, preparing a supplier brief from an existing equipment record. Ask candidates when they last did it, what they used and what they will need to do next. Request a description of the input rather than confidential documents during recruitment.

Distinguish the purchaser from the person doing the work. A department owner may approve a pilot while an assistant performs the daily task. Include the actual operator in the test and the purchaser in the decision review.

Use this cohort worksheet

Participant code
Actual role in the task
Recent example of the task
Next expected opportunity to do it
Access to required inputs
Device and working conditions
Prior relationship with founder
Assumption this participant can test
Support offered during the pilot
Reason included or excluded

Keep contact details in your normal customer system, not in an unnecessarily shared test report. Use participant codes when discussing observations. Record exclusions so the team knows which users its conclusions do not cover.

Select variation that could change the design

Choose differences linked to an assumption. If the product must work for people outside your professional vocabulary, include someone who knows the task but not your terminology. If the task happens on site, include that working condition. Adding random demographic variety does not substitute for testing the relevant workflow differences.

In an illustrative six-person cohort, four participants are experienced specialists and two are new coordinators. If all four specialists complete the task and both coordinators need explanations, the result is not simply four of six successful. It points to a vocabulary or guidance gap that the average hides.

Plan the observation before sending invitations

Give each participant a task and ask them to explain what they expect at the next step. Avoid telling them where to click unless they are blocked. Record the intervention if you help. An assisted completion remains useful evidence, but it answers a different question from independent completion.

Agree a route for unfinished work and a point at which the tester should stop. A pilot should not leave someone depending on an unsupported result for their real task. Provide the established manual route where necessary and record why it was used.

After the first round, recruit the next participant to investigate the strongest unresolved assumption. If the input is unavailable outside the founder’s own organization, more interface feedback will not resolve it. The next test needs someone who can show how another customer obtains that input. Use the cohort worksheet to choose that person deliberately.

Bring the core task and your candidate user list. We can choose a pilot cohort that tests the assumptions most likely to change the product. Discuss the first release with Adamant Code.

Build with Adamant Code

Automating a workflow or building a product?

Bring one manual process you want to automate or the product you want to build. We’ll discuss what is in the way and the next step worth exploring.

Talk through your workflow
How to Choose Pilot Users Who Can Test Your Product’s Core Task | Adamant Code