🔒

Case Study 01

This case study is password protected.
Enter the password Ayu shared with you to continue.

Incorrect password. Try again.

← Back to portfolio
Discovery + Evaluative HRIS Tech

When a Research Request is Really Four Research Studies

Turning an unfocused stakeholder ask into a strategic, sequenced research program — and building a research partnership along the way.

The 30-second version

Paycom's platform had a bare-bones ATS. The business wanted to invest in it as a real offering. A Senior Designer and PM came to me with prototypes, mockups, and ambitions — and a research request that was trying to do everything at once. Before I could run a single study, I needed to turn one sprawling ask into a research program that would actually answer the right questions in the right order.

What followed was four sequential studies — a survey, discovery interviews, and two usability studies — each one informing the next. The result: a product roadmap grounded in recruiter behavior, design requirements shaped by real mental models, and a stakeholder team that learned how to collaborate with research rather than just request it.

Survey · n=50 Discovery interviews Usability Study ×2 Scoping workshops Stakeholder mentorship Dovetail

Two problems, not one

The surface problem was clear enough: the team needed to understand how recruiters actually use an ATS system — what information they prioritize, what metrics they track, how they evaluate candidates. They also wanted feedback on early design mockups and usability validation of two prototype experiences.

But there was a second, less visible problem. The initial research request was unfocused and overly broad. The Designer and PM weren't sure how to structure their questions or prioritize what they needed to know. This wasn't a gap in their commitment — it was a gap in how they'd been taught to engage with research. Addressing this was just as important as the research itself.

Basically: understand user needs (discovery research) and evaluate the direction (evaluative research) — but framed as a single amorphous ask.

Proceeding without resolving the scope problem would have produced research that was technically valid but strategically meaningless. We had to fix the ask before we could answer it.

Who this was really for

Primary research participants: Recruiters — professionals who use ATS systems as a core part of their daily workflow. We needed to understand their mental models, the information they prioritize when evaluating candidates, how they structure their sourcing pipelines, and what "good" looks like for outreach and communication management.

Internal audience: A Senior Designer, a PM, and a UX Analyst — the cross-functional team who would act on these findings. A secondary audience expanded to include additional PMs brought into the final readout, increasing organizational exposure across the broader ATS and Talent Management product portfolio.

What I owned

I served as lead researcher across all four studies, with responsibility for scoping, study design, participant recruitment, moderation, analysis, and synthesis. I also mentored the UX Analyst — who had limited user research experience — through studies 3 and 4 when my project priorities shifted mid-program, ensuring continuity without sacrificing quality.

An equal part of my role was building the research partnership itself: educating the Designer and PM on how to engage with research, running working sessions with them throughout the process, and creating the conditions for genuine collaboration rather than a handoff relationship.

What we were working with

The biggest constraint was the initial scope problem itself — significant upfront time was needed to clarify and reframe the ask before any research could begin. This wasn't time that had been budgeted for, which meant building stakeholder patience alongside the actual research program.

Partway through the program, my project priorities shifted, requiring a handoff to the UX Analyst for studies 3 and 4. Continuity planning became an unexpected but valuable part of the work.

Four studies, one thread

Rather than tackling everything at once, I reframed the work as a sequenced program where each study would build on the one before it. This turned an overwhelming ask into a clear research roadmap — and gave stakeholders a way to see how research evolves as understanding deepens.

1
Scoping workshops — reframing the ask
Held focused sessions with the Designer and PM to understand what they really needed and why. Asked them to separate what they wanted to know from what they needed to decide. This surfaced four distinct question clusters — enough for four distinct studies.
2
Survey (n=50) — establishing the baseline
Focused on essential ATS information, key data fields, and desired inputs. Designed to be broad enough to surface patterns without being so open-ended it generated noise. Results informed which mental models and behaviors were worth exploring in depth.
3
Discovery interviews — understanding the world
Semi-structured sessions focused on recruiter mental models, sourcing behaviors, and expectations for ATS functionality. Looped the Designer and PM into sessions as observers — generating "aha moments" that no readout alone could have produced.
4
Usability Study 1 — candidate sourcing setup & management
Task-based sessions evaluating the prototype for sourcing pipeline setup and candidate management. Interview insights directly shaped the scenarios and success criteria used here.
5
Usability Study 2 — outreach communication setup & management
Evaluated the outreach and campaign creation experience. Mentored the UX Analyst through moderation and analysis for this study as my priorities shifted.
Organized research questions and test plan

Research plan & scoping framework used to break the initial ask into multiple targeted studies

Throughout all four studies, I maintained regular syncs with the team to share progress, address recruitment or prototype issues as they arose, and keep stakeholders invested in the process rather than just waiting for the final delivery.

What moved because of this

🗺
Product direction
Findings directly influenced the ATS product roadmap and helped define design, feature, and function requirements. The product moved into active design development.
📚
Organizational knowledge
All findings were compiled in Dovetail for org-wide access and future reference — making this research a living resource, not a one-time deliverable.
🤝
Research capability
The Designer gained practical skills in structuring research requests, grouping questions under objectives, and engaging with research as a strategic partner.
🌱
Team growth
The UX Analyst was mentored through studies 3–4, developing hands-on research experience and the ability to carry work forward independently.

Honest reflection

The biggest challenge was scope creep at intake — not from a stakeholder trying to be difficult, but from designers who genuinely didn't know how to ask for what they needed. Many feel they should arrive with fully formed research questions, leading to either overly broad asks or delayed collaboration.

The upfront time spent reframing the ask added time we hadn't planned for. But it led to better outcomes. This experience made clear that the real work wasn't just the research — it was creating the conditions for research to succeed.

The gap wasn't in the team's commitment. It was in how they'd been taught to engage with research. That was fixable — and worth fixing.

As a result, our research team began actively encouraging designers to come to us earlier in their thinking — even without a polished request — and explored lightweight frameworks to help structure research questions upfront, so we could move faster from intake to execution.