Source-linked AI summary

A Case Study of Onboarding in Software Teams: Tasks and Strategies

An Ju, Hitesh Sajnani, Scot Kelly, Kim Herzig

arXiv:2103.05055v1cs.SE

TL;DR

The paper addresses the limited understanding of how work tasks shape software developers’ onboarding. It studies onboarding at Microsoft through interviews and surveys, identifying task interactions and commonly used strategies. Survey results suggest that the interview findings are representative and that the strategies cover many practices.

  • Problem

    The paper identifies a lack of systematic understanding of how onboarding tasks relate to developers’ experiences, despite onboarding being associated with outcomes such as productivity, job satisfaction, and retention.

    Source: §I · p. 1
  • Method

    An exploratory Microsoft case study combines interviews with developers and managers, surveys of broader groups, and analysis of task-related onboarding experiences.

    Source: §I · pp. 1–2
  • Results

    Interviews surfaced learning, confidence, and social interactions as themes and three manager strategies; surveys suggest the findings are representative and the strategies describe a majority of practices.

    Source: §I · p. 2, §VII · p. 10
  • Takeaways & Limitations

    The paper offers onboarding recommendations for practitioners and reports that Microsoft practitioners validated them as useful and practical.

    Source: §VII · p. 10

    Because the study was conducted at one company, its external validity is constrained, although the authors believe it should generalize to most modern software-engineering teams.

    Source: §VI · p. 10

Abstract

from arXiv · show

Developers frequently move into new teams or environments across software companies. Their onboarding experience is correlated with productivity, job satisfaction, and other short-term and long-term outcomes. The majority of the onboarding process comprises engineering tasks such as fixing bugs or implementing small features. Nevertheless, we do not have a systematic view of how tasks influence onboarding. In this paper, we present a case study of Microsoft, where we interviewed 32 developers moving into a new team and 15 engineering managers onboarding a new developer into their team -- to understand and characterize developers' onboarding experience and expectations in relation to the tasks performed by them while onboarding. We present how tasks interact with new developers through three representative themes: learning, confidence building, and socialization. We also discuss three onboarding strategies as inferred from the interviews that managers commonly use unknowingly, and discuss their pros and cons and offer situational recommendations. Furthermore, we triangulate our interview findings with a developer survey ($N=189$) and a manager survey ($N=37$) and find that survey results suggest that our findings are representative and our recommendations are actionable. Practitioners could use our findings to improve their onboarding processes, while researchers could find new research directions from this study to advance the understanding of developer onboarding. Our research instruments and anonymous data are available at \url{https://zenodo.org/record/4455937#.YCOQCs_0lFd}

I. INTRODUCTION

The paper examines how engineering tasks shape developers’ onboarding, a process tied to important personal and organizational outcomes. An exploratory Microsoft case study uses interviews and surveys to characterize task effects and task-assignment strategies.

I. INTRODUCTION

  • Onboarding combines adjustment to a new team with acquiring the behaviors, attitudes, and skills needed to fulfill a role; developers may face cognitive overload, social challenges, and pressure to prove themselves.The paper notes that these pressures are associated with happiness, retention, and productivity, and argues that improving onboarding is important.Source: §I · p. 1
  • The study addresses the lack of a systematic understanding of how tasks influence new developers’ onboarding experiences.It also asks which task-assignment strategies can facilitate a positive onboarding experience.Source: §I · p. 1
  • The exploratory case study examines tasks and onboarding without an existing theory, treating task choice as a situational design decision with multiple outcomes.Onboarding can extend beyond six months, and task needs may shift as a developer learns.Source: §I · p. 1

II. METHODS

  • The researchers interviewed 32 developers who had recently joined a team and 15 managers who had recently onboarded a developer, then surveyed broader audiences about interview findings.The paper offers practitioners recommendations and compares the strategies’ pros and cons to help them select an approach suited to their circumstances.Source: §I · pp. 1–2

I. INTRODUCTION

  • Interviews identified learning, confidence, and socialization as themes through which software-development tasks shape onboarding, while uncovering three commonly used manager strategies.Surveys of 189 developers and 37 managers suggest the interview findings are representative and the strategies cover a majority of onboarding practices.Source: §I · p. 2

A. Subjects and Research Site

The study was conducted in two Microsoft divisions and focused on software-development teams, using interviews and surveys to examine onboarding tasks. Interview design covered task context, task characteristics, and the constructs tasks may influence.

A. Subjects and Research Site

  • The study sampled two US Microsoft divisions with distinct businesses, cultures, and onboarding practices, including software-development teams in both.One division focused on service and software development; the other included software and hardware businesses.Source: A. Subjects and Research Site · p. 2, Table I · p. 3
  • The study treats a typical team task as scoped to one to four weeks, while exploratory tasks may be time-boxed to one to two weeks.Some tasks were customized for onboarding, including fixing or updating documentation.Source: A. Subjects and Research Site · p. 2
  • For interviews, developers had joined a team within the previous three months and managers had onboarded someone within six months; survey eligibility used a six-month threshold.Researchers sampled from Microsoft employee records and limited participants to software developers or managers at the US headquarters.Source: A. Subjects and Research Site · p. 2

B. Interviews

  • The researchers piloted six developer interviews and used the resulting onboarding-related constructs to design the interview guides.In this study, “constructs” include artifacts, processes, mental feelings, and metrics.Source: B. Interviews · p. 2, 1) Design · p. 2

1) Design:

  • Interview questions covered onboarding context, task characteristics, and constructs such as learning and confidence that tasks may influence.Developers described tasks and their perceived effects; managers described task assignment, expectations, and evaluation.Source: 1) Design · p. 2

2) Administration:

Interviews were recorded and analyzed through a collaborative coding process, moving from transcript lines to task-level codes and then broader themes. The analysis also identified onboarding strategies, their pros and cons, and interview findings to examine through surveys.

2) Administration:

  • Interviews lasted 30–60 minutes, were audio/video recorded, and were conducted by at least two researchers, with one leading and another transcribing most interviews.Researchers consolidated interview notes immediately afterward.Source: 2) Administration · p. 3

3) Analysis:

  • Initial coding grouped transcript lines into topics, tasks, and constructs, with task-related lines labeled using descriptors such as priority and complexity.The initial descriptors drew on prior reports, expert suggestions, and pilot interviews, and were revised during coding.Source: 3) Analysis · p. 3
  • After coding, the researchers created surveys to gather broader feedback on selected interview findings and practice recommendations.The survey response counts were 189 developers and 37 managers.Source: 1) Design · p. 4, Table II · p. 4
  • Focused coding characterized tasks with a reduced set of codes, and theoretical coding examined learning, confidence, social interactions, and three onboarding strategies.Researchers consulted domain experts on the themes and analyzed the strategies’ pros and cons.Source: 3) Analysis · pp. 3–4, 1) Design · p. 4

C. Surveys

The surveys asked developers and managers about onboarding strategies and recommendations derived from interview findings. Pilot studies and question-design choices were used to reduce ambiguity and bias.

C. Surveys

  • The developer survey asked respondents to select the strategy that best described their recent onboarding, then rate statements about learning, confidence, social interactions, and mentors.The questions included open responses, and background information was collected before the survey sections.Source: C. Surveys · p. 4
  • The manager survey asked which strategy managers used for junior and senior developers and how likely they were to use the practice recommendations.Managers could explain their choices and indicate when a recommendation was already in practice.Source: C. Surveys · pp. 4–5
  • Two rounds of in-person pilot studies with five recently onboarded developers and managers were used to revise survey questions for ambiguity and bias.The pilot participants did not take part in the actual survey, and important terms were defined before questions.Source: C. Surveys · p. 5

2) Administration:

Interview findings center onboarding on learning, confidence, and social interaction, with managers treating independence as a final checkpoint. Learning emerged through tasks and team resources.

2) Administration:

  • 189 developers and 37 managers replied to surveys sent to 1,629 developers and 754 managers.Source: 2) Administration · p. 5

III. INTERVIEW FINDINGS

  • The interviews identified 15 onboarding constructs, with learning, confidence, and social interaction highlighted as especially critical.Source: §III · p. 5

A. Learning, Confidence, and Social Connections

1) Learning:

  • 41 of 61 task items (67%) led to learning about team repositories, customers, tools, processes, and responsibilities.Source: 1) Learning · p. 5
  • Clear, complete, updated, well-organized task documentation helps new developers find information and avoid inaccurate or incomplete answers.Source: 1) Learning · p. 5
  • Task-support mentors help new developers solve problems, learn tools and processes, find resources, and reach other teammates.Source: 1) Learning · p. 5
  • Technical meetings expose new developers to team work, workflows, and responsibilities; they can also answer task questions, but may overwhelm some attendees.Source: 1) Learning · pp. 5–6
  • Explaining a task’s context and team connections before assigning it helps developers filter details and avoid information overload.Source: 1) Learning · p. 6

2) Confidence:

Confidence is a key part of onboarding and can be undermined by unfamiliar technologies, processes, or slow progress. Interviews linked it to task completion, feedback and trust, learning, and accessible support.

2) Confidence:

  • Finishing tasks can build confidence by showing new developers they can deliver value, while slow progress can lower confidence and create pressure.Source: 2) Confidence · p. 6
  • Positive feedback and signs of team trust support confidence; senior developers in the interviews received that confirmation faster and reported better onboarding experiences than junior developers.Source: 2) Confidence · pp. 6–7
  • Learning about the team and clarifying task requirements can improve confidence, so managers are advised to set clear expectations about learning gains.Source: 2) Confidence · p. 7
  • Accessible support from a manager, mentor, or paired senior teammate helps new developers feel confident while working on tasks.Source: 2) Confidence · p. 7

3) Socialisation:

Socialization develops through mentor and teammate interactions and task collaboration. The interviews suggest that task effects depend on context and support, particularly when tasks are uncertain or cross-team.

3) Socialisation:

  • Mentors were helpful to 14 of 18 participants who had one, and can reduce help-seeking barriers by providing an accessible first contact.Source: 3) Socialisation · p. 7
  • 29 of 38 task items involving social interaction strengthened connections, but hesitation to ask for help can reduce interaction; low-cost help channels can ease that barrier.Source: 3) Socialisation · p. 7
  • Collaborative tasks can establish new connections, but cross-team work and delays awaiting feedback may harm motivation and confidence, so such tasks warrant caution.Source: 3) Socialisation · p. 7

4) Answering RQ1.:

  • The interviews characterize onboarding as long-term and context-dependent: uncertain tasks may support learning and social interaction with team support, but hinder onboarding without it.Source: 4) Answering RQ1 · p. 7

B. Onboarding Strategies

The interviews surfaced three task-assignment strategies: Simple-Complex, Priority-First, and Exploration-Based. Simple-Complex progresses from simple tasks toward greater complexity, with depth-first and breadth-first variants after the initial months.

B. Onboarding Strategies

1) Simple-Complex:

  • Simple-Complex was used by 12 managers and applied to 14 developers in the interviews.Source: 1) Simple-Complex · p. 7
  • In Simple-Complex, task complexity increases over time, from introductory bugs or configuration tasks toward domain expertise and feature design.Source: 1) Simple-Complex · pp. 7–8
  • The example progression starts with simple tasks in week one, codebase bugs or features over the next two or three weeks, and domain expertise over the next three to nine months.Source: 1) Simple-Complex · p. 7
  • Managers use Simple-Complex tasks to meet learning goals; completed tasks can build confidence, while expectations in the examples progress toward independent work.Source: 1) Simple-Complex · p. 8
  • After three to nine months, Depth-First develops expertise in one domain before expanding, whereas Breadth-First exposes developers to multiple areas first.Source: 1) Simple-Complex · p. 8
  • Depth-First is more common in the interviews and is linked to domain ownership, confidence, and social interaction; Breadth-First supports exploration and a broader team network.Source: 1) Simple-Complex · p. 8

2) Priority-First:

Priority-First assigns backlog work in order, which can deliver value quickly but may challenge new developers; Exploration-Based offers open-ended work whose fit depends on developer and team context.

2) Priority-First:

  • Priority-First gives developers the highest-priority backlog task, and twelve developers in the interviews onboarded this way.Two managers described assigning tasks in backlog order rather than reserving projects for new hires.Source: 2) Priority-First · p. 8
  • Under pressure, Priority-First can generate immediate team value, and focused coworkers helped one developer feel safe learning through urgent work.Four of six developers reportedly in pressured teams were onboarded this way.Source: 2) Priority-First · p. 8
  • Eight developers described Priority-First tasks as challenging, and early difficulty could lower confidence, while pairing with experienced developers offered support.One developer reported zero confidence about an urgent task; two managers used pair programming or paired new hires with experienced developers.Source: 2) Priority-First · p. 8

3) Exploration-Based:

  • Exploration-Based assigns loosely defined tasks and was used for both senior and junior developers, including technical spikes and tool prototyping outside the core product.The outside-core-product tasks were intended to permit exploration without production-code risk or time pressure.Source: 3) Exploration-Based · p. 8
  • Exploration-Based may create pressure when delivery is slow, but new-team settings can make it more comfortable through shared learning, help, and broad social connections.Five of nine developers from reportedly new teams used this strategy; two interviewees described learning together and building broad connections.Source: 3) Exploration-Based · p. 8

4) Answering RQ2.:

The interviews recommend matching onboarding strategies to developer experience and team circumstances. Surveys of Microsoft developers and managers broadly supported the reported experiences, recommendations, and strategy categories.

4) Answering RQ2.:

  • Simple-Complex gradually prepares junior developers, Exploration-Based suits experienced developers seeking learning and ownership, and Priority-First fits teams with particular needs.The paper identifies Agile teams, new teams, and teams with tight schedules as contexts that may use Priority-First.Source: 4) Answering RQ2 · p. 8

IV. SURVEY RESULTS

  • The surveys received 189 developer responses from 1,629 invitations and 37 manager responses from 754 invitations.These corresponded to response rates of 11.6% and 4.9%, respectively.Source: §IV · p. 9

A. About experiences and recommendations

  • On average, 88.9% of developers agreed with experience statements, while 81.9% of managers not using a recommended practice considered it useful.An average of 36.8% of managers already used recommended practices; the authors interpret the survey as supporting representativeness and actionability within Microsoft.Source: A. About experiences and recommendations · p. 9

B. About the three strategies

  • The three strategies covered 96.3% of reported onboarding experiences, and 94.4% and 85.7% of managers identified one of them as their strategy.The authors conclude the categories explain the design intention of most onboarding experiences.Source: B. About the three strategies · p. 9
  • Managers reported using Simple-Complex for junior developers more often than senior developers, while Exploration-Based was more common for senior developers.The reported comparisons were 86.1% versus 48.6% for Simple-Complex, and 27.6% versus 5.5% for Exploration-Based.Source: B. About the three strategies · p. 9

V. DISCUSSION AND RELATED WORK

The discussion relates task-based onboarding to prior work while distinguishing software-team settings and objectives. The validity section notes constraints in survey measurement, retrospective interviews, and the single-company setting.

V. DISCUSSION AND RELATED WORK

  • Unlike broader onboarding research, this study emphasizes software-specific task properties and notes that its findings concern collocated teams, not distributed teams.The authors identify distributed-team task assignment as requiring further consideration.Source: §V · p. 9
  • The study extends prior onboarding and community-entry work by treating onboarding as a multi-stage path toward independent contribution and identifying Priority-First alongside other task strategies.It also distinguishes industry roles and responsibilities from those in open-source communities.Source: §V · p. 9
  • The findings offer guidance for designing onboarding task-selection tools, including attention to negative code-review feedback that may hurt confidence.The paper points to existing work on detecting negative interpersonal interactions in code reviews as a possible support for onboarding.Source: §V · p. 9

VI. THREATS TO VALIDITY

  • Survey agreement serves as an indirect validity measure, based on the assumption that agreement reflects consistent experiences or perspectives.The authors describe using clear, concrete, neutral survey wording and allowing explanations to address concerns about this measurement.Source: §VI · pp. 9–10
  • Interview recall may be biased, although the researchers used recent participants, multiple researchers, recordings, and expert feedback to address bias.The authors suggest longitudinal observation of developers onboarding as a future direction.Source: §VI · p. 10
  • The study sampled two Microsoft divisions, but its single-company setting limits the scope of external-validity evidence; distributed teams are also outside its focus.The divisions differed in products, businesses, and cultures, which the authors say improves generalizability within the study.Source: §V · p. 9, §VI · p. 10

VII. CONCLUSION AND FUTURE DIRECTIONS

The study characterizes how onboarding tasks relate to learning, confidence, and social interactions, and summarizes strategies managers use. It offers practitioner recommendations and calls for quantitative and experimental follow-up.

  • This first study of software developer onboarding tasks links tasks to learning, confidence, and social interactions, and summarizes three strategies managers use.Source: §VII · p. 10
  • Microsoft practitioners validated the study’s onboarding recommendations as useful and practical.Source: §VII · p. 10
  • Future experiments comparing the three onboarding strategies could provide quantitative perspectives on onboarding.Source: §VII · pp. 10–11
  • The study’s task measurements are subjective because they are based on interviews; future work could develop objective measures.Source: §VII · p. 11
  • The authors envision a theory that captures how onboarding shapes teams and teams reshape onboarding, given its correlation with productivity, job satisfaction, retention, and creativity.Source: §VII · p. 11
Loading 2103.05055v1…