Source-linked AI summary

Enhancing Person-Job Fit for Talent Recruitment: An Ability-aware Neural Network Approach

Chuan Qin, Hengshu Zhu, Tong Xu, Chen Zhu, Liang Jiang, Enhong Chen, Hui Xiong

arXiv:1812.08947v1cs.AIcs.CLcs.LG

TL;DR

Online recruitment creates a Person-Job Fit challenge, while existing methods rely on subjective and inefficient manual inspection. The paper proposes APJFNN, an RNN-based model with hierarchical ability-aware attention, and reports improved performance, robustness, computational evaluation, and interpretability against baselines.

  • Problem

    Person-Job Fit requires matching job requirements with candidate qualifications, but existing approaches largely depend on costly, inefficient, inaccurate, and subjective expert inspection.

  • Method

    APJFNN uses RNN-based word-level semantic representations and four hierarchical ability-aware attention strategies for job requirements and candidate experiences.

  • Results

    APJFNN outperforms all baselines, remains relatively stable across data splits, and highlights matching key phrases for interpretable fitting results.

  • Takeaways & Limitations

    The framework provides an end-to-end approach intended to reduce manual labor while improving Person-Job Fit performance and interpretation.

  • Takeaways & Limitations

    The study mainly focuses on candidates’ working experiences and selected descriptions of other achievements because of real-world data limitations.

Abstract

from arXiv · show

The wide spread use of online recruitment services has led to information explosion in the job market. As a result, the recruiters have to seek the intelligent ways for Person Job Fit, which is the bridge for adapting the right job seekers to the right positions. Existing studies on Person Job Fit have a focus on measuring the matching degree between the talent qualification and the job requirements mainly based on the manual inspection of human resource experts despite of the subjective, incomplete, and inefficient nature of the human judgement. To this end, in this paper, we propose a novel end to end Ability aware Person Job Fit Neural Network model, which has a goal of reducing the dependence on manual labour and can provide better interpretation about the fitting results. The key idea is to exploit the rich information available at abundant historical job application data. Specifically, we propose a word level semantic representation for both job requirements and job seekers' experiences based on Recurrent Neural Network. Along this line, four hierarchical ability aware attention strategies are designed to measure the different importance of job requirements for semantic representation, as well as measuring the different contribution of each job experience to a specific ability requirement. Finally, extensive experiments on a large scale real world data set clearly validate the effectiveness and interpretability of the APJFNN framework compared with several baselines.

1 INTRODUCTION

Online recruitment has made Person-Job Fit more difficult because information growth increases the burden of identifying suitable candidates. Existing approaches rely heavily on manual expert inspection, motivating APJFNN's ability-aware, end-to-end approach.

  • Motivation: Online recruitment platforms create information explosion that makes effective Person-Job Fit techniques increasingly necessary.Person-Job Fit measures the matching degree between talent qualifications and job requirements.
  • Limitations of Existing Work: Existing Person-Job Fit studies largely depend on experts manually inspecting features or key phrases.This dependence is associated with high cost and inefficient, inaccurate, and subjective judgments.
  • Proposed Approach: APJFNN is an end-to-end model designed to reduce dependence on human labeling data and improve interpretation of fitting results.The model addresses ability differences across requirements and candidates rather than relying only on simple keyword matching.
  • Proposed Approach: The model learns word-level semantic representations with an RNN and uses hierarchical ability-aware structures for requirements and candidate experiences.Four attention strategies measure ability importance and requirement–experience relevance.
  • Paper Organization: The paper evaluates APJFNN experimentally after introducing related work, problem formulation, model details, and interpretability analysis.The paper concludes with a summary of the proposed framework and findings.

2 RELATED WORK

Prior work studies recruitment analysis, Person-Job Fit, and deep-learning-based text mining, but the paper positions APJFNN as an interpretable RNN model with ability-aware attention mechanisms.

  • Overview: Related work covers recruitment analysis and text mining with deep learning.The paper organizes prior studies into these two categories.
  • Recruitment Analysis: Recruitment big data has enabled more quantitative recruitment analysis, including Person-Job Fit research on matching qualifications with job requirements.Person-Job Fit is described as a prominent recruitment-analysis topic.
  • Recruitment Analysis: Earlier studies used candidate and job profiles, preferences, and interests for person-job recommendation and matching.Later work also modeled user- or item-level effects and reported increased job applications in a LinkedIn recommender system.
  • Text Mining: Text-based Person-Job Fit relates to NLP tasks including classification, similarity, and reading comprehension.Deep learning reduces reliance on manually designed representations and input features.
  • Text Mining: CNNs extract local semantics, whereas RNNs model sequential text and long-span relations or global semantic representations.These architectures are presented as representative deep-learning approaches for NLP.
  • Positioning of APJFNN: APJFNN combines an RNN-based neural model with four ability-aware attention mechanisms to improve Person-Job Fit performance and interpretability.Figure 2 presents word-level representation, hierarchical ability-aware representation, and fit prediction components.

3 PROBLEM FORMULATION

The paper formulates Person-Job Fit as predicting recruitment outcomes from job postings and resumes, representing requirements and candidate experiences as structured textual inputs.

  • Task Definition: Person-Job Fit measures the matching degree between job requirements in a posting and experiences in a resume.The task concerns a job–candidate pair.
  • Job Representation: A job posting contains p ability requirements, including professional skills and comprehensive qualities.Requirements are represented as word sequences and analyzed without special distinction between these types.
  • Candidate Representation: A candidate resume contains q experiences, represented as word sequences describing work and other achievements.The study mainly focuses on working experiences, project experiences, competition awards, and research publications.
  • Application Labels: Each application pairs a job posting with a resume and assigns a binary label indicating whether the candidate passed the interview process.The same job or resume may occur in multiple applications.
  • Task Definition: Given labeled job applications, the goal is to learn a predictive model that measures job–resume matching and predicts the recruitment result.The formal problem definition names the model M and label y.
  • Transition: The following section introduces APJFNN as the model for addressing this formally defined Person-Job Fit problem.

4 ABILITY-AWARE PERSON-JOB FIT NEURAL NETWORK

APJFNN builds person-job fit representations from words upward, using BiLSTM-based word encoding and hierarchical ability-aware attention for requirements and candidate experiences. Its four attention mechanisms emphasize relevant words, abilities, and experiences to support both fitting prediction and interpretation.

  • Architecture: APJFNN comprises word-level representation, hierarchical ability-aware representation, and person-job fit prediction.The hierarchical component operates over both job postings and resumes.
  • Word-level Representation: BiLSTM encodes job-posting and resume words with sequential context using shared word embeddings and forward and backward processing.LSTM retains longer-range contextual information, while bidirectional processing concatenates forward and backward hidden vectors.
  • Interpretability: Four attention mechanisms refine representations at different levels and improve interpretability by exposing the importance of requirements and contributions of experiences.The mechanisms cover single and multiple ability-aware representations for both job requirements and candidate experiences.
  • Single Ability-aware in Job Requirement: A first attention mechanism weights words within each ability requirement to produce a single ability-aware requirement representation.The attention scores estimate the importance of each word in the requirement.
  • Multiple Ability-aware in Job Requirement: A second hierarchical structure models the sequence of ability requirements and weights their differing importance to summarize a job’s overall needs.A BiLSTM captures requirement order before attention produces a weighted representation.
  • Candidate Experience: For resumes, attention scores measure each word-level experience representation’s contribution to a specific ability requirement, while document structure supports higher-level experience modeling.The resulting scores are intended to show whether and why a candidate is qualified for an ability requirement.

5 EXPERIMENTS

Experiments use an anonymized real-world recruitment dataset and compare APJFNN with conventional supervised, feature-based, and neural baselines. Results indicate that APJFNN improves Person-Job Fit performance, remains robust across training splits, and provides interpretable ability- and experience-level attention.

  • Data Description: The anonymized dataset contains 17,766 job postings and 898,914 resumes across Technology, Product, User Interface, and Others categories.Most applications are technology-oriented, and about 1% were accepted.
  • Data Description: After removing incomplete resumes and job postings without successful applications, experiments retained 3,652 postings, 12,796 successful applications, and 1,058,547 failed applications.The resulting data are strongly imbalanced, and one candidate may apply to multiple positions.
  • Experimental Setup: APJFNN is compared with LR, DT, AB, RF, GBDT, bag-of-words and mean-word-embedding inputs, plus the simplified RNN-based BPJFNN baseline.The baselines use either bag-of-words vectors or averaged pretrained word embeddings, while BPJFNN uses two BiLSTMs.
  • Overall Results: APJFNN outperforms all baselines with a significant margin, while outperforming BPJFNN indicates that its attention strategies improve matching estimation and explanation.The comparison uses successful applications as positives and failed applications as negatives, with under-sampling to balance each job posting.
  • Robustness and Efficiency: APJFNN remains relatively stable across train/test splits, with best-to-worst improvements of only 5.44% and 2.99% for the two reported metrics.Using 60% of the data for training already outperforms all baselines trained with 80%.
  • Interpretability: Attention highlights requirement-relevant phrases and differentiates the importance of skills, abilities, and candidate experiences for specific matching decisions.Examples include stronger attention to “WeChat public platform” for SNS-related requirements and higher significance for scarce independent business negotiation ability.

6 CONCLUSIONS

The paper proposes APJFNN, an end-to-end model using historical job-application data to reduce manual labor and improve interpretation of Person-Job Fit results.

  • APJFNN targets reduced dependence on manual labor while providing better interpretation of Person-Job Fit results.
  • The model learns word-level semantic representations for job requirements and job seekers’ experiences using an RNN.
  • Four hierarchical ability-aware attention strategies estimate requirement importance and each experience’s contribution to a specific ability requirement.
  • Extensive experiments on a large-scale real-world dataset validate APJFNN’s effectiveness and interpretability against several baselines.

APPENDIX

The appendix addresses fairness concerns in recruitment models by examining gender information under a semi-synthetic bias setting and comparing validation and testing performance.

  • Recruitment algorithms must address fairness because biased training data can produce gender-related value deviations.
  • The appendix also includes an example illustrating Attention γ’s advantage in extracting ability-aware information from candidate experience.
  • The semi-synthetic experiment balances successful and failed applications by gender, then introduces mislabeled gender-associated outcomes in training and validation data.
  • Table 3 reports APJFNN and baseline performance on the semi-synthetic dataset.
  • Models using gender perform better on validation data because its distribution resembles training data, indicating learned bias.
  • All models perform better without gender information on the testing set, supporting exclusion of corresponding biased features from training.
Loading 1812.08947v1…