SHL
People Science. People Answers.
  • Solutions
    • Virtual
      • RemoteWorkQ
      • Coding Interview
      • Smart Interview Live
      • Smart Interview On Demand
      • Virtual Assessment & Development Centers
    • Talent Acquisition
      • Tech
      • Volume
      • Graduate
      • Professional
      • Manager
    • Talent Management
      • Leader Assessment & Development
      • High Potential
      • Succession Planning
      • Workforce Review
      • Mobilize
    • Services
      • Professional Services
      • Managed Services
      • Training Services
      • Integrated Solutions
  • Assessments
    • Assessments
      • Behavioral Assessments
      • Personality Assessments
      • Cognitive Ability Assessments
      • Job-Focused Assessments
    • Assessments Catalog
    • TalentCentral™
  • Resources
    • View by Type
      • Blogs
      • Podcasts
      • Webinars & Events
    • View by Topic
      • AI in Talent Assessment
      • Gender Diversity: Mind the Gap
      • The Promise of Gen Z
      • U.S. Programming Skills Report
      • Women in Leadership Report
  • Customers
    • Success Stories
    • Testimonials
    • ROI Calculators
  • Company
    • Careers
    • Leadership Team
    • Global Offices
    • Newsroom
    • Awards & Accolades
    • Channel Partners
  • Get Started
  • English
    • Deutsch
    • Français
    • Italiano
    • Nederlands
    • 简体中文
  • Contact Us
  • Buy Online

Can we help you?   1-800-899-7451 (US)   0330 100 3435 (UK)

SHL Blog Our Insights on the 21st Century Workplace

  • View By Recent
  • View By Category
    • Assessment and Selection
    • Data and Analytics
    • Develop and Accelerate
    • Diversity and Inclusion
    • Leadership
    • Life at SHL
    • Workforce Trends
  • View By Popular Topic
    • AI
    • HR Technology
    • Candidate Experience
    • Talent Strategy
    • Digitalization
    • Organizational Culture
    • Workplace Diversity
  • Subscribe
Assessment and Selection

Not Your Grandad’s Cognitive Ability Assessment

Increasing candidate attraction and reach by cracking the code on cognitive ability testing across device types.

July 15, 2019 Darrin Grelle Candidate Experience, HR Technology, SHL Verify Interactive

blog-woman-on-phone-SH002

As we shared in an earlier blog on this topic, more candidates are choosing to take selection assessments on mobile devices each year.  For many, especially those in lower income communities, a mobile device is their only way to access the internet. Naturally, enabling content for mobile devices is a great way to appeal to candidates and reach individuals who might otherwise have difficulty accessing a computer.

However, up until now, simply enabling tests of cognitive ability developed for PCs on mobile devices has been largely unsuccessful. Candidates completing traditional tests of cognitive ability on mobile devices achieve lower scores than they do when completing the same test on a PC.  SHL researchers knew that a very different approach to tackle this thorny issue would be necessary to ensure that candidates could demonstrate their full potential regardless of which device – laptop, tablet, or mobile – they used to complete a test.

The result was a brand-new portfolio of ground-breaking cognitive ability assessments – SHL Verify Interactive.

screenshot-wide-verify-interactive-six-screens

Mobile-First Responsive Web Design

Design for content that will be viewed on multiple devices is most successful when it begins with optimizing the content for the smallest devices. To maintain a consistent experience across devices, the content should respond to larger devices while maintaining the same experience as on the mobile device. Some of the design principles SHL researchers followed to achieve this include:

  • Use minimal text
  • Utilize graphics to convey information wherever possible
  • Eliminate any need for horizontal scrolling– all content must fit within the width of the screen
  • Minimize vertical scrolling to every extent possible
  • Where vertical scrolling must exist on smaller screens, ensure it is also required on larger screens

We also eliminated the need for multiple-choice response options, which can take up a lot of room on screen, by building in user mechanics described here that allow candidates to input responses in the question itself.

Advanced Scoring Methodologies

In a standard multiple-choice question, a candidate only has two scoring options: right or wrong. We don’t know much about the steps the candidate took to arrive at the answer they chose, so the person that was very close to the right answer and the person who had no idea both get the question wrong.

The innovative question formats used in SHL Verify Interactive have multiple data points, and we can give candidates partial credit for the pieces of the question they respond to correctly if they don’t get the whole question correct. This means we can capture up to ten times as much information about a candidate’s ability level within a single question. So, while the typical question takes a bit longer than a traditional multiple-choice question, we learn so much more about the candidate with each question that fewer questions are needed overall.

All Verify tests released after 2012 have been computer adaptive. We continue that tradition with SHL Verify Interactive in this novel application of a partial credit model for which we built an entirely new computer-adaptive algorithm. The theory behind our algorithms are well researched in the peer-reviewed literature, but to our knowledge, this is the first time this body of work has been applied to an adaptive selection assessment.

Candidate performance is not affected by device choice.

Measurement Equivalence

In order to demonstrate empirically that a candidate’s performance on SHL Verify Interactive would not be affected by device choice, we conducted a study in which participants completed SHL Verify Interactive on a mobile device and then on a PC a few days later (half of the sample completed the tests in the opposite device order). We then did a statistical comparison of the scores from both administrations and found negligible and statistically non-significant differences between scores. The scores were also very highly correlated. Both pieces of evidence indicate that candidate performance is not affected by device choice.  This evidence was supplemented by further analyses. providing overwhelming evidence of measurement equivalence across devices¹.

The outcome of our work was SHL Verify Interactive – a ground-breaking portfolio of assessments that attracts candidates and provides them with the opportunity to showcase their skills to potential employers. While SHL is proud of the efforts that went into crafting the engaging look and feel of these tests, we are just as excited about what candidates can’t see.  That is the strong psychometric theory that ensures that candidates’ critical reasoning skills are measured as precisely and fairly as possible – regardless of device type.  Not your Grandad’s cognitive ability assessment indeed!

Learn more about SHL Verify Interactive and how SHL can help you win by providing deep people insights to predict and drive performance. 


¹ These results will be published in a forthcoming peer-reviewed journal article titled “Developing Device-Equivalent and Effective Measures of Complex Thinking with an Information Processing Framework and Mobile First Design Principles” in the journal Personnel Assessment and Decisions.

Share

Author

Darrin Grelle

Darrin Grelle

Darrin Grelle is a Principal Research Scientist for team Digital at SHL with more than 10 years of experience in the talent assessment industry. In this role, he is responsible for the growth and development of one of the largest cognitive ability testing programs in the field of talent assessment. His primary areas of expertise include innovating traditional cognitive assessment formats, design, and development of assessments for mobile delivery, and application of item response theory for computer adaptive testing. Darrin holds a Ph.D. in Applied Psychology from the University of Georgia, with a focus on psychometrics.
4 Areas of Focus to Boost Your Candidate Attraction Efforts What to Do With Your ‘Homegrown’ Assessment Tool?

Related Posts

blog-woman-at-computer-SH009

Assessment and Selection

7 Best Tips on How to Attract Top Tech Talent

Learn our best tips on how to attract top tech talent to your company and stay competitive in the increasingly fierce tech job market.

blog-man-at-desk-UN001

Assessment and Selection

Winning the War for Talent: The Changing Fields and Tools

The war for talent rages on as the fields and tools evolve. Read our blog to learn the secrets to winning the war for talent.

blog-change-neon-UN001

Diversity and Inclusion

How to Make Real Change with Your DEI Efforts

How standard processes throughout the employee lifecycle create the infrastructure needed to create a diverse and inclusive work environment.

Recent Stories

  • How to Improve Internal Mobility Using Contextual Challenges

    How to Improve Internal Mobility Using Contextual Challenges

    4 days ago
  • 7 Best Tips on How to Attract Top Tech Talent

    7 Best Tips on How to Attract Top Tech Talent

    5 days ago
  • How to Keep Your Customers at the Center of Innovation

    How to Keep Your Customers at the Center of Innovation

    6 days ago

Related Stories

Insights by Andy: Uniting Science and AI Technology in Talent Assessment
How the Best Got Better. Reimagining SHL’s Flagship Product – the OPQ
How Talent Acquisition and Management Was Transformed

© 2021 SHL and its affiliates. All rights reserved.

Follow SHL

LinkedIn Twitter Facebook YouTube Instagram

Keep Up with Our Blog Follow SHL on social media to find out when a new article has been shared.