The Science
As lifelong technologists, we have diligently mastered the process of engineering scientific instruments.
A team of experts spanning multiple continents, we ground our work in undeviating scientific principles.
As both we and our corporate members value precision when building our teams, PAC rigorously designs, analyzes and validates instruments to measure talent.
The Blueprint of Success
From years of experience working with global authorities in test development, we understand the content and criterion essential to measuring and comparing talent.
Critical Correlation
Through statistical and market research on the factors that influence on-the-job execution, we define parameters for evaluating talent. We focus on understanding the correlations that reveal not only knowledge, but also the ability to apply knowledge.
Structural Archetype
We logically define the structure for each assessment, using it as a factor in assessing talent proficiency. We divide all content into timed sections by topic, then provide a section level score. Talent performance in each section reveals information on strengths and areas of growth.
The Power of Global Standards
When developing the content for assessments we distinguish between knowledge and the ability to execute. We work with leading global minds, such as professors and industry experts, to verify the content that demonstrates crucial talent proficiency.
Targeted Groups
We design all assessments to account for targeted groups defined by their level of experience. In addition, we administer assessments that correspond to the experience levels of individuals being evaluated.
A Standard of Caliber
Consistently producing effective scientific instruments requires a systematic process of scrutiny. We use stringent standards to ensure that our assessments are of the highest caliber.
Authoritative Content
Developed by some of the world's most astute subject specialists, the content of our scientific instruments is not only thorough and accurate, but it also correlates to critical marketplace skills.
Rigorous Inspection
When developing the content for assessments, we perform – for every – item, answer and distracter correlations, identifying if the distribution of answer selections falls within an acceptable norm, and based on that information, determine question difficulty level. We modify questions with answer selection patterns that fall outside of an acceptable norm. In addition to item and distracter correlation, we review all questions and their correlations with assessment scores.
Item and Assessment Correlation
When developing the content for assessments we perform item, answer and distractor correlations, identifying if the distribution of answer selections falls within an acceptable norm, and based on that information determining question difficulty level. We modify questions with answer selection patterns that fall outside of an acceptable norm. In addition to item and distractor correlation, we review all questions and their correlations with assessment scores.
Iterative Analysis
Content and construct validity are essential to building scientific instruments of precision. Therefore, we methodically re-evaluate and revise content to increase statistical accuracy.
Normalization
Our dynamic assessment engine constantly normalizes assessment results to establish an appropriate standard deviation. Post normalization, we band all talent along a normal curve to show how they compare to their peers.
Post Assessment Analysis
By testing talent all over the world with our content, we collect valuable data on its efficacy. We systematically analyze item and assessment performance based on the results of varying geographic sample groups.
Correlation Studies
After assessments have been released, we cyclically examine and analyze results to ascertain that they accurately reflect market patterns. Items found to be out of date or no longer effective are removed or modified to meet current standards.
An Encyclopedic Process
PAC scientific instruments are designed, created and validated in five phases—Blueprint, Creation, Substantiation, Release and Analysis. While the initial process lasts up to two months, we consistently repeat it to certify the statistical rigor of every assessment.
Blueprint
Working with preeminent experts, we create blueprints to define and authenticate assessment content and structure. In the blueprint we establish the pivotal factors that correlate to successful job performance.
Creation
Based on the blueprint, leading subject specialists develop assessment content that correlates to critical marketplace skills.
Substantiation
During the substantiation process we further validate assessment content. Through groups of individuals who serve as the first round of testers, we calibrate content and establish difficulty ratings by statistically surveying the results. In addition, we review all content for accuracy and modify it. Once questions have been reviewed we correlate them to assessments.
Release
After questions pass the stringent standards of the substantiation process, we enter them into our assessment engine in preparation for release to our Members. Once in the system, assessments are dynamically created and presented to our Members.
Analysis
To confirm proper standard deviations and test reliability, our dynamic assessment engine constantly normalizes assessment scores. In addition, we perform cyclical examinations and correlation studies to monitor the efficacy of items. Ineffective or out of date items are adapted or phased out of use. Based on these studies, we also refine existing blueprints and develop new content.