To meet the growing demand for Amazon Web Services around the globe, we need exceptionally talented, bright, and driven people. We are looking for a dynamic, organized self-starter to join the AWS Certification Team focusing on holistic strategies and multiple audiences for our AWS Certification offerings. As part of this team, you will be responsible for maintaining the validity of our certifications and supporting initiatives to improve quality, efficiency, and alignment with AWS technologies, solutions, and services.
We are seeking a Psychometrician with experience working with criterion-referenced assessment programs to support a large global AWS Certification program. In this role, you will support all psychometric aspects of exam development, including job analyses, standard setting, automatic item generation and automated test assembly, quality assurance, applications of natural language processing, item and test analyses, optimal item bank design, and project planning.
You will work closely with a team of psychometricians, subject matter experts, certification exam program managers in development, publishing, delivery, security, product management and translation/localization to support ongoing analyses of exam data. To be successful in this position, you must be highly motivated, creative, and a self-starter who is able to think big, execute, yet stay focused on the details.
Key job responsibilities
• Run item analysis to evaluate quality and performance of exam items
• Use automated test assembly procedures to assemble forms or item pools
• Work with content development to optimize the health of item banks
• Support the development of a cloud-based analytics and reporting system
• Interpret and clearly communicate the results of analyses to stakeholders through written and oral reports
• Support or conduct standard setting studies to set the passing score for an exam
• Support or conduct Job Task Analysis (JTA) workshops and post-JTA survey analyses to define the blueprint and test specifications for new certifications or updates to existing certifications
• Support ongoing efforts to incorporate Automatic Item Generation and Assessment Engineering into the item development processes
• Follow the accreditation standards set by ISO/IEC:2012 17024 and the National Council for Certifying Agencies (NCCA) as they relate to valid psychometric practices
• Contribute to the development and execution of the strategic goals regarding the AWS certification program.
• Consult with leadership, internal staff, external consultants, and industry leaders regarding advancement of current offerings
About the team
The AWS Certification program recognizes demonstrated expertise and grants certification for 12 key IT Cloud roles.
We are open to hiring candidates to work out of one of the following locations:
Arlington, VA, USA | Chicago, IL, USA | Seattle, WA, USA
BASIC QUALIFICATIONS
– PhD
– Direct experience working with high stakes certification or licensure programs.
PREFERRED QUALIFICATIONS
– Knowledge of R or Python
– Experience with different exam designs and delivery (e.g. LOFT, CAT)
Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit https://www.amazon.jobs/en/disability/us.
Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $127,300/year in our lowest geographic market up to $247,600/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit https://www.aboutamazon.com/workplace/employee-benefits. Applicants should apply via our internal or external career site.