About The Role
We are seeking a dedicated and dynamic individual to manage the creation and refinement of rater training and scoring materials for large-scale English language assessments. The ideal candidate will have a strong background in educational assessment and project management, with a commitment to improving educational outcomes for K-12 English learners.
Responsibilities
General
- Develop and update procedures for creating rater training materials
- Create and maintain general rater training presentations
- Manage team access to scoring resources
- Participate in special projects related to the training of test raters and scoring of constructed response tasks
- Collaborate with test development managers to document task performance observations and communicate key insights to the team
Field Test Scoring
- Select anchor responses and create training response sets using provided response lists
- Review, revise, and approve written score justifications
- Collaborate with test development managers to refine task-specific scoring guidance
- Ensure consistent application of scoring rubrics and principles
- Identify potential scoring challenges and collaborate on resolutions
- Monitor field test response availability and communicate updates with team members
Operational Scoring
- Select additional responses to enhance rater training materials for newly operational tasks
- Review and confirm score accuracy for responses selected by the scoring vendor
- Monitor rater agreement rates and score distributions
- Review and confirm score changes proposed by the scoring vendor
- Collaborate with test development managers to address client and scoring vendor questions
Qualifications
Education and Experience
- A Bachelor's degree in a relevant field (e.g., Applied Linguistics, Educational Assessment, TESOL) with at least four years of relevant experience, or a Master's degree in a relevant field with at least two years of relevant experience
- Experience scoring written and/or spoken responses produced by K-12 students
Ideal Candidate
- Experience scoring responses from second language learners
- Experience working with K-12 multilingual learners
- Experience teaching English to speakers of other languages
- Strong oral and interpersonal communication skills
- Excellent organization, planning, and time management skills
- Excellent writing, editing, and proofreading skills
- Strong grasp of second language development
- Knowledge of a language other than English
- Proficiency with project management tools (e.g., Microsoft Project, Smartsheet)
Travel Requirements
- Occasional travel (1-2 times per year) may be required.
Compensation And Benefits
- Minimum Salary: $67,800.00; Benefits eligible
Physical Demands
- Effectively communicate and operate a computer and other office productivity equipment
- Sit or stand in a stationary position for approximately 50% of the time
- CAL adheres to ADA compliance and guidelines as a common practice
Equal Opportunity Employment Statement
We are an equal opportunity employer and comply with all applicable federal, state, and local laws regarding nondiscrimination. We provide equal employment opportunities to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, sexual orientation, gender identity, disability, or genetics.
How To Apply
Please submit your resume and cover letter when applying. We look forward to hearing from you!
Employment Type: Full-Time