Assessment Specialist

Job Summary:

The Assessment Team within the School of Medicine's Office of Assessment, Evaluation, and Outcomes (AEO) is responsible for the design, development, delivery, scoring, analysis, and results reporting for written assessments taken by undergraduate medical students. Under the leadership and supervision of the Director of AEO, the Assessment Specialist will be responsible for all item banking and test development work associated with the pre-clinical and advanced science courses. It is critical that this position establish strong working relationships with faculty to support and promote best practices in assessment and provide item writing training and feedback. The Assessment Specialist must also be highly organized and detail-oriented to manage numerous overlapping test development schedules and processes. Strong Microsoft Excel skills are also required to complete work accurately and efficiently.

Key Responsibilities:

Assessment Planning:

• Create and execute test development plans, ensuring alignment with curricular goals.
• Collaborate with faculty to define exam scope and manage timelines effectively.
• Assist in maintaining and updating assessment policies and procedures.

Item Development:

• Review and revise assessment items for clarity and adherence to guidelines.
• Provide feedback to faculty on item quality and lead collaborative review meetings.
• Ensure items align with learning objectives and quality standards.

Form Development:

• Assemble exam forms using faculty input, blueprint specifications, and psychometric data.
• Recommend item revisions based on psychometric analysis and best practices.
• Finalize and approve exam forms, ensuring they meet all required specifications.

Exam Production:

• Conduct quality control testing of exam forms in a secure environment.
• Post exams to the testing platform and ensure all settings and attachments are correct.
• Notify students of exam availability and provide specific administration details.

Item Banking:

• Maintain item metadata and organize the item bank for easy access by course and exam.
• Prepare item collections for faculty review before each course and update items post-exam.
• Track item status and feedback for continuous improvement.

Post-Administration Processes:

• Prepare key validation documents and annotate exams with performance data.
• Upload exam scores and release results to students.
• Assist in generating exam summaries and reports for curriculum improvement.

This description is a summary only and is describing the general level of work being performed, it is not intended to be all-inclusive. The duties of this position may change from time to time and/or based on business needs.

Work Location:

Hybrid eligible - required to be onsite minimally 2 days per week. Additional on-site days may be required when particular sessions, on-site meetings, or events necessitate an additional on-site presence. Remote work schedules and/or remote work arrangements may be discontinued or modified at any time. Please see the campus-wide policy for additional information.

Why Join Us:

Joining the Assessment, Evaluation, and Outcomes (AEO) office means becoming a key player in shaping the future of medical education. AEO ensures that our curriculum meets rigorous accreditation standards, driving continuous improvement in educational quality. By collaborating closely with the Curriculum Steering Committee (CSC), we actively influence and refine all aspects of the MD program. This is an opportunity to engage with diverse data sources, contribute to impactful decisions, and support the development of future medical professionals. Be a part of a dynamic team dedicated to educational excellence and innovation!

For more information, visit the AEO Evaluation page.

Why work for the University?

We have AMAZING benefits and offer exceptional amounts of holiday, vacation and sick leave! The University of Colorado offers an excellent benefits package including:

• Medical: Multiple plan options
• Dental: Multiple plan options
• Additional Insurance: Disability, Life, Vision
• Retirement 401(a) Plan: Employer contributes 10% of your gross pay
• Paid Time Off: Accruals over the year
• Vacation Days: 22/year (maximum accrual 352 hours)
• Sick Days: 15/year (unlimited maximum accrual)
• Holiday Days: 10/year
• Tuition Benefit: Employees have access to this benefit on all CU campuses
• ECO Pass: Reduced rate RTD Bus and light rail service

There are many additional perks & programs with the CU Advantage.

Diversity and Equity:

The University of Colorado Anschutz Medical Campus is committed to recruiting and supporting a diverse student body, faculty and administrative staff. The university strives to promote a culture of inclusiveness, respect, communication and understanding. We encourage applications from women, ethnically minoritized individuals, persons with disabilities, persons within the LGBTQ+ community and all veterans. In addition, the Anschutz Campus has also been recognized as an Age-Friendly University. The University of Colorado is committed to diversity and equality in education and employment.

Qualifications:

Minimum Requirements:

• Bachelor's degree in education, psychology, business, public administration, health care, educational technology, social science, liberal arts, communications, accounting, finance, library science, or a directly related field from an accredited institution.
• Two years of professional level experience in academic program assessments, evaluations and outcomes.
• Experience developing professional examinations and/or educational assessments
  
  
  
  • Substitution: A combination of education and related technical/paraprofessional experience may be substituted for the bachelor's degree on a year for year basis, but not for the specific experience.
  
  
  
  

Preferred Qualifications:

• Master's degree in education, assessment and evaluation, management, and/or educational administration.
• Three to five years of administrative experience with academic program assessment in a university or higher education setting.
• Experience with developing medical knowledge examinations in either an academic or professional testing environment
• Three years of project management experience
• Experience working in and managing an online item banking system
• Experience working with learning management systems (e.g., Ilios, Canvas)

Competencies:

• Strong written and verbal communication skills
• Expertise in question writing and test construction; understanding of measurement principles
• Familiarity with innovative item types and different assessment modalities
• Strong Excel skills including the ability to use pivot tables and a variety of formulae
• Must be detail-oriented with exceptional editing skills
• Exemplary organizational, project management, and problem-solving skills with demonstrated ability to manage complex processes and multiple, concurrent, and overlapping projects
• Ability to work independently and as a member of a team
• Must be able to work effectively, collaboratively, and in a professional manner with University and school leadership, faculty, and staff

How to Apply:

For full consideration, please submit the following document(s):

1. A letter of interest describing relevant job experiences as they relate to listed job qualifications and interest in the position

2. Curriculum vitae / Resume

3. Three to five professional references, including name, address, phone number (mobile number if appropriate), and email address

Questions should be directed to: Lucinda Allen, Lucinda.allen@cuanschutz.edu

Screening of Applications Begins:

Applications will be accepted until finalists are identified, but preference will be given to complete applications received by October 16, 2024.Those who do not apply by this date may or may not be considered.

Anticipated Pay Range:

The starting salary range (or hiring range) for this position has been established as

$52,961 - $67,367.

The above salary range (or hiring range) represents the University's good faith and reasonable estimate of the range of possible compensation at the time of posting. This position may be eligible for overtime compensation, depending on the level.

Your total compensation goes beyond the number on your paycheck. The University of Colorado provides generous leave, health plans and retirement contributions that add to your bottom line.

Total Compensation Calculator: http://www.cu.edu/node/153125

ADA Statement:

The University will provide reasonable accommodations to applicants with disabilities throughout the employment application process. To request an accommodation pursuant to the Americans with Disabilities Act, please contact the Human Resources ADA Coordinator at hr.adacoordinator@cuanschutz.edu.

Background Check Statement:

The University of Colorado Anschutz Medical Campus is dedicated to ensuring a safe and secure environment for our faculty, staff, students and visitors. To assist in achieving that goal, we conduct background investigations for all prospective employees.

Vaccination Statement:

CU Anschutz strongly encourages vaccination against the COVID-19 virus and other vaccine preventable diseases. If you work, visit, or volunteer in healthcare facilities or clinics operated by our affiliated hospital or clinical partners or by CU Anschutz, you will be required to comply with the vaccination and medical surveillance policies of the facilities or clinics where you work, visit, or volunteer, respectively. In addition, if you work in certain research areas or perform certain safety sensitive job duties, you must enroll in the occupational health medical surveillance program.