New

AI Evaluation Lead

University of Illinois Chicago
life insurance, paid time off, retirement plan
United States, Illinois, Chicago
Oct 11, 2025
AI Evaluation Lead AI Evaluation Lead Hiring Department: Hospital Administration Location: Chicago, IL USA Requisition ID: 1037482 Work Schedule: M-F Workplace Type: Hybrid Posting Close Date: 10/16/2025 Salary Range (commensurate with experience): $99,289.00 - 148,933.00 / Annual Salary; Final salary offered will be determined by market data, internal equity, candidate experience/qualifications, and budget. About the University of Illinois Hospital & Health Sciences System (UI Health) The University of Illinois Hospital & Health Sciences System (UI Health) provides comprehensive care, education, and research to the people of Illinois and beyond. A part of the University of Illinois Chicago (UIC), UI Health comprises a clinical enterprise that includes a Joint Commission-accredited tertiary care hospital and outpatient clinics, and the Mile Square Health Center network of federally qualified health centers. It also includes the seven UIC health science colleges: the College of Applied Health Sciences; the College of Dentistry; the School of Public Health; the Jane Addams College of Social Work; and the Colleges of Medicine, Pharmacy, and Nursing, including regional campuses in Peoria, Quad Cities, Rockford, Springfield, and Urbana. UI Health is dedicated to the pursuit of health equity. Learn more: https://hospital.uillinois.edu/about-ui-health This position is intended to be eligible for benefits. This includes Health, Dental, Vision, Life Insurance, a Retirement Plan, Paid time Off, and Tuition waivers for employees and dependents. Position Summary The IT Technical Associate (AI Evaluation Lead) role will operationalize a standardized assessment framework to guide the systematic review of proposed AI tools, ensuring they are thoughtfully and proactively assessed for value, reliability, and alignment with organizational goals. It works closely with operational and clinical leadership, Information Services, compliance, research, and academic partners to enable AI innovations that improve care delivery, operational efficiency, and patient outcomes. Facilitates and guides the evaluation, governance, and implementation of artificial intelligence (AI) solutions across UI Health and AI.Health4All by providing leadership and vision, ensuring alignment with clinical needs, operational priorities, regulatory requirements, and patient safety. This position serves as a bridge between clinical, technological, and academic stakeholders, integrating innovation with compliance to support responsible and effective AI adoption. Duties & Responsibilities Develops and deploys structured evaluation of proposed AI tools using a standardized framework, including assessment of clinical relevance, operational feasibility, financial impact, ethical considerations, and regulatory compliance. Manages intake, triage, and prioritization of AI proposals to ensure alignment with organizational goals and available resources. Facilitates the evaluation and adoption of AI functionality released within Epic/EHR systems across all application teams, maintaining a forward-looking approach to stay current with emerging technologies while carefully managing associated risks. Coordinates multidisciplinary reviews with Information Services, clinical leadership, compliance, research, and operational stakeholders. Identifies potential implementation risks and partners with stakeholders to develop and monitor mitigation strategies. Conducts workflow simulations and documents evaluation outcomes to inform decision-making and adoption planning. Guides deployment strategies, including local infrastructure considerations, operational readiness, and integration into clinical workflows. Establishes and maintains governance processes to ensure AI tools are implemented, monitored, and evaluated for ongoing performance and return on investment. Creates, maintains, and utilizes project reporting and data visualization tools to track progress and communicate results to stakeholders on a regular basis. Promotes education, transparency, and communication around AI assessment standards, fostering engagement and trust among clinicians, operational leaders, and technology teams. Ensure alignment with Organization Strategic Goals Performs other related duties and projects as assigned Minimum Qualifications Bachelor Degree - Computer Science, Engineering, Information Systems Management, related information management field or a clinical area of study. Minimum of eight (8) years professional level IT experience within Data Analytics & Integration which includes demonstrated experience in designing, implementing, and supporting clinical application interfaces, as well as developing, modifying, distributing, and testing reports, metrics, dashboards, and self-service reporting capabilities in the business intelligence suite of tools and applications. Preferred Qualifications Familiarity with AI and machine learning tools in healthcare contexts, including governance processes, regulatory compliance, and risk assessment. Experience with electronic health record (EHR) systems, preferably Epic, and an understanding of their integration with emerging technologies. Demonstrated ability to analyze complex problems, develop strategic recommendations, and implement innovative, data-driven solutions. Exposure to research, academic, or regulatory environments preferred. Advanced degree in health informatics, public health, or a related discipline preferred. Strong leadership, interpersonal, written, and verbal communication skills with the ability to coordinate effectively across diverse stakeholder groups. Proven skill in conflict resolution, consensus building, and diplomacy. Demonstrated experience partnering with hospital leadership and operational teams to implement IT solutions effectively. Consistently delivers projects that meet objectives within established timelines and budget constraints. Tolerance for ambiguity and comfort working in a complex organization and adapting to changing situations. To Apply: For fullest consideration click on the Apply Now button, please fully complete all sections of the online application including adding your full work history with specific details of your duties & responsibilities for each position held. Fully complete the education, licensure, certification and language sections. You may upload a resume, cover letter, certifications, licensures, transcripts and diplomas within the application. Please note that once you have submitted your application you will not be able to make any changes. In order to revise your application you must withdraw and reapply. You will not be able to reapply after the posting close date. Please ensure the application is fully completed and all supporting documents have been uploaded before the posting close date. Illinois Residency is required within 180 days of employment. The University of Illinois System is an equal opportunity employer, including but not limited to disability and/or veteran status, and complies with all applicable state and federal employment mandates. Please visit Required Employment Notices and Posters to view our non-discrimination statement and find additional information about required background checks, sexual harassment/misconduct disclosures, and employment eligibility review through E-Verify. The university provides accommodations to applicants and employees. Request an Accommodation To apply, visit https://uic.csod.com/ux/ats/careersite/1/home/requisition/17126?c=uic Copyright 2025 Jobelephant.com Inc. All rights reserved. Posted by the FREE value-added recruitment advertising agency jeid-35536b89d93a4747a533c1501d33bd98