james lehman

Responsible for all psychometric analyses and client consultation for the company. This includes responsibility for technical deliverable's to our large state clients. Hands-on experience managing computer adaptive test (CAT) item banks. Perform Item Response Theory (IRT) item bank calibrations as part of maintaining item banks. I have analyzed data from our artificial intelligence based essay scoring engine to address issues such as: essay prompt fairness, and student growth in writing derived from repeated measures.

Project Specialist: Responsible for campus-wide implementation of an automated student advisement system that determines degree requirement fulfillment and completion.

Taught Introductory Statistics in the Mathematics Department and Personnel Selection and Placement in the Psychology Department.

Responsible for a wide variety of assessment activities such as job analyses, item editing, exam assembly, psychometric analysis including equating and scaling, standard setting, and certain client-related activities including business development and proposal writing. In this role, I manage multiple projects simultaneously, meeting deadlines, delivering results that are consistent with company and industry standards. The Director of Test Development & Psychometrics reports to the President and CEO of PCS.

* Strategized, designed, developed, and executed assessment and evaluation plans for specific projects. * Crafted item analysis strategy and led team to improve item analysis process to greatly reduce resource usage while maintaining quality and accuracy. * Leadership role to calculate and document psychometric properties for selected assessments for the first time at the Firm. * Leading role in completing the Firm's first human capital Return on Investment project for a training program. Results were presented to executive leadership. * Led the development & implementation of the first diagnostic assessment to allow learners to 'test-out' of part of a fundamental Taxation course.

* Responsible for the quality and timeliness of the work of the team in key development areas in the semi-adaptive CPA exam. * Execute contract with multiple-choice question vendor to insure quality, meet contractual deadlines, and monitor question bank status. * Worked with team to improve the scoring of the simulations portion of the CPA exam.

* Provided leadership and supervision for the College's nationally recognized learning assessment activities * Primary responsibility for the undergraduate Thomas Edison College Examination Program (TECEP) * a credit-by-examination program * Conceived & implemented e-Pack, a new credit earning option centered on a textbook, web-based diagnostic testing, and a comprehensive final exam.

* Responsibilities included: * statistical coordinator of SAT and PSAT/NMSQT differential item functioning (DIF) analyses * statistical coordinator of the SAT validity study service which produces validity studies for institutions * participated in equating the SAT I & II, and the College Level Examination Program (CLEP)on a regular basis. * statistical coordinator of the College Entry Level Assessment program

Leads all statistical analysis for placement and certification testing at Vantage Labs. This includes a suite of psychometric analyses such as item analysis, item response theory calibrations, and operational management of the firms's computer adaptive item banks.

Activities and Societies: Member American Educational Research Association, Member National Council on Measurement in Education