SPECIAL PROJECTS IN DEVELOPMENT AND MAINTENANCE OF STATEWIDE ASSESSMENTS
OAERS staff provide technical expertise and research capacity to DPI for issues related to the statewide testing program.
We provide technical assistance and conduct research to support the North Carolina Test Development program in the development and maintenance of statewide assessments in Mathematics, English Language Arts/Reading, and Science. In this role, we collaborate in analysis of testing data, run measurement analyses to complement the operational analyses already conducted by DPI, and perform research on best practices to inform future operational decisions. Recent projects have included comparability studies of IRT software (flexMIRT, IRTPRO), review of standard setting procedures by other state agencies, and mode comparability (paper versus computer-based).
OAERS staff provide technical expertise and research capacity to DPI for issues related to the statewide testing program.
We provide technical assistance and conduct research to support the North Carolina Test Development program in the development and maintenance of statewide assessments in Mathematics, English Language Arts/Reading, and Science. In this role, we collaborate in analysis of testing data, run measurement analyses to complement the operational analyses already conducted by DPI, and perform research on best practices to inform future operational decisions. Recent projects have included comparability studies of IRT software (flexMIRT, IRTPRO), review of standard setting procedures by other state agencies, and mode comparability (paper versus computer-based).
UNCG NSF S-STEM: STAMPS (SCIENCE, TECHNOLOGY AND MATH PREPARATION SCHOLARSHIPS) PROGRAM
The UNCG STAMPS program provides financial, academic, mentoring and advising support to talented students in the STEM fields at UNCG to increase retention rates and better prepare students for STEM-based careers or professional (e.g., medical, dental, pharmacy, graduate) schools. The program recruits a diverse group of first year Biology, Chemistry, Computer Science, Earth Science and Geographic Information Systems, Mathematical Sciences, and Physics and Astronomy majors to participate in a yearlong integrated science course, designed to create a cohort supported by faculty mentors, student support services, and peer-mentors. OAERS Staff conduct research on how the STAMPS program supports students’ sense of belonging, self-efficacy, and science identity, and collect data on best practices about how to support and train diverse students for a skilled STEM workforce.
The UNCG STAMPS program provides financial, academic, mentoring and advising support to talented students in the STEM fields at UNCG to increase retention rates and better prepare students for STEM-based careers or professional (e.g., medical, dental, pharmacy, graduate) schools. The program recruits a diverse group of first year Biology, Chemistry, Computer Science, Earth Science and Geographic Information Systems, Mathematical Sciences, and Physics and Astronomy majors to participate in a yearlong integrated science course, designed to create a cohort supported by faculty mentors, student support services, and peer-mentors. OAERS Staff conduct research on how the STAMPS program supports students’ sense of belonging, self-efficacy, and science identity, and collect data on best practices about how to support and train diverse students for a skilled STEM workforce.
GLOBAL LEARNING FOR GLOBAL ENGAGEMENT QUALITY ENHANCEMENT PLAN
OAERS staff provide technical expertise and data analysis for issues related to student success in an ever-changing global society.
The Global Engagement Quality Enhancement Plan (QEP) team at UNCG aims to provide students a learning environment that delivers the necessary knowledge, skills, and attitudes to engage effectively in the world. The OAERS staff supports the QEP team by providing technical assistance with instrument design, sampling, data collection, statistical analyses, and reporting. Recommendations for efforts to enhance global learning outcomes and suggestions for future initiatives are provided. OAERS works collaboratively with the QEP team to help develop and refine surveys and questionnaires seeking to measure the impact of initiatives, both on and off campus.
OAERS staff provide technical expertise and data analysis for issues related to student success in an ever-changing global society.
The Global Engagement Quality Enhancement Plan (QEP) team at UNCG aims to provide students a learning environment that delivers the necessary knowledge, skills, and attitudes to engage effectively in the world. The OAERS staff supports the QEP team by providing technical assistance with instrument design, sampling, data collection, statistical analyses, and reporting. Recommendations for efforts to enhance global learning outcomes and suggestions for future initiatives are provided. OAERS works collaboratively with the QEP team to help develop and refine surveys and questionnaires seeking to measure the impact of initiatives, both on and off campus.
EXTERNAL EVALUATION OF THE NSF NETWORK FOR COMPUTATIONAL NANOTECHNOLOGY – HIERARCHICAL NANOMANUFACTURING NODE
OAERS staff provides STEM program evaluation with attention to culture, equity, and diversity.
The educational and outreach objective for the NCN Hierarchical nanoMFG Node is to promote computation, simulation, and education services to the nanoscience and engineering communities that fully integrates simulation and modeling tool development to create and sustain a robust and diverse pipeline in STEM education from pre-college to graduate studies toward workforce development. Evaluation is an integral component of the NCN Hierarchical nanoMFG Node, and is conducted on a formative and summative basis. We provide useful and valid information about the program’s theory, communication, implementation, recruitment/diversity, effectiveness, outcomes, and sustainability. The evaluation utilizes a Values-Engaged, Educative (VEE) evaluation approach which defines high quality STEM educational programming that effectively incorporates cutting edge scientific content, strong instructional pedagogy, and sensitivity to diversity and equity issues.
OAERS staff provides STEM program evaluation with attention to culture, equity, and diversity.
The educational and outreach objective for the NCN Hierarchical nanoMFG Node is to promote computation, simulation, and education services to the nanoscience and engineering communities that fully integrates simulation and modeling tool development to create and sustain a robust and diverse pipeline in STEM education from pre-college to graduate studies toward workforce development. Evaluation is an integral component of the NCN Hierarchical nanoMFG Node, and is conducted on a formative and summative basis. We provide useful and valid information about the program’s theory, communication, implementation, recruitment/diversity, effectiveness, outcomes, and sustainability. The evaluation utilizes a Values-Engaged, Educative (VEE) evaluation approach which defines high quality STEM educational programming that effectively incorporates cutting edge scientific content, strong instructional pedagogy, and sensitivity to diversity and equity issues.
NATIONAL FOLK FESTIVAL SURVEY EVALUATION
OAERS staff analyze and report on survey data from attendees of the National Folk Festival.
The National Folk Festival project was conducted through a survey in order to gather critical data on festival attendees. Demographic data were gathered and analyzed to determine the effect of the festival on the city of Greensboro. Further analysis by the OAERS staff disaggregate results so Folk Festival stakeholders can understand participation trends. The descriptive analysis of the survey and the reported results help demonstrate the value of the festival on the city and its residents.
OAERS staff analyze and report on survey data from attendees of the National Folk Festival.
The National Folk Festival project was conducted through a survey in order to gather critical data on festival attendees. Demographic data were gathered and analyzed to determine the effect of the festival on the city of Greensboro. Further analysis by the OAERS staff disaggregate results so Folk Festival stakeholders can understand participation trends. The descriptive analysis of the survey and the reported results help demonstrate the value of the festival on the city and its residents.
PSYCHOMETRIC ANALYSIS AND REPORTING OF SPECIALTY EXAMS
OAERS provides technical support and assistance to the North Carolina State Bar Board of Legal Specialization Specialty Exam Committees to inform scoring decisions and exam improvement.
In our role, OAERS conducts item and test level analyses for the yearly administrations of their state-wide specialty law exams, including Elder Law, Bankruptcy Law, Appellate Practice, Criminal Law, Estate Planning and Probate Law, Family Law, Immigration Law, Real Property Law, Social Security Disability, Trademark Law, Utilities Law, and Workers’ Compensation Law. Our team also works with Exam Committee Chairs to increase their assessment literacy through workshops on the fundamentals of psychometrics and measurement, scoring processes, rubric development, and domain specification.
OAERS provides technical support and assistance to the North Carolina State Bar Board of Legal Specialization Specialty Exam Committees to inform scoring decisions and exam improvement.
In our role, OAERS conducts item and test level analyses for the yearly administrations of their state-wide speciality law exams, including Elder Law, Bankruptcy Law, Appellate Practice, Criminal Law, Estate Planning and Probate Law, Family Law, Immigration Law, Real Property Law, Social Security Disability, Trademark Law, Utilities Law, and Workers’ Compensation Law. Our team also works with Exam Committee Chairs to increase their assessment literacy through workshops on the fundamentals of psychometrics and measurement, scoring processes, rubric development, and domain specification.
PSYCHOMETRIC ANALYSIS AND REPORTING OF PARALEGAL CERTIFICATION EXAMS
The OAERS office provides services in the area of measurement and psychometrics related to data analyses, scoring and reporting of the North Carolina State Bar Board of Paralegal Certification Examinations.
The North Carolina State Bar Board of Paralegal Certification administers certification exams twice a year for paralegals who would like to serve in North Carolina. OAERS staff provides technical assistance with test development and conducts test and item analyses for the paralegal certification exams. In this role, the office provides reports to the exam committee to inform scoring decisions and exam improvement.
The OAERS office provides services in the area of measurement and psychometrics related to data analyses, scoring and reporting of the North Carolina State Bar Board of Paralegal Certification Examinations.
The North Carolina State Bar Board of Paralegal Certification administers certification exams twice a year for paralegals who would like to serve in North Carolina. OAERS staff provides technical assistance with test development and conducts test and item analyses for the paralegal certification exams. In this role, the office provides reports to the exam committee to inform scoring decisions and exam improvement.
ESEARCH DATA MEASUREMENT AND REPORTING
OAERS staff provides survey development, data analysis, reporting, and methodological training for library research projects and staff professional development.
The UNCG Library conducts research to assess library use and library program effectiveness. Through qualitative and quantitative data analyses, OAERS staff help library stakeholders improve educational programing, respond to student needs for library resources, and promote student success. OAERS staff also provides professional development opportunities to aid library staff in data collection and analyses. Examples of research projects include: conducting student focus groups concerning library use, examining student success in courses that contain a library component, and surveying students about the effectiveness of library resources for distance and online learning.
OAERS staff provides survey development, data analysis, reporting, and methodological training for library research projects and staff professional development.
The UNCG Library conducts research to assess library use and library program effectiveness. Through qualitative and quantitative data analyses, OAERS staff help library stakeholders improve educational programing, respond to student needs for library resources, and promote student success. OAERS staff also provides professional development opportunities to aid library staff in data collection and analyses. Examples of research projects include: conducting student focus groups concerning library use, examining student success in courses that contain a library component, and surveying students about the effectiveness of library resources for distance and online learning.