Rigorous education research is at the core of all of our work, including the evaluation and consulting services described below. ARS designs and executes real-world studies that meet the “Scientifically Based Research” criteria identified by the No Child Left Behind Act and the U.S. Department of Education. Our experience with real research in real schools under real constraints helps organizations meet the demands for rigorous, scientifically based research. Our methods include teacher value added modeling (VAM), Multi-Level Modeling, Random Control Trials, Propensity Score Matching, Structural Equation Modeling, and deep strength in experimental and quasi-experimental research methods. We also gather and analyze measures of implementation fidelity and conduct structured analysis of qualitative data. We work with data from a variety of sources, and have experience with multi-site education research, negotiating with Institutional Review Boards, obtaining appropriate research clearances, and protecting student and teacher data with respect for both the letter and the spirit of federal FERPA requirements. Our tools for analysis and data management include nVivo, STATA, SPSS/PASW, R, MySQL, Postgres SQL, Microsoft Access and SQL Server, including highly secure online data storage and server-based analysis where appropriate.

Arroyo Research Services has strong experience in education program evaluation, with particular strengths in evaluating innovative programs for at-risk students, professional development, the development of complex online education applications, distance learning, and education technology. Our evaluations focus on learner outcomes, and build on a thorough understanding of how schools, districts, and states organize and execute their work. Our evaluation work includes evaluation of specific initiatives and programs at the school and district levels to evaluation of multi-site, state-wide initiatives. Evaluation work includes ARRA and Enhancing Education Through Technology evaluations, evaluations of granted funded programs awarded by the U.S. Department of Education, Fund for the Improvement of Post-Secondary Education, National Science Foundation, Department of Defense Education Agency, and state education agencies. Our evaluation projects include a multi-year evaluation of the Texas Dropout Recovery Pilot Program, evaluation of the Ohio, Virginia and Maryland statewide Enhancing Education Through Technology programs, evaluation of schools in need of improvement under NCLB, and evaluation of the Hawaii Principal Performance Contract and associated leadership development program.

For school districts, state agencies and education-related organizations Arroyo Research Services provides strategic consulting and professional services designed to provide discovery, analysis, insight, and direction. Our work typically includes input from major stakeholders, comparisons to best practice and other education organizations, and institutional capacity building. We focus on using your existing data to the extent possible to answer driving questions in your organization and to craft data-driven solutions. In Baltimore County Public Schools, for example, ARS led the development of a new Curriculum Management Plan, facilitating joint work across the Departments of Curriculum and Instruction, Professional Development and Research, Accountability and Assessment, together with Area Superintendents and Principals. Arroyo Research Services principals have designed accountability and decision support systems, guided the development of new research and evaluation divisions, and designed data collection and presentation systems. For Ohio SchoolNet, an Arroyo Research Services principal designed a project portfolio system that served as the primary data collection and analysis tool for the summative evaluation of the Interactive Video Distance Learning Program. Together with TrueNorthLogic, Arroyo Research Services designed reports and decision support tools to measure the efficacy of project implementation and professional development for the Hawaii Department of Education and Montgomery County Public Schools. For the California Department of Education’s EdTechProfile, Arroyo Research Services developed a variety of online reports and expanded surveys to better meet the needs of the project’s stakeholders. For White Hat Management, ARS reviewed and advised on the implementation of the Data Based Middle School, a broad based, intensive educational technology initiative of the HOPE Academies. For Fairfax County Public Schools, ARS conducted a professional development needs assessment and consulted on development of a long-term professional development measurement plan.