Education Technology Industry Network (ETIN) and Empirical Education Inc. have recently collaborated to release the Guidelines for Conducting and Reporting EdTech Impact research in U.S. K-12 Schools. These guidelines aim to provide clarity on how research is conducted and information is presented to users of educational technology products in light of the changes brought by the Every Student Succeeds Act (ESSA). In the era of ESSA, it is crucial to measure the impact of educational technology to ensure that it effectively supports student learning and achievement.
The updated guidelines reflect the evolving landscape of educational technology, particularly with the prevalence of cloud-based products that provide more access to teacher and student usage data. Additionally, these guidelines consider the compressed development timeline of edtech products and the shift in standards of evidence with ESSA replacing No Child Left Behind (NCLB). As a result, districts are increasingly seeking their own student and teacher product usage data to conduct their own studies and evaluations.
The guidelines are divided into four main sections: Getting Started, Designing the Research, Implementing the Design, and Reporting the Results. When getting started, it is recommended to use a logic model from the product provider to develop a model for how the product works. Logic models can help identify the factors that correlate with different outcomes, providing a foundation for further research.
In designing the research, it is essential to consider the four levels of evidence defined by ESSA. Starting with a logic model, researchers can then progress to conducting a correlational study, a comparison study, and ultimately a randomized experiment. While randomized experiments are considered the gold standard, comparison studies are often more practical due to their efficiency and cost-effectiveness.
Implementing the research design requires caution, especially when handling confidential information. With the increased availability of personally identifiable student information from school districts and edtech products, privacy concerns regarding the usage data of educational technology have become more prominent. Protecting the privacy of students and teachers is paramount in conducting impactful research in the ESSA era.
When reporting the results of edtech product evaluations, transparency is key. All findings should be made available to the public, rather than selectively publishing only the most favorable outcomes. Providing detailed information allows schools to determine if a product is suitable for their specific context, beyond just the average results. This transparency enables educators to make informed decisions about the adoption of educational technology products.
Denis Newman, the lead author of ETIN’s guidelines for research on edtech impact, brings a wealth of experience in improving student-teacher learning processes and instructional technologies. As the CEO of Empirical Education Inc., he has conducted numerous randomized controlled trials (RCTs) and evaluations of school programs. Newman’s expertise in applying technology to enhance learning and professional development has been instrumental in shaping the guidelines for measuring edtech impact in the ESSA era.
Andrew Coulson, Chief Data Science Officer, plays a pivotal role in leading the data analysis team at MIND, overseeing expansion strategies, and evaluating the impact of educational programs. With a background in high-tech manufacturing engineering and education, Coulson brings a unique perspective to the research on edtech impact. His experience in scaling educational initiatives across multiple states has contributed to the development of effective strategies for measuring the efficacy of educational technology products.
Bridget Foster, EVP & Managing Director of ETIN, offers a comprehensive understanding of the education market, having worked in various roles from classroom teacher to industry leadership. Her expertise in helping companies navigate the education landscape and expand their reach globally underscores the importance of strategic market insights in the edtech industry. Foster’s credentials in English, science, mathematics, and school administration further reinforce her ability to guide companies in effectively positioning their products in the education market.
Join the EdFocus: The EdMarketing Community to connect with colleagues in the education industry, share information and resources, ask questions, and seek advice. This professional learning community fosters collaboration and knowledge-sharing among education professionals, supporting the growth and innovation of educational technology in the ESSA era.
In conclusion, the Guidelines for Conducting and Reporting EdTech Impact research provide a comprehensive framework for evaluating the effectiveness of educational technology products in K-12 schools. By following these guidelines, researchers can ensure that their studies are conducted ethically, transparently, and with a focus on improving student learning outcomes. The evolving landscape of educational technology demands rigorous research methodologies that align with the standards set forth by ESSA, enabling educators to make informed decisions about the adoption and implementation of edtech products. Download the full guidelines to learn more about measuring edtech impact in the ESSA era and stay informed about the latest developments in the field.