Guiding AI’s Responsible Use in Schools

Considerations for Evaluating AI

Artificial intelligence literacy — the knowledge and skills that enable humans to critically understand, use and evaluate AI systems — has emerged as a crucial skill set for everyone in education.

Evaluating AI is the most critical element of AI literacy. Too often, people use AI passively without considering the privacy, safety or societal implications of doing so. To be truly AI literate, users must take a more active approach to understand not only what data the tool is using, but also how these data are being used and shared.

When evaluating AI tools for your district, we recommend four considerations.

Transparency: Support users to understand what data and methods were used to train the AI system or tool. Ask: What AI model and methods were used to develop this tool? What datasets were used to train this AI model?

Safety: Understand data privacy, security and ownership. Ask: How is information being collected, used and shared? How do we prevent tools from collecting data and/or deleting data that was collected?

Ethics: Consider how datasets, including their accessibility and representation, reproduce bias in our society. Ask: How is AI perpetuating issues of access and equity? Who is harmed and benefiting, and how?

Impact: Examine the credibility of outputs and the efficacy of algorithms and question the biases inherent in the use of AI systems and tools. Ask: Is this AI algorithm the right tool for impact? Is this AI output credible? How do we center human judgment in decision making?

Evaluating AI is an essential component of a broader AI literacy framework, which also includes understanding AI and using AI. Digital Promise’s AI Literacy Framework helps educational leaders design and implement a clear approach to AI literacy for their learners, teachers and community.

—  Pati Ruiz and KellyAnn Tsai

Writing Clear and Accessible Policies

While policies touch upon complex and evolving topics, they need to be clear and understandable by all school community members. A few tips:

Avoid techno-centric language when possible. Direct educators and families who may be less familiar with technology terms to glossaries such as the Glossary of Artificial Intelligence Terms for Educators.

Consider easy-to-consume ways to disseminate guidelines. The Iowa City Community School District drafted short teacher and student guidelines, formatted as one-page infographics, to be posted in classrooms as reminders about responsible use. Using the acronyms TEACH and LEARN, they summarize what students ought to consider when using AI for learning and what teachers must consider when leveraging AI for instruction.

Avoid human terminology, such as “hallucinate” or “think,” when writing about AI. Such language reinforces the idea that AI is a humanlike robot that will replace humans. Instead, refer to AI as a tool or technology that can (and does) make mistakes.

Resource Leads

These informational resources can help school districts devise responsible use guidelines:

Digital Promise report, “AI Literacy: A Framework to Understand, Evaluate, and Use Emerging Technology”

Sample empathy interview protocol

Sample language for emerging technology acceptable use policies

AI Pedagogy Project 

—    Pati Ruiz and KellyAnn Tsai