Effective Use of Educational Assessments

If AI can now produce competent answers in seconds, what exactly are we assessing in our degrees? AI is already embedded in how students learn, think, and produce work. So, the question is no longer about its use. Rather, the real question is whether assessment is designed to treat AI as a liability to be controlled or as a resource to be used well. AI-integrated assessment does not mean looking the other way when students use AI. It means designing tasks where AI use is expected, visible, and evaluated. The shift is subtle but fundamental: from policing outputs to assessing judgment. Several practical design principles follow. First, assess decisions rather than artefacts. In an AI-rich environment, polished outputs are cheap. What remains scarce is the ability to frame problems well, choose appropriate tools, test assumptions, and decide when not to trust an AI response. Assessment can require students to justify how AI was used, why particular prompts were chosen, and how outputs were validated against disciplinary knowledge. Second, make the process evidence assessable. Short AI logs, annotated iterations, or structured commentaries can document how thinking evolved through interaction with AI. This is forensic reasoning about choices made, alternatives rejected, and risks managed. Used well, it turns AI from a shortcut into a cognitive amplifier. Third, build in authentic constraints. In professional settings, AI is used within limits, including ethical rules, organisational policies, incomplete data, and reputational risk. Assessment can simulate these conditions through ambiguous briefs, imperfect datasets, or explicit governance boundaries. Students are evaluated on how they navigate trade-offs, not how elegant the final output appears. Fourth, reintroduce dialogue selectively. Ask for recorded walkthroughs or live critiques, which allow students to explain how AI shaped their reasoning. The purpose is not detection but sense-checking judgment. Weak understanding surfaces quickly when students must articulate why they trusted or rejected an AI-generated insight. Finally, reward responsible AI use explicitly. Rubrics should recognise transparency, validation, ethical awareness, and the integration of AI output with human judgement. When expectations are clear, students learn how to use AI well rather than how to hide it. This approach develops genuinely transferable skills such as judgment under uncertainty, learning agility, ethical reasoning, and accountability. It prepares students for workplace realities where AI is normal, governed, and consequential. It fosters better feedback and stronger academic relationships by shifting conversations from suspicion to reasoned discussion. The irony is that AI-integrated assessment is not easier. It is harder. It raises the bar. We need to shift our thinking from compliance to using assessment to develop graduates who not only know how to use AI, but also when, why, and to what effect.

If you are a teacher or someone who works with teachers, you know that assessment is the topic that keeps coming up in every conversation about AI in education. The discourse tends to focus on students cheating and academic integrity. And those are valid concerns. But students are only part of the equation, maybe even a small part. The biggest piece is assessment design and assessment strategies. The problem, as I argued in a previous guide, is really one of assessment literacy. The old techniques, the standard essays, the recall-heavy exams, the formulaic problem sets, they just don't hold up anymore when students have access to tools that can produce competent work in seconds. We need to rethink how we assess learning. And yes, that requires creativity, experimentation, and a willingness to try new approaches. I know that can push some teachers out of their comfort zone. But unless we do the hard work of redesigning our assessments, we won't be able to evaluate genuine learning. We'll only be measuring a student's ability to prompt an AI. So I put together this guide. I compiled insights from researchers, fellow teachers, and assessment specialists along with practical strategies and tips to help you create assessments that are harder for AI to shortcut. And no, there is no such thing as an AI-proof assessment. AI can now handle just about any traditional assignment you throw at it. But that doesn't mean we're powerless. In this guide, I share frameworks, research findings, and specific strategies that can help you design assessments focused on deeper thinking and understanding. Link in the first comment #AIinEducation #EdTech #AIAssessment #TeacherTools #HigherEd #K12Education #AILiteracy

The Ends of Tests: Possibilities for Transformative Assessment and Learning with Generative AI In "The Ends of Tests," Cope, Kalantzis, and Saini propose a transformative vision for education in the era of Generative AI. Moving beyond the limitations of traditional assessments—especially multiple-choice and time-limited essays—they advocate for AI-integrated, formative learning environments that prioritize deep understanding over rote recall. Central to their argument is the concept of cybersocial learning, where educators curate AI systems using rubric agents, knowledge bases, and contextual analytics to scaffold learner thinking in real time. This reconfigures the teacher’s role: not diminished by AI, but amplified through new pedagogical tools. The authors call for education systems to abandon superficial summative assessments in favor of dynamic, dialogic, and multimodal evaluations embedded in everyday learning. Importantly, this model aims to redress structural inequalities by personalizing feedback within each learner’s “zone of proximal knowledge.” Rather than automating outdated systems, the paper imagines AI as a medium for epistemic justice, pedagogical renewal, and educational equity at scale. Full text and video here: https://lnkd.in/efhjt6jf

Moving away from thinking in AI as a "cheating" machine: The post discusses the updated version of the AI Assessment Scale (AIAS), a framework for integrating generative AI ethically into educational assessments across different disciplines. The AIAS provides five levels with varying degrees of permitted AI usage: 1. No AI: Students cannot use any AI tools. 2. AI-Assisted Idea Generation and Structuring: AI can be used for brainstorming and outlining, but final work must be human-authored.  3. AI-Assisted Editing: Students can use AI for refining and editing their work, submitting both original and AI-assisted content. 4. AI Task Completion, Human Evaluation: Students use AI for components of the task but critically evaluate the AI outputs. 5. Full AI: AI can be used throughout the task at the student/teacher's discretion. The updated AIAS aims to provide more nuance, flexibility and accommodate multimodal AI across diverse fields. Examples are given for applying each level to different assessment types. The author emphasizes the need to shift the narrative around AI in education from just "cheating" to exploring how it can enhance teaching and learning. The AIAS offers clarity to students on acceptable AI use and provides an ethical, equitable policy tool for institutions. The post includes an abstract from the published journal article further detailing the rationale and benefits of the AIAS framework. https://lnkd.in/ev-n_v4f

I have never seen such drastic changes in university education as what has happened during the past two years because of generative AI technologies. Especially student assessment is now a completely different activity than what it used to be. I am starting to think that this requires a complete paradigm change in student assessments. We should not merely measure individual student capabilities but start evaluating student-AI teams and the result of the collaboration between AIs and students. Traditional university assessments are designed to measure individual student knowledge, skills, and critical thinking. Exams, essays, and projects typically emphasize personal effort and originality, aiming to cultivate independent thinkers. While this model has worked well for centuries, it now feels increasingly disconnected from the realities of the digital age. AI tools like ChatGPT, DALL-E, and others can produce sophisticated outputs, ranging from code and essays to data analysis and creative designs. Denying students access to these tools in assessments not only misrepresents their future work environments but also hinders their ability to develop critical skills for the AI-integrated workplace. The workplace of tomorrow will not reward individuals who can outperform AI but those who can work with AI to achieve exceptional outcomes. Universities must therefore adapt assessments to evaluate how well students integrate AI tools into their workflow to address complex, real-world problems, how critically they evaluate AI outputs for accuracy and bias, and how creatively and effectively they use AI to enhance their projects and generate novel solutions. Furthermore, students’ understanding of ethical considerations, including data privacy, transparency, and responsible innovation, must also become a focal point of assessment. Transitioning to a model that evaluates collaboration between students and AI requires innovative approaches. Assignments could explicitly require AI assistance, such as asking marketing students to develop campaigns with the help of AI tools, assess their viability, and justify their strategic decisions. Grading systems might prioritize the process over the final product, evaluating how students choose and use AI tools, iterate based on feedback, and address errors in AI-generated outputs. Open-book exams could allow AI use, with students evaluated on their ability to interpret, critique, and expand upon AI-generated content. Simulated workplace scenarios, where students work as part of a team with AI, could also become a powerful tool to measure real-world readiness. However, this transition is not without its challenges. See the comment section for more. Have you already started to assess the results of student-AI collaboration or do you still consider the individual capabilities of students as the main thing to assess in university education? #AI #education #assessment #grading #capabilities

What if the act of taking a test was indistinguishable from the act of learning? Why wait weeks for summative scores when multimodal AI can map student performance in real time? How much brilliance goes unnoticed because tests only score final answers? In our newly released case study, "Accessible by Design," my co-author Edward Metz and I explore a necessary paradigm shift. For decades, education has relied on static exams to rank students. This retroactive auditing identifies misconceptions months after the window for effective intervention has closed. We must deemphasize retroactive auditing. Let's build proactive, real-time support systems and erase the boundary between testing and instruction entirely. One future of EdTech is using multimodal AI to capture "learning in motion." Imagine spoken reasoning, applied research, classroom debate, and video game performance becoming learning metrics. By analyzing complex data streams—natural speech, revision of evidence-based writing, open-ended problem-solving—AI has the potential to illuminate a student's thinking as it happens. To ensure these tools serve all students, they must be grounded in Universal Design for Learning (UDL) and Evidence-Centered Design (ECD). These frameworks strip away construct-irrelevant barriers, transforming assessment into an invisible engine delivering personalized scaffolds. Ed and I are incredibly proud to highlight trailblazing companies from the federal ED/IES SBIR portfolio already transforming measurement: 🔬 STEM: OKO, KASI, PocketLab (NotebookAI & G-Force), Water Guardian, INQits, 2 Sigma Schools, StepWise. ✍️ Literacy: LightSide Labs (Turnitin Revision Assistant), Scrible, CG Scholar, Kibeam, Sound Town, Moby.Read, Capti (ETS ReadBasix). 🌱 Support: SownToGrow, Education Modified, PACE AI. I encourage folks to read this piece. Join us in rebuilding assessment to cultivate human potential, not just audit it. 📖 Read the full case study...

I would like to share a second AI in Ed SoTL article entitled, “Redesigning Assessment for the Generative AI Era: A Framework for Educators” by Khlaif, et al. (2025) (https://lnkd.in/eAeV6BxJ ). Khlaif and colleagues offer a timely and practical rethinking of assessment practices grounded in educational integrity, learner agency, and AI fluency. Their work proposes a multidimensional framework designed to ensure that assessment continues to reflect meaningful learning even when AI is involved at every stage. The authors argue that generative AI has fundamentally disrupted assessment by: - Making traditional recall tasks obsolete - Complicating academic integrity enforcement - Blurring lines between student work and AI contribution - Expanding students’ access to instant feedback and explanations Rather than focusing on catching misuse, Khlaif et al. advocate for: - Authentic, process-driven assessments - Metacognitive reflection on tool use - Evaluation of student + AI co-production - Assessment of higher-order thinking, not output alone Four Key Dimensions 1) Pedagogical Dimension. Assessment must align with active learning, inquiry, critical thinking, and student-centered design. 2) Ethical Dimension. Includes transparency, academic honesty, consent, bias awareness, and AI literacy. 3) Technological Dimension. Focuses on tool selection, AI capability analysis, and appropriate use boundaries. 4) Assessment Dimension. Calls for redesigned methods including: - performance-based tasks - iterative submissions - reflective writing - multimodal evidence - collaborative problem-solving - AI-augmented portfolios Educators are urged to: - Require students to document how they used AI - Compare drafts with and without AI assistance - Integrate oral defense, peer review, and process documentation - Blend human judgment with AI-supported analytics - Incentivize learning, not just product creation Rather than equating AI use with cheating, the authors propose a new definition: Integrity means honestly representing the relationship between human and AI contributions. This shift reframes assessment in terms of transparency, reflection, and ethical agency. Khlaif et al. make a compelling case that assessment, not content, is where AI will make the biggest impact on learning systems. If assessment fails to evolve: - learning outcomes become artificial - grades become meaningless - student agency weakens - equity gaps worsen If redesigned with AI in mind: - creativity expands - students build meta-AI literacy - authentic learning becomes visible - assessment becomes more human, not less Reference Khlaif, Z. N., Alkouk, W. A., Salama, N., & Abu Eideh, B. (2025). Redesigning assessments for AI-enhanced learning: A framework for educators in the generative AI era. Education Sciences, 15(2), 174.

🚀The real opportunity with AI isn't about building more - it’s about how humans can apply it in smarter, more innovative ways, especially in assessment. This year, let’s not ask "what now", let's ask ‘what if’: What if: 🖌️ AI could analyze examinee behavior in real-time to auto-adjust accommodations like font size, contrast, and voice prompts, ensuring accessibility without pre-requests? 🙏 ethically responsible facial recognition or voice sentiment analysis could adapt test pacing or provide calming cues for candidates showing signs of stress? 🔮 predictive models measured not only what candidates know today but also their capacity to learn and apply knowledge in the future? 🧠 AI detected cognitive fatigue and modified pacing or recommend breaks mid-assessment for optimal performance? 📈 models could detect anomalies like sudden difficulty spikes during exams and recalibrate on-the-fly to maintain fairness? 💻 AI could evaluate readiness through pre-tests and recommend optimal testing times based on mental alertness data? 🖱️ nuanced behaviors like hesitation patterns or mouse movements could identify cognitive processes and offer dynamic insights to content teams to improve task design? 🌐 automated item generation could localize questions and scenarios on the fly to make assessments more relevant and fair across diverse populations? 🔠 dynamic blueprints could evolve based on global candidate data, adapting to emerging trends and staying perpetually relevant? 🌳 near-infinite item banks could be created by continuously monitoring global knowledge databases to auto-generate highly contextualized, evergreen test items? 🤖 AI distributed the psychometric design, where thousands of micro-AIs independently optimized different parts of the testing process ensuring maximum precision and scalability while reducing systemic error risks? The future of assessment will be shaped by the bold “what ifs” humans are willing to explore today. This year, let’s aspire to solutions that not only responsibly push boundaries but also build trust and enhance equity. 🚀⚖️ What’s your “what if” in 2025? 🙏👇 🌚Do you find these aspirations helpful as a little inspo? Grab the PDF from the link in the comments. #PossibilityNotPrediction #AIforGood #InnovationInAssessment

AI, Assessment And The Future Of Exams In Academia If you have ever railed against lack of critical thinking in college graduates or rote teaching/learning, memorized textbooks instead of understanding or the burgeoning use of AI by students to cheat or a waning interest in actual learning then this one is for you. As AI becomes ever more embedded in education, we must rethink assessment methods—not just policing misconduct, but designing learning around AI in ways that preserve integrity and learning outcomes. Prioritizing just answers encourages shortcuts: Assessments reward students for producing correct answers, often under timed conditions. The structure is: Retrieve facts, apply procedures and generate the expected response. Success, in this model, is about how quickly you can answer. If students can bypass the effort of learning simply by using AI tools to generate responses that meet assignment requirements, the problem lies with the assignment and system. Key Points for Educators: Shift mindset: Instead of banning AI or focusing on detection, institutions should integrate AI into assessments, evaluating students on their understanding of AI-generated content rather than penalizing usage. Intentional design: Assessments must be crafted so that students demonstrate critical thinking, creativity, and human insight. Faculty leadership: Academic staff need to lead this transformation. Ethical and effective use of AI should be built by educators. Broader Context & Supporting Insights - AI Assessment Scale (AIAS): A five-level framework - from no AI to full AI use helped one university reduce misconduct, improve grades, and boost pass rates by aligning task complexity with expected AI involvement. https://lnkd.in/ehbC-7_4 - AI-Resilient Task Design: Tools analyzing semantic depth and Bloom’s Taxonomy help educators flag low-level tasks (e.g., recall) easily solvable by AI, promoting higher-order assessments focused on analysis and creation. - Modern Assessment Innovations: Educators are successfully experimenting with AI-integrated assignments, such as assessing students’ critique of AI-generated responses rather than the answers themselves. Summary - Don’t ban AI : Encourage critical thinking over avoidance - Use frameworks like AIAS: Tailors AI use to learning objectives - Design cognitively rich tasks: Makes cheating harder, learning more authentic - Empower faculty leadership: Ensures ethical, pedagogy-aligned AI integration AI in education is not a threat, it is inevitable and can be a powerful ally. However, to ensure academic integrity, educational leaders must welcome AI with intention, reshape assessments, and trust educators to guide ethical integration. Thoughtful design today is crucial for meaningful, future-proof learning. https://lnkd.in/e8GAGR8S