A professor on redesigning a course after AI agents could do every assignment

AIAI #AI #Hacker-News #table

A professor on redesigning a course after AI agents could do every assignment

Concrete assessment changes other educators can copy or argue with.

The instructor of Machine Learning in Production (100–170 students) describes moving assessment away from take-home work toward TA interactions, exams and video demos once AI agents could complete all assignments, including changes that go against evidence-based teaching practice.

Read it at the source

The Last Software Engineer (Substack)How I changed teaching after AI managed to do all my homework assignments ↗ Hacker NewsDiscussion: How I changed teaching after AI managed to do all my homework assignments ↗

Cascadic Analysis 2

UndertowRole underspecification / the Doorman Problem

What hidden risk could pull against this, even if the news is good?

Take-home assignments did more than measure learning; they forced practice. Redesigning around what AI can complete may remove the part of a course that built the skill, not just the part that graded it.

UndertowDelayed Consequence / False Success Problem

What hidden risk could pull against this, even if the news is good?

Students leaning on AI can look competent on assignments for a long time. The gap shows up later, in exams, interviews or jobs, after the feedback that could have corrected it has passed.

Rabbit Holes 1

Goodhart's law

After exploring How I changed teaching after AI managed to do all my homework assignments, the general principle is Goodhart's law.

The adage that “when a measure becomes a target, it ceases to be a good measure,” named for economist Charles Goodhart. A useful lens on homework that AI can complete for you.

Wikipedia · Wade · 5 min

0

A professor on redesigning a course after AI agents could do every assignment

Further down the stream