The I-O’s AI Toolkit: Practical Applications for Organizational Interventions

This 3.5-hour workshop teaches I-O professionals to design and configure AI agents and assistants for content generation, grounded in a use case of developing materials for a director of Operations AC. Participants build progressively: AI Assistant that generates behavioral interview probes and scoring rubrics from a job description using six structured prompt-engineering techniques; AI agent augmented with external knowledge sources (RAG for job analyses, O*NET for validated KSAOs, web search for industry benchmarks) to improve material validity and surface potential bias; and a Stage 3 multi-agent system of four specialist agents (probe generator, scenario builder, rubric architect, consistency checker) coordinating to produce diverse AC materials while surfacing conflicts requiring human judgment. Participants evaluate AI-generated materials against a five-criterion rubric and apply red-team scenarios surfacing symptomatic-versus-structural design failures. Construct validity, adverse impact, and employer liability anchor the expert-in-the-loop principle throughout: AI generates; the I-O psychologist decides what deploys.

Workshop Facilitators

Ben Hawkes, The Hiring Science Studio & TAPnet
Michael Bazigos, Columbia University & CultureShifts Consulting

Participants must bring a connected device.
Recommended but not required: capability to connect directly to an AI foundational model, like ChatGPT, Claude, Gemini, etc. (Note that some employer issued laptops have security barriers that may prevent such connections.)