Pairit: A Platform for Live Experiments on Human-AI Collaboration

2026-09-09

AI Summary

为解决人机协作实验设计难题，Pairit平台通过单一YAML配置文件实现人类与AI在实时会话中沟通及协作的灵活实验设置。

Abstract

Organizational design in the era of artificial intelligence requires experimental methods that can test how human-AI groups coordinate, delegate, and make decisions. Programmable platforms coordinate live human-to-human sessions or real-time human-AI chat, but researchers cannot easily declare experiment protocols in which AI participants both communicate and act on shared work within one auditable configuration. Here we introduce Pairit, an online platform that facilitates the design, testing, and deployment of experiments that test human-AI organizational designs and interventions. Through a single YAML configuration file, researchers declare an executable experiment graph (pages, routing, randomization, matchmaking, chat, shared workspaces, server-hosted agents, surveys, timers, and custom HTML components) and combine any number of humans and AI agents in live sessions. We have validated the feasibility of the platform through multiple live deployments, including peer-reviewed published studies, capturing high-resolution process traces of communication, negotiation, and collaborative work in live human-AI dyads. By representing complex interactive protocols as standardized, auditable configuration files, Pairit provides reusable infrastructure for specifying, deploying, and sharing live human-AI organizational experiments.

Problem

• Human-AI Collaboration
• Organizational Design
• Experiment Protocols
• Real-time Interaction

Innovation

• Human-AI Collaboration
• YAML Configuration
• Experiment Graph
• Live Sessions
• Organizational Design