Welcome to SHARPIE’s documentation!

SHARPIE logo, a human and robotic hand holding a marker together

SHARPIE, or Shared Human-AI Reinforcement Learning Platform for Interactive Experiments, is a modular framework to conduct experiments involving humans and reinforcement learning agents.

Reinforcement learning offers a general approach for modeling and training AI agents, including human-AI interaction scenarios. SHARPIE addresses the need for a generic framework to support experiments with RL agents and humans. Its modular design consists of a participant-facing web interface, a webserver to synchronize multiple participants and agents interacting with a single environment, and a runner to encapsulate RL environments and algorithm libraries.

SHARPIE comes with logging utilities, supports deployment on popular cloud platforms, and integrates with participant recruitment platforms.

It empowers researchers to study a wide variety of research questions related to the interaction between humans and RL agents, including those related to interactive reward specification and learning, learning from human feedback, action delegation, preference elicitation, user-modeling, and human-AI teaming. The platform is based on a generic interface for human-RL interactions that aims to standardize the field of study on RL in human contexts.

Check out the Getting Started section for further information, including the Installation of the project.

Note

This project is under active development.

Contents

Source code GitHub.