AI Agent Gym

A training ground to make AI your personal sidekick.

Scroll to explore

The best ideas don't come from one mind.

They come from many minds, with different perspectives, competing and collaborating.

This pattern shows up everywhere — in AI research, in design practice, and now, in a tool.

Inspiration I

Learning from Consequences

Reinforcement learning doesn't need instructions. It needs an environment and a signal.

Richard Sutton & Andrew Barto, Reinforcement Learning: An Introduction, 1998
Step 1

The Empty Grid

An agent stands in a world with no manual. No instructions. Just a grid of possibilities and the freedom to explore.

Step 2

The Reward Signal

Somewhere in the grid is a goal. The agent doesn't know where — but when it stumbles onto it, a signal fires: that was good, do more of that.

Step 3

Trial and Error

The agent wanders, bumps into walls, backtracks. Each failure narrows the search. Each success reinforces a path. Slowly, a policy emerges.

Step 4

Your Turn

Click on the grid to place rewards and penalties. Watch the agent learn a new policy in real time. You're shaping the environment, not writing instructions.

Insight

Environment as Curriculum

The deep lesson: you don't teach an RL agent what to do. You design the environment and let the agent discover the answer itself.

Inspiration II

The Adversarial Dance

A forger and a detective, locked in an arms race that produces masterpieces.

Ian Goodfellow et al., Generative Adversarial Networks, 2014
Step 1

Two Networks

In 2014, Ian Goodfellow proposed a deceptively simple idea: pit two neural networks against each other. A Generator that creates, and a Discriminator that judges. They start knowing nothing.

Step 2

The Generator Creates

The Generator produces crude attempts — rough shapes, wrong proportions. Like a first draft with no revision.

Step 3

The Discriminator Judges

The Discriminator spots every flaw. "Too simple. Not realistic. Missing detail." Its criticism is the Generator's learning signal.

Step 4

The Arms Race

Each gets better. The Generator refines. The Discriminator sharpens. Quality spirals upward through competition — not collaboration.

Insight

Competition Creates Quality

Neither network could improve alone. It's the tension between them that drives quality. Sound familiar? Think: design critique.

Inspiration III

The Training Arena

OpenAI Gym gave every researcher the same standardized environments to test their ideas. A gym for algorithms.

Greg Brockman et al., OpenAI Gym, 2016

You need a structured arena where agents can safely fail, learn, and be compared. Without standardized environments, progress is anecdote, not science.

Inspiration IV

Nobody Taught Them That

OpenAI's hide-and-seek agents discovered tool use, architecture, and exploitation — all on their own.

Bowen Baker et al., Emergent Tool Use From Multi-Agent Autocurricula, OpenAI, 2019
Phase 1

Random Running

Agents wander aimlessly. Hiders and seekers move randomly, no strategy, no awareness.

Phase 2

Basic Chasing

Seekers learn to pursue. Hiders learn to flee. Simple predator-prey dynamics emerge.

Phase 3

Shelter Building

Hiders discover they can push boxes and walls to create shelters. Nobody programmed "architecture."

Phase 4

Ramp Exploitation

Seekers learn to use ramps to jump over walls. The hiders' shelter strategy is defeated by creative tool use.

Phase 5

Ramp Locking

Hiders counter by locking ramps in place before building shelters. A preemptive defensive strategy.

Phase 6

Box Surfing

Seekers learn to ride boxes to glitch over walls. An exploit no designer anticipated — emergent creativity at its purest.

Multi-agent interaction creates behaviors that no single agent, and no programmer, could have designed. The system is smarter than its parts.

Inspiration V

Wisdom of the Crowd

Perplexity's Model Council asks multiple AI models the same question, then synthesizes their best thinking.

Perplexity AI, Internal Model Council, 2024
Step 1

One Question

A single prompt goes out to multiple models simultaneously. Same question, different architectures, different training data.

Step 2

Parallel Processing

Each model reasons independently. GPT thinks one way, Claude another, Gemini a third. They don't see each other's work.

Step 3

Agreement Zones

Where models agree, confidence is high. Where they diverge, there's genuine uncertainty — or a creative opportunity.

Insight

Diversity Is the Signal

No single model is as reliable as the consensus. Diversity of perspective isn't a bug — it's the entire mechanism.

The Connection

You Already Do This

The double diamond. Design sprints. Critique sessions. Diverge, then converge. Compete, then collaborate.

British Design Council, Double Diamond Framework, 2005

Discover

Open exploration. Generate possibilities. Diverge wildly.

Generator

Define

Critique ruthlessly. Find the real problem. Converge on truth.

Pragmatist + Visionary

Develop

Defend the best ideas. Push creative boundaries. Diverge again.

Advocate

Deliver

Synthesize everything. Make the call. Ship it.

Synthesizer

Great design has always worked this way. AI Agent Gym just never stops, and never gets tired.

The Synthesis

The Machine

Five AI agents. One creative loop. Infinite iterations. This is AI Agent Gym.

Phase 1

The Generator Creates

Starting from your brief, the Generator produces multiple creative directions. Divergent thinking, unbounded by pragmatism.

Phase 2

The Critics Evaluate

The Pragmatist stress-tests feasibility. The Visionary pushes ambition. They pull in opposite directions — and that tension is the point.

Phase 3

The Advocate Defends

The Advocate champions the strongest ideas, arguing for their potential against the critics' objections. Every idea gets its day in court.

Phase 4

The Synthesizer Decides

The Synthesizer integrates all perspectives into a coherent direction. Not compromise — synthesis. The best parts of every argument, unified.

Phase 5

You Steer

The human reviews, adjusts, and kicks off the next round. You're the coach, not the player. The environment designer, not the agent.

Try It Yourself

AI Agent Gym runs locally on your machine with Claude Code. Download the zip, then choose your path.

Download AI Agent Gym
Easy

Let Claude Code do it

1

Unzip the folder and open Claude Code inside it

2

Ask Claude: set this up and run it

Manual

Do it yourself

1

Unzip and open a terminal in the folder

2

Run npm install

3

Run npm run dev and open the browser

Requires Claude Code CLI and Node.js 18+