UPDATE 0
● COLLECTING 0 steps REWARD — BEST LAP — σ —
⚡ LIVE — PPO
SPEED
LEARN RATE 3.0e-4
ENTROPY 0.0030
EPISODE LEN 60s
↺ RESTART REQUIRED
AGENTS 8
🧬 PPO MODS (LIVE)
FAILURE RATE 0%
🏅 BEST NETWORK (AVG OF ALL AGENTS)
no snapshot yet
EPISODE RETURNS
🧠 AI TRAINER
PPO REINFORCEMENT LEARNING · SELECT A MAP TO TRAIN ON
⚙ CONFIGURE TRAINING
SETTINGS ARE LOCKED ONCE TRAINING STARTS — RESTART REQUIRED TO CHANGE ARCHITECTURE
🧠 NETWORK ARCHITECTURE
HIDDEN LAYERS
more layers = learns complex patterns, trains slower
NEURONS PER LAYER
more neurons = more capacity, heavier updates
🏎️ ENVIRONMENT
CAR
PARALLEL AGENTS 8 agents
more agents = more diverse experience per update (rounded to a multiple of the group size)
EPISODE LENGTH 60s
max seconds per run before reset
📊 TRAINING
AGENT GROUPS
groups spawn together at the same spot; each agent's advantage is its return vs the group average (GRPO-style — replaces the critic). Raise AGENTS so several groups run in parallel.
COMPUTE BACKEND
AUTO = multi-core WASM · GPU = TensorFlow.js on WebGL (stable everywhere, no WebGPU) · JS = plain fallback
GRADIENT THREADS 4 threads
CPU worker count for WASM/JS backends — more than your core count wastes memory
STEPS PER UPDATE (HORIZON)
more steps = better gradient estimate, slower update
LEARNING RATE 3.0e-4
how fast the network learns — too high = unstable
ENTROPY (EXPLORATION) 0.0030
higher = more random actions early on, helps explore
DRAG=PAN · SCROLL=ZOOM · SIM ON WORKER THREAD · RENDERING ON MAIN THREAD · PPO UPDATES ON MULTI-CORE WORKER POOL