The 3D view needs WebGPU or WebGL2.

input neuronsneurons read out

Models

BrainFlyWire 2024

Macro photograph of a fruit fly head

138,639 neurons, 15.1 million connections

Mouse controlLive demo

Mouse control

0.49 s per movementfaster than people

Object trackingLive demo

Object tracking

97% on targetseven fast objects

Humanoid locomotionLive demo

Humanoid locomotion

98% uprightunder ball fire

GameplayLive demo

Gameplay

88% Doom rounds wonagainst waves of enemies

Control

The fly brain controls pointers, controllers and simulated bodies.

Models

CursorMouse control · Live demoCursor moves a mouse pointer to a given target and clicks. The fly brain computes 50 steps per second and learned the task from mouse recordings of 96 people.WalkHumanoid locomotion · Live demoWalk connects the fly brain to a simulated human body with 21 joints and 42 muscles. The body walks at a given speed and heading, is hit by balls, and gets up after falls.PlayGameplay · Live demoThe fly brain plays video games, one game at a time: a side-scrolling jump-and-run, whose screen it sees through its compound eyes, and Doom, where it sees a map of its field of view drawn by the game. It chooses the buttons itself.

Planned

KeysKeyboard controlPlanned: the fly brain presses and releases keys to type text and shortcuts.PadGame controllerPlanned: the fly brain sees game frames through its compound eyes and moves the sticks, triggers and buttons of a controller.