Project F: An adaptive game controller
A controller for one specific person with a motor disability, through Makers Making Change or the Xbox Adaptive Controller ecosystem. The gentlest Phase 5 project, a real need, and a full needs-finding cycle in a month.
On this pageA month
Video games are how a lot of people socialize, and a standard controller assumes two working hands with fine finger control. The Xbox Adaptive Controller exposes every button as a 3.5 mm jack that any switch can plug into; Makers Making Change maintains a library of open switch designs and a list of people who need them. Building a controller for one person, with their input, is the complete Phase 5 cycle (need, requirementsRequirements Testable statements of what the device must do, such as "input-referred noise below 1 microvolt RMS from 0.5 to 40 Hz." Related: VerificationVerification Testing that the device meets its requirements; did you build what you specified. . Glossary entry, build, test, hand over) in the friendliest possible setting. It is also where EMGElectromyography (EMG) Recording the electrical activity of muscles, hundreds of microvolts to millivolts, much larger than EEG. Related: Myoelectric prosthesisMyoelectric prosthesis An artificial limb controlled by EMG from the remaining muscles. , Electroencephalography (EEG)Electroencephalography (EEG) Recording the brain's electrical activity from electrodes on the scalp, a few tens of microvolts of blurred, summed cortical activity. . Glossary entry and EOGElectrooculography (EOG) Recording eye position from the standing voltage across the eyeball, which moves with the eyes; also the main source of blink artifacts in EEG. Related: Blink artifactBlink artifact The large, slow deflection an eye blink produces in frontal channels, often ten times the size of the brain signal. , Electroencephalography (EEG)Electroencephalography (EEG) Recording the brain's electrical activity from electrodes on the scalp, a few tens of microvolts of blurred, summed cortical activity. . Glossary entry from Phase 1 become inputs for someone who has nothing else.
A person with muscular dystrophy can move one thumb about five millimetres with very little force. What is the first thing to build?
The tiny switch, mounted rigidly where the thumb already is. Most adaptive controller work is switch selection and mounting, and the mounting matters more than the switch. A five-millimetre movement with light force is a perfectly good input if the switch is in the right place and stays there. Everything more complex comes after that works.
Find the person
- Week oneFind the personMakers Making Change keeps a queue of real requests from real people. A local rehabilitation clinic or an adaptive gaming group works too.
- Week oneWatch them playBefore proposing anything. Which movements are reliable all evening, not just for five minutes?
- Week twoBuild the simplest thingOne switch into one 3.5 mm jack on an Xbox Adaptive Controller. Do not add a second input until the first one is right.
- Week threeTest with them, iterateMounting position matters more than electronics. Expect to redo the mount three times.
- Week fourDeliver and documentSpares, a printed guide, and your contact. Upload the build so the next person does not start from nothing.
Makers Making Change lists requests by region. Local independent living centres, the Utah Assistive Technology Program, and the rehabilitation hospital’s recreational or occupational therapists know people who game or want to. Ask what they play; the controller is for that game.
Understand the need
Watch them play now, or try to. What movements are reliable, how much force, how much travel, how long before fatigue. Which game actions do they use most; a fighting game needs different inputs from a farming game. Write need statementsNeed statement One sentence, "a way to [do X] for [whom] that [outcome]," with no solution in it. Related: Needs findingNeeds finding Observing clinical work to catch the moments that are slow, awkward, or unsafe, before proposing any solution. . Glossary entry. Sketch two or three switch layouts and let them choose.
Build
Switches: microswitches with light actuation force, sip-and-puff for people with no limb movement, large button switches, proximity or capacitive touch for zero-force. EMGElectromyography (EMG) Recording the electrical activity of muscles, hundreds of microvolts to millivolts, much larger than EEG. Related: Myoelectric prosthesisMyoelectric prosthesis An artificial limb controlled by EMG from the remaining muscles. , Electroencephalography (EEG)Electroencephalography (EEG) Recording the brain's electrical activity from electrodes on the scalp, a few tens of microvolts of blurred, summed cortical activity. . Glossary entry or EOGElectrooculography (EOG) Recording eye position from the standing voltage across the eyeball, which moves with the eyes; also the main source of blink artifacts in EEG. Related: Blink artifactBlink artifact The large, slow deflection an eye blink produces in frontal channels, often ten times the size of the brain signal. , Electroencephalography (EEG)Electroencephalography (EEG) Recording the brain's electrical activity from electrodes on the scalp, a few tens of microvolts of blurred, summed cortical activity. . Glossary entry from Phase 1 as a switch, for a person whose only reliable signal is a muscle twitch or an eye movement, through a small board that closes a relay or produces a switch output. 3D-print the housings and, above all, the mounts: arms that clamp to a wheelchair tray or a bed rail and hold the switch rigidly at the exact position.
Wire everything to 3.5 mm plugs for the Adaptive Controller, or build a small board that emulates a USB gamepad (an Arduino Pro Micro or an RP2040RP2040 The Raspberry Pi microcontroller, cheap and well documented, with fast SPI and USB. Related: ESP32ESP32 A cheap microcontroller with Wi-Fi and Bluetooth, good for streaming data from a sensor board to a laptop. . Glossary entry does this natively) if the person plays on a PC.
Test and iterate
An hour of play with you watching. Where did they miss, what fatigued, what did they wish they could do. Fix, repeat, three times. Then a week of use and a follow-up visit. Then hand over with spare switches and a page of instructions a family member can follow.
- Find the person and their game. One listening visit.
- Map reliable movements. Choose switch types and sketch layouts. They pick.
- Print mounts and housings. Wire to the Adaptive Controller or a USB gamepad board.
- Play session, iterate, three times.
- A week of use, follow-up, hand-over with instructions and spares.
- Post the design to Makers Making Change so the next person benefits.