Nintendo Labo: What it is, how it works, and why it's good.

Teased by Nintendo as a "new interactive experience" that is "specially crafted for kids and those who are kids at heart," Nintendo Labo seems at first to be a very strange meshing of papercraft and DIY robot building.  Utilizing unique features of the Nintendo Switch console with custom cardboard cradles and housings, you'll be able to transform the video game console into a myriad of devices with new functionality, creating new gameplay experiences in the process.  It's kind of the reverse end of what the public thought Nintendo might do with custom switch joy-cons for certain games, instead adapting the unique functionality of the joy-cons themselves.

While I love the presentation of the video itself, for a lot of switch owners or parents thereof, the Labo video is very quick in its presentation, skimming over how each device works.  For some viewers, it's going to just seem like really expensive pretend with cardboard.  So we're going to take a closer look at the functionality of the Nintendo Switch, it's controllers, how they'll feed into functionality of the Labo sets, and why this experiment is super cool.

The Nintendo Switch

A real quick summary for those not in the know:  the Switch is Nintendo's latest game console from 2017.  It's unique in a lot of ways, but the most defining feature is that the unit itself is a powerful tablet-like architecture with detachable side controllers called Joy-Cons.  This design allows the console to be played portable and be attached to a docking unit to output on a TV, creating a sort of 2-in-1 gaming experience.  The Joy-Cons are battery powered and contain a host of sensors including an advanced IR camera, an NFC reader, vibration motors, accelerometer and gyroscopes, both used for motion tracking.  The controller's communicate with the base system via bluetooth.  These functions, while rarely used with most traditional video games on the system, are key in making the Labo kits functional.

How it works

The info that Nintendo has provided so far is that there will be two sets for the Labo platform released on April 20th at $70 and $80 respectively.

Included in the Variety Kit

• RC Cars
• Fishing Rod
• House
• Motorbike
• Piano
• Variety Kit Software

The second Robot Kit is one project used to make a backpack and pulley system in order to play a robot game on the TV.  It actually seems like it's an adaptation of Nintendo's Project Giant Robot on the WiiU.  It will come with software to run with the kit when it's finished.

The kicker for all of these is by using all of the sensors on the Joy-Cons plus the included software you turn them into functioning interactive experience.  Lets go through how each works.

Piano

The Piano is sort of the give-away for this entire project.  By inserting the right Joy-Con (the only one with an IR camera) into the back of the Piano, along with the tablet base, you can make your own electronic keyboard.

The IR sensor will measure the distance of the 13 keys to register as either pressed or resting, with rubber bands pulling the keys back after they're pressed.  Send these key presses back to the tablet and emit the proper tone and you've got music.

The screen itself has the potential to display simple melodies or even chords.  Also on the top of the housing are a play/pause and recording button.

RC Cars

Probably the simplest device of the bunch, the Joy-Con's vibration motors are capable of driving the device forward or to turn either left or right by activating one or the other.  

Fishing Rod

Combination use of the accelerometer and gyroscope to track the fishing rod's rotation on the reel and it's position, while the gamepad gives you info on the fish and when to start reeling them in. The second Joy-Con is positioned in the handle to enhance the motion tracking.

House

Similar to the Piano, the right Joy-Con's IR sensor points down in the house, tracking different openings and showing reactions on the screen inside of the house.  The best showing is inserting a faucet and turning on water, which has position and rotation provided by the left Joy-Con

Motorbike

Joy-Cons on the left and right handle of the kit allow for accurate turning, as well as rotating the handlebars themselves to control throttle.  The screen in the middle of the handlebars displays a course for the driver.  Expect some light rumble that increases the faster you go.

Robot Kit

The most complex of the bunch and probably having software the closest resembles an actual game.  The backpack unit uses the IR sensor to track four pulley positions for the players limbs and can track if they're extended or retracted.

The second controller is attached to a headset mount of the player and will track head rotation.

Both of the controllers will also probably be using their accelerometer and gyroscopes to track the player's facing and and movements.  All of this data will get transmitted to the docked tablet to control an on-screen robot.  Expect to be doing a lot of punching and transforming.

Why it's good

It's kind of hard to hate this experiment unless you're some kind of monster.  This sort of gamified learning is right up their with other children construction toys like Lego, presenting kids and parents with interactive directions to follow along with, and also explaining how each device works.  This has huge potential to have kids learn not only how things work but also introduce kids to other activities like music, construction, art, or even simple programming.  All of this getting Trojan horse'd into a very popular video game console is kind of perfect in concept.

Price is my one real worry about this project.  $70 and $80 is above the average for most AAA video games, and that's not including the extra $300 for the consoles themselves.  Keep in mind however that it isn't just the cardboard, but the software included in each kit that goes into the cost.  My hope is that Nintendo does pursue the education market to some degree and offer discounts or bundles in places like schools that are interested.

Nintendo Labo kits 1 and 2 come out on April 20th.  If you're in the San Francisco or New York area and have a child between 6 and 12, you can attend an early 3-hour preview in February and March.

Find out more about Nintendo Labo here.