Wednesday, September 29, 2021

"Leaked Documents Show How Amazon's Astro Robot Tracks Everything You Do" (AMZN; EVIL)

From VICE, September 28:

Leaked meetings show the robot will heavily rely on facial recognition and user behavior, but sources who worked on Astro say the robot is flawed.

Amazon's new robot called Astro is designed to track the behavior of everyone in your home to help it perform its surveillance and helper duties, according to leaked internal development documents and video recordings of Astro software development meetings obtained by Motherboard. The system's person recognition system is heavily flawed, according to two sources who worked on the project.

The documents, which largely use Astro's internal codename "Vesta" for the device, give extensive insight into the robot's design, Amazon's philosophy, how the device tracks customer behavior as well as flow charts of how it determines who a "stranger" is and whether it should take any sort of "investigation activity" against them. 

Sentry

In its announcement video, Amazon says Astro is designed to give "peace of mind" to its owners. First and foremost, Astro is a surveillance device that tracks you and everyone who enters your home. When a user purchases the $999 robot, customers are asked to "enroll" their face and voice, as well as the faces and voices of anyone who is likely to be in a home, so Astro can learn who is supposed to be there.

One of the internal documentation files presented in a development meeting and obtained by Motherboard describes how Astro patrols an owner's home and tries to identify people it encounters. Other files refer to “Sentry,” the components and software that control the device's security features. Sentry software includes integration with Ring cameras and Alexa Guard, Amazon's home security service.Screen Shot 2021-09-28 at 5.04.20 PM.png

The meeting document spells out the process in a much blunter way than Amazon's cutesy marketing suggests.

"Vesta slowly and intelligently patrols the home when unfamiliar person are around, moving from scan point to scan point (the best location and pose in any given space to look around) looking and listening for unusual activity," one of the files reads. "Vesta moves to a predetermined scan point and pose to scan any given room, looking past and over obstacles in its way. Vesta completes one complete patrol when it completes scanning all the scan point on the floorplan.

"Astro is terrible and will almost certainly throw itself
down a flight of stairs if presented the opportunity."

If the robot detects what it thinks is something out of the ordinary, such as seeing a person it doesn't recognize, or a sound like glass breaking or a fire alarm, it will investigate further including following an unidentified person around the house, the file reads....

....MUCH MORE