Marcin Wichary (code and design) Dominic Mazzoni (browser compatibility) Charles Chen (ChromeVox support) URL: http://code.google.com/p/html5slides/ --> Real Virtual Reality

Real Virtual (Augmented) RealityTM:










The future of Neuroscience/Neurology, Surgery, Health, Security, and Wellness

Tuesday January 31, 2017, Stanford University, Thorton 110, 4:30pm
Prof. Steve Mann: Chief Scientist, Metavision.com; Founder, InteraXon.ca
HI (Humanistic Intelligence) [Mann 1998]

“ Humanistic Intelligence [HI] is intelligence that arises because of a human being in the feedback loop of a computational process, where the human and computer are inextricably intertwined. When a wearable computer embodies HI and becomes so technologically advanced that its intelligence matches our own biological brain, something much more powerful emerges from this synergy that gives rise to superhuman intelligence within the single 'cyborg' being. ”

--Kurzweil, Minsky, and Mann,
   "The Society of Intelligent Veillance"
   IEEE ISTAS 2013.
Problem with current self-driving cars:

  • Lack of Feedback
  • Risk over rest
  • AI is only a half truth without HI
  • Surveillance is only a half truth without Sousveillance
  • The answer is HI and Sousveillant Systems
AI solution: replace human with machine:
HI solution: Empower Human with tech.


Neckworn camera with fisheye lens and sensors:


Gesture recognition, autogesture, augmediated reality
Priveillance™: Privacy and Veillance (Sur AND Sousveillance)
"Feedback delayed is feedback denied"

The Code of Ethics on Human Augmentation,
--TV04 [Mann 2004];
--VRTO2016 [S. Mann, B. Leonard, D. Brin, A. Serrano, R. Ingle, K. Nickerson, C. Fisher, S. Mathews, R. Janzen, M. A. Ali, K. Yang, D. Braverman, S. Nerkar, K. M.-Sanchez, Z. P. Harris, Z. A. Harris, J. Damiani, E. Button 2016]
Natural User Interfaces [Mann 2001]

Interfaces that won't needlessly distract users' attention.

Undigital anti-gestures

Nature-based, e.g. "Natural Philosophy" (Physics)
(Natural Elements, e.g. Earth, Water, Air);

Natural to use, e.g. as we engage in the real physical world.
Natural, innate, e.g. RWM (Reality Window Manager)

Other examples:
•Hydraulophone;
•Mindmesh ("Look and Think" instead of point and click);
•MannCar [Mann 1997];
•EyeTap.

Augmented Reality Driving simulation for rehabilitation:
    Absement-based Robotic Wrestling
            
"WROBOT" Wrestling with the Waterbot

Natural User Interface (NUI)


(image: Wikimedia Commons)
Intelligent Image Processing, Mann 2001
Natural User Interfaces
Metaphor-free computing
Reality User Interfaces

Hydraulophone

Hydraulophone



Toronto: Home of the world's largest hydraulophone!!!
Main centerpiece in front of landmark architecture site;
Water conservation: sophisticated recirculation system;
Permanent public art installation open 24 hours a day.
Universal access:
All ages; All abilities.

Standing Waves


Wikimedia Commons.

Now let me tell you about something different ==
let us call this new thing a "sitting wave".

Standing and Sitting Wave Comparison

Wearable Computing...

AR Vision: WearCam + WearComp + WearDisp



Crazy idea... 35 years ago...
Now a $241 billion industry!...
Nicholas Negroponte, Director of MIT Media Lab:

Early 1990s TV broadcast; Founding of MIT Wearable Computing Project
Wearable Computing with Wearable Cameras
Crazy idea... 35 years ago;

"Steve Mann is the perfect example of someone deemed to be on the lunatic fringe, but who persisted in his vision and ended up founding a new discipline."

--Nicholas Negroponte, Bangor Daily News - Sep 26, 1997.
--Nicholas Negroponte, Toroto Star, 2001 Jul. 8, 02:32 EDT, Page D3, `Wearable computer' pioneer Steve Mann keeps one eye locked on the future, by Eric Shinn

Now a $241 billion industry!...

HDR Video
35 years of Digital Eye Glass

MannGlass 1978 and GOOGlass 2013
Both of these are Generation-1 DEG
MannGlass 1998 (15 years ago):
Nature (human) and Technology (computer) combined!


Thin strip of metal wraps around the head;
No hinges: 1-piece construction.
Gen-4 Glass (Laser EyeTap)
Sleek slender metal frame, in one continuous piece
45-degree glass
Fiber optics
Not foldable
Completed 1998


Implantable camera system


Canadian Patent 2313693, filed 2000, July 19 by S. Mann
IMPLANTABLE CAMERA SYSTEM,
SYSTEME DE CAMERA IMPLANTABLE
Implantable camera system:
Vision system for the blind
and partially sighted.
50 Best Inventions of 2009 - TIME Magazine













Recent collaboration with filmmakers:
•Denys Desjardins ("My Eye for a Camera"), National Film Board of Canada; and
•Rob Spence
Mind-controlled illumination... EEG to DMX512 lighting... leading to interactive art installation... Ottawa, Toronto, Niagara Falls

Art Installation at Vancouver Olympics 2010


Muse, available at Best Buy stores all across North America
"Smart Shoes", Mann 1996, 1997

  • Personal Technologies, Vol. 1, No. 1, March 1997.
  • http://wearcam.org/personaltechnologies/
  • Array of force sensors.
  • Wearable musical instrument.
Modern version,
collaboration with students
Conclusions and future work:

•Feedback delayed is feedback denied;
•HI (Humanistic Intelligence) [Mann 1998]:
•Sousveillant Systems;
•Direct User Interfaces [Mann 1998];
•Natural User Interfaces [Mann 2001];
•Being digital is being quantized;
•Being undigital is being free!

•HIcar;
•Seeing Action Potentials;
•Neurosurgery with SWIM.

•Join our team!
•San Mateo, February and March 2017