GlassEyesTM
........ 35 years of Digital Eye Glass and AR in everyday life ........ Present+Future: Gen-5 Digital Eye GlassSteve Mann
Thurs . 2013 June 27, 10am
IEEE ISTAS13, Toronto, Ontario, Canada
Steve Mann
Thurs . 2013 June 27, 10am
IEEE ISTAS13, Toronto, Ontario, Canada
Welding Glass...
Digital Welding Glass...
Digital Eye Glass to help people SEE BETTER!
Augment AND Diminish (Augmediate) Reality...
AR Vision: WearCam + WearComp + WearDisp
Crazy idea... 35 years ago...
Now a $241 billion industry!...
AR Vision:
• WearCam +
• WearComp +
• WearComm +
• WearDisp
1984, 1996
Steve Mann, 1996. Others, e.g. Mark Spitzer, interested in this ordinary-looking "Digital Eye Glass"
330 Dundas St. West, today after talks +before gala
MannGlas (1978-1980) and Google Glass (2013)
Both of these are Generation-1 DEG
WearComp4, 1984
Sleek slender metal frame, in one continuous piece)
45-degree glass
Fiber optics
Not foldable
Completed 1998
Nicholas Negroponte, Director of MIT Media Lab:
Early 1990s TV broadcast; Founding of MIT Wearable Computing Project
Augmediated Reality comprises 3 elements:
• Wearable Camera ("WearCam"), connected to a
• Wearable Computer ("WearComp), connected to a
• Wearable Display ("WearDisp").
WearComp + WearDisp is a well-researched field.
But WearCam is not: cameras are always merely added on as an afterthought ---- zero consideration to the light flow path!!!
- Lightspace Analysis Glass, Lightspace Synthesis Glass,
- Tensor outer product of plenoptic function with itself.
- Generation 1 Digital Welding Glass: 3rd Eye, separate, "Look Up" information;
- Generation 2 Digital Eye Glass: EyeTap;
- Generation 3 Glass: EyeTap with focus-tracking;
- Generation 4 Glass: infinite depth of focus, e.g. Laser EyeTap;
- Generation 5 Glass: True 3d: Meta-view + POE TM Software-based EyeTapping
- Google Glass is a Generation-1 Digital Eye Glass ("3rd eye")
MannGlass 1999; GoogleGlass 2012:
Quantigraphic camera promises HDR eyesight from Father of AR
Invention of HDR (High Dynamic Range) imaging:
"The first report of digitally combining multiple pictures of the same scene to improve dynamic range appears to be Mann." in "Estimation-theoretic approach to dynamic range enhancement using multiple exposures" by Robertson etal, JEI 12(2), p220, right column, line 26
Synthetic Gen-5 Digital Eye Glass (Computational P.o.E.)
Seeing aid for the blind: Wearable true 3D cameras
ACM Multimedia 2011, Mann, Huang, Janzen, Lo, Rampersad, Chen, Doha
Implantable camera system
Canadian Patent 2313693, filed 2000, July 19 by S. Mann
IMPLANTABLE CAMERA SYSTEM,
SYSTEME DE CAMERA IMPLANTABLE
Vision system for the blind
and partially sighted.
Art Installation at Vancouver Olympics 2010
Neckworn camera with fisheye lens and sensors:
Gesture recognition, autogesture, augmediated reality
PriveillanceTM: Privacy and Veillance (Sur AND Sousveillance)
- The contract analogy;
- The secrecy of security (e.g. domes): Hypocrisy, integrity, surveillance, sousveillance
- Sensory-Entitlement Principle
- Liabalization
- "The law is advancing so rapidly --- so many stupid laws are being enacted so quickly --- that technology is having a hard time catching up!" -- S. Mann
- EXISTech,
Natural environments and intelligent environments
"Environment" and "Nature" in the wide sense:
The environment around you can be an human-made!
Nature includes Natural Philosophy (physics).
Natural User Interface (NUI)
(image: Wikimedia Commons)
Intelligent Image Processing, Mann 2001
Natural User Interfaces
Metaphor-free computing
Reality User Interfaces
Cyborg Enrivonment Interaction (CEI)
Nature in the wide-sense...
Environment in the wide-sense
Centre for Cyborg Enrivonment Interaction (CEI)
Centre for Nature, Technology, and Health
Centre for Multidisciplinary Mobile+Wearable Tech.+
We're all cyborgs in some sense... shoes, clothing...
We thus interact indirectly with nature
Natural elements: Earth, Water, Air...
Water, in particular, is an exemplary natural element.
Intimate, pure, primal, primordial
Natural, innate, e.g. RWM (Reality Window Manager)
Nature-based, (Natural Elements, e.g. Earth, Water, Air)
Canada's largest museum of
world culture and natural history.
Canadian invention
used around the world.
WaterHammer Demo (Ryan)
Hydraulophone for members of the public to play:
SPLASH Festival 2011, Lake Simcoe, Georgina Ontario
Headline Act for Winterlude, North America's largest winter festival...
Dr. Draw and Ryan Janzen, etc....
Hydraulophone
Hydraulophone
Toronto: Home of the world's largest hydraulophone!!!
Main centerpiece in front of landmark architecture site;
Water conservation: sophisticated recirculation system;
Permanent public art installation open 24 hours a day.
Hydraulophone
Toronto: Home of the world's largest hydraulophone!!!
All ages; All abilities.
WOIP (Water Over Internet Protocol)
Multimedia beyond acoustic vibrations in water:
To touch and be touched by water.
Try to stop me if you will.
I'll keep on spraying, spraying still.
I am water, still as glass,
so block me, block me, still I pass. ----S. Mann, 2011
WOIP (Water Over Internet Protocol)
First Mover Advantage:Touch and be touched by water, across the parking lot, or Hands and Feet Across the Harbour...
Hydraulikos Research Lab
Where do we go from here...
Collaborators:
• University of Toronto,
• Faculty of Applied Science and Engineering,
• Dept. Electrical and Computer Engineering ("Tech"),
• Faculty of Forestry ("Nature");
• InteraXon
• Ori Inbar, Pete Wassell
• EPSON
• Meta: Steve Mann, Chief Scientist; Raymond Lo, Director of Research and Development
• IEEE ISTAS (IEEE is the world's largest technical society)
Conclusions
Natural User Interfaces and "Humanistic Intelligence":
Global Centre for Nature + Technology + Health
Natural Elements: Earth, Water, Air
GlassEyes: AR in everyday life
Theory of Glass: Gen-1 (Google), Gen-5 (Meta-view)
Priveillance, Equiveillance, ... Veillance.me
Mann-Wassell Law