Phenomenal Augmented Reality (ΦAR): Wearables + IoT










DEG (Digital Eye Glass) combines Nature with Technology.
Augmented World Expo 2015 June 8-10
Steve Mann, Chief Scientist, Meta
PHENOMENAugmented Reality (ΦAR)

Visualizing audio using abakography

Sensing Sensing using feedback; Steve Mann, 1985

Abakographic visualization of radio waves (standing waves, RADAR)

"Bugbroom" demo, Rifdhan...
Surveilluminescence
Veilluminescence
Lights that glow when they're being watched
#veillance
Correct spelling of #veillance hashtag: remove first 3 letters from "SURveillance"
Patented photographic lighting system

Abakographic Image Processing:

ἄβακoς abakos, ἄβαξ ʾābāq, אבק
אבקוגרפי Abakogrpahy
אבקוגרפיה Avakographia
אבקאורגרפי Avakorgraphy

Pעpe™Information Conduits

Abakography אבקוגרפי

Pעpe™Information Conduits

Pעpes™ you can walk in: Wayfinding+Gaming

Spacetime continuum



Abakographic Principle invented by S. Mann

Modular photographic lighting, artistic lighting, and data visualization system.
Wearable Computing...

AR Vision: WearCam + WearComp + WearDisp



Crazy idea... 35 years ago...
Now a $241 billion industry!...
WearCam™ Vision-based AR

Augmediated Reality comprises 3 elements:

  • Wearable Camera ("WearCam"), connected to a
  • Wearable Computer ("WearComp"), connected to a
  • Wearable Display ("WearDisp").
Nicholas Negroponte, Director of MIT Media Lab:

Early 1990s TV broadcast; Founding of MIT Wearable Computing Project
1993, Thad Starner: "Tin Lizzy" Wearable

Starner, Mann, Rhodes, Rhodes, Levine, Healey, Kirsch, Pentland, (1997).
"Augmented reality through wearable computing"
Presence 6(4), pp386-398.
Wearable Computing with Wearable Cameras
Crazy idea... 35 years ago;

"Steve Mann is the perfect example of someone deemed to be on the lunatic fringe, but who persisted in his vision and ended up founding a new discipline."

--Nicholas Negroponte, Bangor Daily News - Sep 26, 1997.
--Nicholas Negroponte, Toroto Star, 2001 Jul. 8, 02:32 EDT, Page D3, `Wearable computer' pioneer Steve Mann keeps one eye locked on the future, by Eric Shinn

Now a $241 billion industry!...
Invention of Digital Glass, Mann 1978
35 years of Digital Eye Glass

MannGlass 1978 and GOOGlass 2013
Both of these are Generation-1 DEG
MannGlass 1998 (15 years ago):
Nature (human) and Technology (computer) combined!


Thin strip of metal wraps around the head;
No hinges: 1-piece construction.
Gen-4 Glass (Laser EyeTap)
Sleek slender metal frame, in one continuous piece
45-degree glass
Fiber optics
Not foldable
Completed 1998
IEEE Computer
IEEE Computer, Vol. 30, No. 2, February 1997
IEEE Computer, Vol. 30, No. 2, February 1997
IEEE Computer, Vol. 30, No. 2, February 1997 6ense™, http://wearcam.org/6ense/

(Sixth Sense™)
IEEE Computer, Vol. 30, No. 2, February 1997
IEEE Computer, Vol. 30, No. 2, February 1997
IEEE Computer, Vol. 30, No. 2, February 1997
Introduced "SixthSense", i.e. Gesture-based wearable computing + AR (fingertracker with colored tape on index finger)




Implantable camera system


Canadian Patent 2313693, filed 2000, July 19 by S. Mann
IMPLANTABLE CAMERA SYSTEM,
SYSTEME DE CAMERA IMPLANTABLE
Implantable camera system:
Vision system for the blind
and partially sighted.
50 Best Inventions of 2009 - TIME Magazine













Recent collaboration with filmmakers:
•Denys Desjardins ("My Eye for a Camera"), National Film Board of Canada; and
•Rob Spence

Neckworn camera with fisheye lens and sensors:


Gesture recognition, autogesture, augmediated reality
Priveillance™: Privacy and Veillance (Sur AND Sousveillance)


Little Data, Six Penny AR and Superpower to the People

Surveillance is the veillance of hypocrisy.

Sousveillance (the opposite of surveillance) is the veillance of ???

The opposite of hypocrisy is integrity.
[Lucaites, Condit, and Caudill, 1999, p92]
In this sense, surveillance often lacks integrity, and this lack of integrity invites corruption.

Centralized data storage leads to corruption; Compare with Yatim
DASTEM:

Brainwave-based Humanistic Intelligence + HI Clothing


Ongoing work with Celine, Johnny, Max, Tsuyoshi, Jason, Hang Wu, Hao Lv, and Di Zhang
Conclusion: #GetaMeta + enjoy #AWE2015

Phenomenaugmented Reality
S.W.I.M. (Sequential Wave Imprinting Machine), Mann 1974
Metasensing
GetaMeta and let us help you do something great with @metaglasses
and join us here at AWE2015




Three axes: from Bits, Atoms, and Genes ...
... to Physical Sci, Comp. Sci., and Soc. Sci.
Merging of the 3 worlds: IoT (surveillance); Wearables (sousveillance); AR.
Join in creating AR AR exhibit... Smithsonian, Computer History Museum...