ECE516: Intelligent Image Processing










DEG (Digital Eye Glass) combines Nature with Technology.
First day of lectures: 2022jan09, 5pm, in BA3165
Prof. Steve Mann, TAs: Ali Barzegar Khanghah and Navid Hasanzaeh
Overview:
• Available to 3rd and 4th year undergrads, or grad. students.
• Textbook: "Intelligent Image Processing", Wiley
• Course website: http://wearcam.org/ece516/

Not a good course to "audit":
Need to be registered for course credit:
• There is little or no use in "auditing" this course.
• The course is an embodied opportunity for interaction with founders.... 
2023 class, lab, and office hour schedule:
  Mon. 5pm lecture;
  Wed. 3pm lecture;
  Thu. 9am lab (certain days) and 3pm lecture. 
  Office hours: 1 hour after each class, plus additional times by arrangement.
Course Evaluation (Grading):
• Closely Supervised Work: 40% (in-lab reports, testing, participation, field trials, etc.);
• Non-Closely Supervised Work: 25% (take-home assignments or the portion of lab reports done at home);
• Final exam: 35%. Exam is open book, open calculator, but closed network connection.
• No midterm!

The ones who usually get a 100% mark are the early starters.
Grading sessions in labs.

Respect in the labs:
• Don't tamper with other people's experiments;
• No borrowing equipment without asking one of the DepuTAs;
• If you're in the lab you should be doing ECE516-related material;
This is a "DO" course:
"Labs" are grading sessions! Your group will BRING + demo:
• working code your group wrote; or
• a working electronic circuit that you built ; or
• a mechanical system you built; or
• measurements and scientific results; or
• improvements to your project from previous lab!

If you wish, you can choose your own projects:
1. OBSERVE topics raised in the first few course lectures;
2. Think of a related project you can DEFINITELY DO which is FUN for you;
3. DISCUSS with, Steve, Ali, and Navid;
4. Get started and TRY something!

You may switch projects later, or do different projects each lab period! If you choose to work on your own projects: high marks for something small that works well; less marks for something grandiose that works unreliably or has poor connection to course material.

Flexibility:

(1) Student track (traditional), plus opportunity (and optional mentorship) to publish papers (dozens of IEEE+ACM papers published by students in this course);
(2) Inventrepreneur track: InventorshipMentorship for patent opportunities, and startups (YC, Silicon Valley, etc.);
(3) Deputy track: Learn leadership, how to be teach, etc.. Ideal for the aspiring professors.

• No "bell curve" (500-series);
• Option for custom-designed lab projects and assignments based on direct consultation each year!
• Option to do your own projects, but MUST connect to course material....
Phenomenal Team:

• Founders of new fields of research;
• Modern-day Leonardo daVinci thinkers;
• Choose courses taught in fields created by those teaching the material (Ryan, Pete, Adnan, ...).

Transparent Technology



RCA906 CRT Pictures courtesy of Neil Heckt, who passed away on August 19, 2015. May we all remember Neil for his great service to the community, his natural curiosity in regards to all things electrical, and as a great educator through web-based media.

Standing Waves


Wikimedia Commons.

Now let me tell you about something different ==
let us call this new thing a "sitting wave".

PHENOMENAugmented Reality (ΦAR)

Visualizing audio using abakography

Sensing Sensing using feedback; Steve Mann, 1985

Abakographic visualization of radio waves (standing waves, RADAR)

Pעpe™Information Conduits

Abakography אבקוגרפי

Pעpe™Information Conduits

Pעpes™ you can walk in: Wayfinding+Gaming

Spacetime continuum



Abakographic Principle invented by S. Mann

Modular photographic lighting, artistic lighting, and data visualization system.
Wearable Computing...

AR Vision: WearCam + WearComp + WearDisp



Crazy idea... 35 years ago...
Now a $241 billion industry!...
WearCam™ Vision-based AR

Augmediated Reality comprises 3 elements:

  • Wearable Camera ("WearCam"), connected to a
  • Wearable Computer ("WearComp"), connected to a
  • Wearable Display ("WearDisp").
Nicholas Negroponte, Director of MIT Media Lab:

Early 1990s TV broadcast; Founding of MIT Wearable Computing Project
Wearable Computing with Wearable Cameras
Crazy idea... 35 years ago;

"Steve Mann is the perfect example of someone deemed to be on the lunatic fringe, but who persisted in his vision and ended up founding a new discipline."

--Nicholas Negroponte, Bangor Daily News - Sep 26, 1997.
--Nicholas Negroponte, Toroto Star, 2001 Jul. 8, 02:32 EDT, Page D3, `Wearable computer' pioneer Steve Mann keeps one eye locked on the future, by Eric Shinn

Now a $241 billion industry!...

HDR Video
35 years of Digital Eye Glass

MannGlass 1978 and GOOGlass 2013
Both of these are Generation-1 DEG
MannGlass 1998 (15 years ago):
Nature (human) and Technology (computer) combined!


Thin strip of metal wraps around the head;
No hinges: 1-piece construction.
Gen-4 Glass (Laser EyeTap)
Sleek slender metal frame, in one continuous piece
45-degree glass
Fiber optics
Not foldable
Completed 1998


Implantable camera system


Canadian Patent 2313693, filed 2000, July 19 by S. Mann
IMPLANTABLE CAMERA SYSTEM,
SYSTEME DE CAMERA IMPLANTABLE
Implantable camera system:
Vision system for the blind
and partially sighted.
50 Best Inventions of 2009 - TIME Magazine













Recent collaboration with filmmakers:
•Denys Desjardins ("My Eye for a Camera"), National Film Board of Canada; and
•Rob Spence
Mind-controlled illumination... EEG to DMX512 lighting... leading to interactive art installation... Ottawa, Toronto, Niagara Falls

Art Installation at Vancouver Olympics 2010


Muse, available at Best Buy stores all across North America

Lowdown Focus eyeglass

Neckworn camera with fisheye lens and sensors:


Gesture recognition, autogesture, augmediated reality
Priveillance™: Privacy and Veillance (Sur AND Sousveillance)


Surveillance is the veillance of hypocrisy.

Sousveillance (the opposite of surveillance) is the veillance of ???

The opposite of hypocrisy is integrity.
[Lucaites, Condit, and Caudill, 1999, p92]
In this sense, surveillance often lacks integrity, and this lack of integrity invites corruption.

Centralized data storage leads to corruption; Compare with Yatim
See http://wearcam.org/integrity.htm, and scroll down to "Principles, Tenets of Integrity".

Veillance Foundation: Decriminalizing Integrity in the age of hypocrisy
"Daddy, why do cars and buildings ALWAYS have the right to wear cameras, but people sometimes don't?" -- Stephanie, Age 7, in response to her father being physically assaulted at a McDonalds in Paris, France for wearing a computerized seeing aid.
48 years inventing, creating, and living in XR

... since childhood in the 1970s... http://wearcam.org/xr.htm

DR = Diminshed Reality = sensory attenuation

None of the prior realities (VR, AR, MR, MiXR, etc.) directly address sensory attenuation!

Earplugs, sunglasses, HDR welding helmets, sensory deprivation tanks, and Sensory Reprivation™

Mersivity™

Total sensory deprivation defines the origin (zero point) of XV Continuum.
World’s first VR float tank: http://wearcam.org/waterhci2003
[Surveillance & Society 1(3), pp 375-398, 2003]
[Leonardo 37(5), pp 372-374, 2004]
 Multimediated Reality/Intelligence™

















Photograph of radio wave, S. Mann, July 6, 1974

















Metavision, S. Mann, 1974

See and photograph sensors (e.g. police radar).
Metavision(1974) and XR(1991): predecessors of metaverse(1992)

Modern metavision: IoT
S.W.I.M.


Photograph of car with SWIM:

SWIM = Sequential Wave Imprinting Machine

See and photograph metaveillance

(the eXtendiVerse, abbreviated "XV")

http://wearcam.org/droneswarms.pdf
http://wearcam.org/droneswarms.pdf
MotoMetaVerse















See and photograph magnetic fields with SWIM
http://wearcam.org/SWIMotor/
XR Definition:

XR is any combination of a virtual environment with reality where the virtual environment is responsive to a real or complex-valued output from reality, by way of real-time computation.

S. Mann and C. Wyckoff, 1991 (wearcam.org/xr.htm)

Collaborative (shared) XR

http://wearcam.org/abaq.pdf

XV Definition:

XV is a shared XR intelligent environment.

XV combines XR (eXtended Reality, perceived with senses or peripherals including neural-interfaces), XI (eXtended Intelligence, including HI = H. Int. = Humanistic Intelligence = human-in-the-loop Artificial Intelligence), XB (eXtended Being, including Digital Twin), XE (eXtended Economy), and XS (eXtended Society) into a vision that covers the generally agreed scope of metaverse while extending the impacts and emphasizing the implications on our consciousness and humanity.

S. Mann and Y. Yuan

Grand Challenges:


1. Standards, Yu Yuan...;

2. Human factors + perceptual eff. Tom F.;

3. Reliability (ruggedization, etc.) Joe;

4. Storage (sousveillance) Thomas;

5. Ethical, ... Advance tech. for humanity!

Touch on #4 briefly...

Consider s=scale, e.g. s(α, β, γ)...

Body, Ownership, and Control!

Environment versus invironment (technology that becomes part of us):

• Clothing analogy;
"Very funny, Scotty. Now beam me up my clothes."
-- Sean Keogh, Bottoms Up: A Cheeky Look At Life.

• Car or boat analogy.
"You hit me!"
Cyborgs existed > a million years ago

Summary:

The 500% principle

Three Choices:
(1) Student track (traditional), plus opportunity (and optional mentorship) to publish papers;
(2) Inventrepreneur track: InventorshipMentorship for patent opportunities, and startups (YC, Silicon Valley, etc.);
(3) Deputy track: Learn leadership, how to be teach, etc.. Ideal for the aspiring professor.

Need to be registered for course credit: There is little or no use in "auditing" this course. The course is an embodied opportunity for interaction with founders....