Face Blur. Computer Vision

While blurring something out in After Effects recently, I realized the relationship between the blur, with tracking (including Z axis tracking) and computer vision.

 

“Hold Infinity in the palm of your hand...A fibre from the Brain does tear...The Game Cock clipd & armd for fight...Has left the Brain that wont Believe”
— William Blake - Auguries of Innocence

Notes taken on a mobile device. Pardon any auto-corrections or incorrection.

Security in AR and the dark side of the future.

"The user interface you think of today will radically change over the next five years for the apps you buy and for the applications you build." - Gartner Top 10 Strategic Technology Trends 2018

It is understood or expected that AR is in Gartner's horizon for 2018.
What is surprising is the emphasis on net security and specifically setting up decoys for digital intruders. Netsec very large and over looked market by interaction designers, largely because it is not a consumer facing experience. It is an experience no one wants to face.
As AR becomes the interface to innovations that we cannot see, such as the blockchain, UAVs and UMS, machine learning, and ambient computing, it will also become an interface or seam to our lives that can be hacked.
I gave a talk on the dark side of AR UX and cited Neal Stephenson's novel the Diamond Age and how someone was infected with " a meme that ran advertisements for roach motels, in Hindi, superimposed on the bottom right-hand corner of his visual field, twenty-four hours a day."

We may not face threat of 24/7 visual hack anytime soon as AR contact lens ventures have been invested in but not innovated upon. But what about "pop-ups" or visual attacks while driving, walking, or operating machinery? We understand the work place, manufacturing, and other enclosed environments to be the first contexts for digital eyewear to reiceve adoption.

As we design the interface to ubiquitous computing we not only need to make it usable (something we struggle with), useful (something we constantly aspire to), but also safe. That's something we're not aware of. People question how advertising will be non-intrusive with AR. But there are deeper sides that public discourse has not touched upon yet.
 

 

Notes taken on a mobile device. Pardon any auto-corrections or incorrection.

Three Types of Design

John Maeda dissected design into three types of design.
This model was first displayed in KPCB's 2016 Design in Tech Report.
It has since been reused in 2017's DIT Report.
 

3 Types of Design - John Maeda KPCB Design in Tech Report

I find it useful in conveying to people the types of design I specialize in. Design Thinking to define new revenue streams for better business models. And Computational Design, such as using WebVR to code functional Augmented Reality prototypes.

Madea writes how this simple chart is controversial. Much the model can be debated. For example, websites and mobile sites could be seen as falling into "Classical Design" because we have been making them for decades.

See more on the Design in Tech report here.

 

Notes taken on a mobile device. Pardon any auto-corrections or incorrection.

xR Announcements - 2017 Q2

Recent xR announcements
include but are beyond head mounted displays

Screen Shot 2018-01-17 at 11.43.58 PM.png

 

Facebook: 
Use cases for AR

- information
- digital objects
- enhancements

Focused on the camera as the AR platform

https://www.youtube.com/watch?v=OFkEHEWPZSU 

 

Building Blocks
- Precise Location
- (SLAM) Simultaneous Localization & Mapping
- Mapping 3D scenes from still photos
- 3D Effects
- Object recognition 

Use Cases visualized
Leave directions or notes for friends.

Give people more information about where they are

Drop digital objects other people can find and interact with right there

https://www.youtube.com/watch?v=K_bTzosFGUs


MSFT

- Use by airlines to make jet engines
- To manager factories with data overlaid
- For medicine
- In education
Released hand held controllers (they are the only 6DOF multi-hand controllers you can set down on a flat surface).

 


Google Lens:
“Vision based computing capabilities”
Tango is now ARCore - 
based on:
- Camera movement
- Approximate Lighting
- Planar tracking (horizontal only)


Apple: 
ARKit
- Approximate lighting
- Amazon has a game development engine.
The implications for commerce are huge.


They don’t have to be in HMDs
Newly announced experiences are mobile based.

But… whatever devices we wear will offer functionality of replacing everything that we do with current mobile phones.

Torch 3D has people ask, "This prototyping tool your creating. If you don’t think people will use it for games…what will they use it for?"
Torch 3D's answer is “For everything else. Everything that we currently use our phones for.”

It is immediately important to understand how it affects your business beyond the CMO role and across your organization.

Notes taken on a mobile device. Pardon any auto-corrections or incorrection.

Highlights from the preview of ARiA

From Charles' Finks preview of Augmented Reality in Action on Forbes.

1. It’s already here.

“What's visible to the consumer right now are tricks like masks, filters, and games that nibble at the edges of visual computing, but what's invisible is the way AR has been integrated into every day life. For example, most new cars have a heads up display: data projected onto the driver's windshield. Broadcast news and sports now routinely lay data, graphics, and animation onto the physical world. AR has become ubiquitous in ways that have nothing to do with smart glasses.”

2. It’s going to get bigger

“ 'AR is on the verge. It’s exciting to watch it take shape. In the end, it won’t even be called AR. That it will disappear,’ says Bob Metcalfe, Professor of Innovation at the University of Texas, Founder of 3Com, who famously formulated Metcalfe's Law, which states that the value of a telecommunications network is proportional to the square of the number of connected users of the system.”



3. It’s going to be really big

“ Many industry insiders see AR/VR as the fourth wave of modern computing following mobile computing, the internet, and personal computing. With each subsequent wave dwarfing the previous in market size and social impact, this is one wave you may want to catch. AR is likely to replace not only the majority of screens in use but alter the way we interact with computers forever.”

Read in full here: https://www.forbes.com/sites/charliefink/2018/01/15/aria-the-ar-conference-at-mit-is-the-anti-ces/#6f3bdd133e7c

Notes taken on a mobile device. Pardon any auto-corrections or incorrection.

Teaching Prototyping for VR/AR/xR

I'm teaching a full day workshop at R/GA on Prototyping VR/AR/xR.
Two years ago, I spoke about skill gap when designing for xR. People asked me what I mean by xR. I replied "Extended Realities" but initially meant x for whatever form or degree of reality we are designing for when it comes to spatial computing and three dimensional interfaces.

This class shows the fundamentals of designing in three dimensionally rendered space to prototype across the reality-virtuality spectrum from VR to AR using web based technologies.

This approach of using web based technologies allows participants to developer a prototyping pipeline that can be experienced cross platform. So the output is not application dependent such as Snap Lens Studio or Facebook AR Studio. Nor do the experiences rely on Unity and Unreal to produce platform dependent applications for  ARCore on iOS and ARKit on Android.
The web has largely brought about a democratization of information consumption and production.  This full day course makes prototyping the next generation of computing accessible.

Join the class

Notes taken on a mobile device. Pardon any auto-corrections or incorrection.

R/GA University and Prototyping In VR.

Fresh off the MIT Media Lab Reality Virtually Hackathon and getting inspired by the NYVR Expo, I'm really excited to be part of R/GA U's public launch.

This full-day intensive course is a deep dive into one of the most exciting technological developments.
Image Courtesy R/GA-U.

Image Courtesy R/GA-U.

Take part in this course I teach with a Creative Director from the semi-top-secret Prototype Studio.

Want to Prototype VR?

Notes taken on a mobile device. Pardon any auto-corrections or incorrection.

Tony Parisi (Unity): Face the Future - Computing in an Augmented World

We capture only the photons in front of us.

The expense (of creating 3D content) has never been justified for rendering it on a flat screen - except for a game.
until now…

The creation and access are cheaper

Today’s kids are tomorrow’s xR natives.
With XR there’s nowhere to go but in.


3 areas (for growth):
Software
Content
Services 

Notes taken on a mobile device. Pardon any auto-corrections or incorrection.