How Augmented Reality Works // A Beginner鈥檚 Guide to AR - YouTube

Channel: Reality School

[0]
So you want to become an augmented reality content creator or maybe you
[5]
want to design or develop custom AR apps. The only problem is you just don't
[10]
understand how AR works. Well, this video is for you. Before we get started, I
[19]
actually want to clarify something. Augmented reality can be subdivided in
[23]
different modalities such as visual, auditory or haptics. In this video, we're
[30]
going to focus on visual-based AR. If someone asked you what augmented reality
[34]
was, how would you define it in one sentence? Pause the video and submit your
[39]
answer in the comments below. This is how I define augmented reality: AR is a
[46]
digital medium that allows you to overlay
[48]
virtual content into the physical world in a way that makes it seem like the
[52]
content is physically there. AR essentially allows us to merge the
[57]
digital and physical worlds. I bet you're curious to know how this magical
[62]
technology actually works. It all starts with AR enabled hardware such as a phone
[67]
or glasses. Most importantly, AR uses a system of cameras and in some devices
[73]
also time-of-flight 3d depth sensors to see and understand the physical world
[78]
around you. Imagine entering a room you've never ever been in, what do you
[85]
tend to do? You look around and make sense of your surroundings. Your mind
[90]
builds a mental model of the space so that you can memorize it and recall it
[95]
the next time you enter the same space. The processor in your head mapped the
[100]
environment using images from the dual camera system on your face. Similarly,
[106]
your phone or glasses also map your surrounding environment and build a
[111]
model of it using hardware sensors and specialized software, in this case
[116]
computer vision and machine learning software. Now imagine this room again,
[120]
when we move around the room we can pretty accurately estimate our location
[125]
within it. This is possible because we take into
[129]
account our relative position to important features in the room, such as
[133]
the walls, the desk and ultra-wide monitor. In AR this is referred to as tracking or
[139]
localization. The research community has a fun word called SLAM which stands for
[145]
Simultaneous Localization and Mapping. This is what your phone or glasses do
[150]
many times a second. They map your environment but also keep
[155]
track of where you are in relation to it. This is so important to understand. Once
[160]
mapping and localization are working well for a new environment, an AR
[164]
experience can begin. But how does the placement of AR content actually work?
[168]
When placing AR content, your phone or glasses really place them in the virtual
[173]
map of the environment. The virtual map, however, is invisible. So that's why it
[179]
looks like the digital content is placed in the physical world. It is therefore
[183]
really important that our virtual map is accurate and aligned with its physical
[188]
counterpart. In addition to mapping and localization, your AR device also senses
[193]
other characteristics of the environment, for example the light intensity and
[197]
color temperature. To make things appear as realistic as possible, our AR devices
[202]
sense the conditions of our environment and project that onto our digital
[206]
content as well. And that is how AR works. It maps your environment and tracks your
[212]
location within it. By doing that, it allows you to place digital content into
[216]
the physical world in a way that makes you and those around you believe that it
[221]
is actually there. I hope that you're super stoked to get started with
[225]
augmented reality. The technology feels magical and AR has a true potential to
[230]
disrupt every single industry on earth. I'm willing to bet it'll even spawn new
[236]
industries we haven't yet imagined. Now I know AR is still very new and
[241]
uncertain, so where do you get started? Well I'm glad you asked.
[245]
Subscribe to my channel and I will guide you along the way.
[249]
I will regularly upload content for my new series AR for Beginners. So tell me,
[255]
what will you create?