Difference between revisions of "Augmented Reality"

From Pokemon Go Wiki
Jump to: navigation, search
(Created page with "= Augmented Reality = ''Augmented reality'' (AR) in '''Pokémon GO''' allows digital Pokémon, items, and UI elements to be rendered over the live camera feed, appearing as i...")
 
 
(18 intermediate revisions by the same user not shown)
Line 1: Line 1:
−
= Augmented Reality =
+
[[file:pokemon go AR1.png|350px|right]]
 +
'''[https://vrarwiki.com/wiki/Augmented_reality Augmented Reality] [https://vrarwiki.com/wiki/AR (AR)]''' is a technology that overlays computer-generated images, sounds, and contextual data onto the real world, creating an interactive composite view. Unlike [https://vrarwiki.com/wiki/Virtual_reality Virtual Reality], which replaces the user’s surroundings entirely, AR supplements reality, letting digital [[Pokémon]] appear on streets, in parks, or even on a player’s desk. Since its launch in July 2016, Pokémon GO has continuously expanded its AR tool-set, evolving from a simple camera overlay into sophisticated, persistent, and shared experiences that leverage surface detection, spatial mapping, and cloud anchoring.
  
−
''Augmented reality'' (AR) in '''Pokémon GO''' allows digital Pokémon, items, and UI elements to be rendered over the live camera feed, appearing as if they occupy physical space around the Trainer. Since the game’s launch in July 2016, developer '''[[Niantic]]''' has expanded AR from a simple overlay to advanced experiences such as [[AR+]], [[GO Snapshot]], [[Buddy Adventure]], Reality Blending, AR Mapping, and [[Pokémon Playgrounds]]. These features rely on Apple’s [[ARKit]], Google’s [[ARCore]], and Niantic’s own [[Lightship]] ARDK and [[Visual Positioning System]] (VPS).<ref name="ARPlus2017" /><ref name="ARPlusAndroid2018" /><ref name="RealityBlending2020" />
+
For a broader introduction to AR concepts, see the [https://vrarwiki.com AR Wiki].
−
 
+
__NOTOC__
−
== Definition and context ==
+
==Historical development==
−
AR in '''Pokémon GO''' uses '''marker-less, inside-out tracking''' to lock 3-D Pokémon models to real-world planes detected by the device camera, enabling players to walk around, view them from different angles, and take photographs. The concept aligns with the [[inside-out tracking]] article on the external [VR & AR Wiki](https://vrarwiki.com/wiki/Inside-out_tracking).<ref name="VRARwiki" />
 
−
 
 
−
== Historical development ==
 
 
{| class="wikitable"
 
{| class="wikitable"
−
! Year !! Milestone !! Key details !! Sources
+
! Year !! Milestone !! Key details
 
|-
 
|-
−
| 2016 || Launch overlay || Basic camera passthrough; could be toggled off for battery savings. || <ref name="CatchingARHelp" />
+
| 2016 || Launch overlay || Basic camera passthrough. optional toggle for battery savings.
 
|-
 
|-
−
| 2017 || [[AR+]] (iOS) || Uses ARKit for surface detection, proximity ‘‘stealth’’ meter and ''Expert Handler'' bonus. || <ref name="ARPlus2017" />
+
| 2017 || [[AR+]] (iOS) || Surface detection, proximity ‘‘stealth’’ meter, and ''Expert Handler'' bonus on ARKit devices.
 
|-
 
|-
−
| 2018 || AR+ on Android || Requires ARCore-compatible devices running Android 7.0+. || <ref name="ARPlusAndroid2018" />
+
| 2018 || AR+ on Android || Requires ARCore-compatible phones running Android 7.0+.
 
|-
 
|-
−
| 2019 || [[GO Snapshot]] || Stand-alone photo mode for any stored Pokémon; supports social sharing and Smeargle photobombs. || <ref name="Snapshot2019" />
+
| 2019 || [[GO Snapshot]] || Stand-alone photo mode for any stored Pokémon. supports social sharing and Smeargle photobombs.
 
|-
 
|-
−
| 2019 || [[Buddy Adventure]] || Lets Trainers interact with and photograph their buddies together in Shared AR. || <ref name="Buddy2019" />
+
| 2019 || [[Buddy Adventure]] || Let Trainers interact with and photograph buddies together in Shared AR.
 
|-
 
|-
−
| 2020 || Reality Blending & AR Mapping || Depth-based occlusion and crowd-sourced PokéStop Scans. || <ref name="RealityBlending2020" /><ref name="ARMappingHelp" />
+
| 2020 || Reality Blending & AR Mapping || Depth-based occlusion and crowd-sourced PokéStop Scan tasks.
 
|-
 
|-
−
| 2024 || [[Pokémon Playgrounds]] || VPS-anchored, persistent AR that other players can see. || <ref name="Playgrounds2024" />
+
| 2024 || [[Pokémon Playgrounds]] || VPS-anchored, persistent AR that other players can see.
 
|}
 
|}
  
−
== Core AR features ==
+
==Core AR features==
 +
===AR Catching & AR+===
 +
*'''Standard AR mode''' places the wild Pokémon in the centre of the camera feed and tracks the device’s [https://vrarwiki.com/wiki/Gyroscope gyroscope] and [https://vrarwiki.com/wiki/Accelerometer accelerometer] for orientation. 
 +
*'''AR+ mode''' (2017 iOS / 2018 Android) anchors Pokémon to detected planes, renders them at canonical scale, and introduces an '''awareness meter''', an approach too quickly and the target may flee.
  
−
=== AR Catching & AR+ ===
+
===[[GO Snapshot]]===
−
* '''Surface detection''' creates tall grass; tapping reveals the Pokémon.<ref name="CatchingARHelp" />
+
Players can choose any caught Pokémon, place it on a detected surface, reposition it, and capture photos. Smeargle and special-event photobombs may appear after a snapshot session.
−
* '''Stealth meter''' rewards slow, careful motion with an ''Expert Handler'' XP/Stardust bonus.<ref name="ARPlus2017" />
 
  
−
=== GO Snapshot ===
+
===[[Buddy Adventure]] & Shared AR===
−
* Players can place any Pokémon, change angles, and tap to direct its gaze.<ref name="Snapshot2019" />
+
In '''Play Together''', Trainers feed, pet, and walk with their [[Buddy Pokémon]] rendered in real space. Shared AR syncs up to three buddies for group photos.
  
−
=== Buddy Adventure & Shared AR ===
+
===Reality Blending===
−
* Up to three Trainers can synchronize their buddies for group photos and mini-games.<ref name="Buddy2019" />
+
Supported devices use depth APIs to let Pokémon move '''behind''' furniture or trees, improving realism through occlusion.
  
−
=== Reality Blending ===
+
===AR Mapping tasks===
−
* Depth-based occlusion lets Pokémon move behind furniture, trees, or other objects on supported devices.<ref name="RealityBlending2020" />
+
Field Research labelled '''AR Mapping''' asks Trainers to record short, anonymised videos of PokéStops. these scans refine Niantic’s 3-D maps and unlock in-game bonuses such as powered-up PokéStops.
  
−
=== AR Mapping tasks ===
+
===Pokémon Playgrounds===
−
* Spinning a PokéStop with an “AR Mapping” tag grants a Field Research task that asks the player to record a 20-second scan; rewards include items and help expand VPS coverage.<ref name="ARMappingHelp" />
+
An experimental feature that lets Trainers anchor Pokémon persistently at real-world landmarks for others to discover and photograph, enabled by Niantic’s [[Visual Positioning System]].
  
−
=== Pokémon Playgrounds ===
+
==Technology stack==
−
* Trainers can leave Pokémon anchored at real-world landmarks for others to discover later, creating persistent shared scenes.<ref name="Playgrounds2024" />
 
−
 
 
−
== Technology stack ==
 
 
{| class="wikitable"
 
{| class="wikitable"
 
! Layer !! Implementation
 
! Layer !! Implementation
 
|-
 
|-
−
| Device frameworks || [[ARKit]] (iOS 11+) and [[ARCore]] (Android 7+) supply plane finding, light estimation, and motion tracking.<ref name="ARPlusAndroid2018" />
+
| Device frameworks || [https://vrarwiki.com/wiki/ARKit ARKit] plane-finding on iOS 11+ devices and [https://vrarwiki.com/wiki/ARCore ARCore] Plane APIs on Android 7+ phones
 
|-
 
|-
−
| Lightship ARDK || Niantic’s cross-platform SDK adds depth, meshing, and semantic segmentation.<ref name="RealityBlending2020" />
+
| Niantic Lightship ARDK || Cross-platform SDK adding meshing, depth, semantic segmentation, and multiplayer.
 
|-
 
|-
−
| Visual Positioning System || Cloud anchors provide centimeter-level geopose accuracy for Playgrounds and future features.<ref name="Playgrounds2024" />
+
| Visual Positioning System || Cloud-hosted anchors power Playgrounds and future persistent content.
 +
|-
 +
| Networking || Peer-to-peer sessions synchronise transforms for Shared AR.
 
|-
 
|-
−
| Networking || Peer-to-peer sessions synchronize transforms for Shared AR.<ref name="Buddy2019" />
 
 
|}
 
|}
  
−
== Gameplay impact ==
+
==Gameplay impact==
−
* '''Immersion & social play:''' Shared sessions and persistent anchors let Trainers co-create scenes and stories.<ref name="Playgrounds2024" />
+
*'''Immersion and creativity''' – AR photography (#GOsnapshot), Reality Blending, and Playgrounds deepen the illusion that Pokémon coexist with the physical world.
−
* '''Rewards & progression:''' AR+ yields bonus XP/Stardust; Mapping tasks give items and help unlock powered-up PokéStops.<ref name="ARPlus2017" /><ref name="ARMappingHelp" />
+
*'''Physical activity''' – AR incentives encourage exploration. studies report increased daily step counts among active players.
−
* '''Community creativity:''' Niantic hosts regular #GOsnapshot contests to showcase AR photography.<ref name="Snapshot2019" />
+
*'''Social connection''' – Shared AR sessions and Playgrounds create collaborative in-person moments.
−
 
 
−
== Device support and limitations ==
 
−
AR functions require gyroscope-equipped phones that pass ARCore/ARKit certification; older or budget devices can disable AR to save battery.<ref name="CatchingARHelp" /> Advanced options like Reality Blending or Playgrounds have limited device and level roll-outs.<ref name="RealityBlending2020" /><ref name="Playgrounds2024" />
 
  
−
== Privacy and data considerations ==
+
==Challenges and limitations==
−
PokéStop Scans are anonymized—faces and license plates are blurred—yet watchdog groups note that large-scale geospatial data could be misused if mishandled.<ref name="RealityBlending2020" /><ref name="LGM2024" />
+
*'''Battery and processing load''' – Continuous camera, sensor fusion, and real-time rendering drain power, especially on older devices. 
 +
*'''Environmental constraints''' – Very dim or over-bright settings reduce surface-tracking accuracy. textured, well-lit areas work best.
 +
*'''Accessibility''' – Advanced features require ARKit-/ARCore-certified phones. players on legacy hardware can disable AR to maintain performance.
  
−
== Future outlook ==
+
==Influence on AR industry==
−
Niantic’s Large Geospatial Model (LGM) aims to fuse geometry, semantics, and cultural context, paving the way for headset-based AR and richer narrative events.<ref name="LGM2024" />
+
Pokémon GO’s mainstream success validated mobile AR design, inspiring titles such as '''Harry Potter: Wizards Unite''' and '''Jurassic World Alive''' and driving developer interest in Unity’s [[AR Foundation]]. The game has been credited with popularising [https://vrarwiki.com/wiki/Inside-out_tracking inside-out, marker-less tracking] for consumer devices.
  
−
== External links ==
+
==Future outlook==
−
* [https://vrarwiki.com/wiki/Augmented_Reality_Devices VR & AR Wiki – Augmented Reality Devices]
+
Niantic has signalled plans for richer occlusion, weather-aware behaviours, and eventual headset support, leveraging its Large Geospatial Model and continued Lightship ARDK updates.
−
* [https://vrarwiki.com/wiki/Inside-out_tracking VR & AR Wiki – Inside-out Tracking]
 
  
−
== References ==
+
==External links==
−
<references>
+
* [https://vrarwiki.com/ VR & AR Wiki]
−
<ref name="ARPlus2017">''AR+ is now available in Pokémon GO!'', Pokémon GO Live (December 20 2017). :contentReference[oaicite:0]{index=0}</ref>
+
* [https://vrarwiki.com/wiki/Augmented_Reality_Devices Augmented Reality Devices]
−
<ref name="ARPlusAndroid2018">Abner Li, “Pokémon GO AR+ comes to ARCore Android devices,” 9to5Google (October 11 2018). :contentReference[oaicite:1]{index=1}</ref>
 
−
<ref name="Snapshot2019">''Snap off the lens cap on your inner photographer!'', Pokémon GO Live (February 11 2019). :contentReference[oaicite:2]{index=2}</ref>
 
−
<ref name="Buddy2019">''Buddy Adventure coming soon—Even more ways to explore, grow, and bond with your buddy!'', Pokémon GO Live (December 17 2019). :contentReference[oaicite:3]{index=3}</ref>
 
−
<ref name="RealityBlending2020">Kjell Bronder, “Reality Blending and PokéStop Scanning Come to Pokémon GO,” Niantic Labs Blog (May 26 2020). :contentReference[oaicite:4]{index=4}</ref>
 
−
<ref name="ARMappingHelp">“What are AR Mapping tasks?” Pokémon GO Help Center (accessed April 27 2025). :contentReference[oaicite:5]{index=5}</ref>
 
−
<ref name="CatchingARHelp">“Catching Pokémon in AR mode,” Pokémon GO Help Center (accessed April 27 2025). :contentReference[oaicite:6]{index=6}</ref>
 
−
<ref name="Playgrounds2024">“Engineering Pokémon Playgrounds,” Niantic Labs Blog (November 13 2024). :contentReference[oaicite:7]{index=7}</ref>
 
−
<ref name="LGM2024">Eric Brachmann & Victor Prisacariu, “Building a Large Geospatial Model to Achieve Spatial Intelligence,” Niantic Labs Blog (November 12 2024). :contentReference[oaicite:8]{index=8}</ref>
 
−
<ref name="VRARwiki">“Augmented Reality Devices,” VR & AR Wiki (accessed April 27 2025). :contentReference[oaicite:9]{index=9}</ref>
 
−
</references>
 

Latest revision as of 06:23, 27 April 2025

Pokemon go AR1.png

Augmented Reality (AR) is a technology that overlays computer-generated images, sounds, and contextual data onto the real world, creating an interactive composite view. Unlike Virtual Reality, which replaces the user’s surroundings entirely, AR supplements reality, letting digital Pokémon appear on streets, in parks, or even on a player’s desk. Since its launch in July 2016, Pokémon GO has continuously expanded its AR tool-set, evolving from a simple camera overlay into sophisticated, persistent, and shared experiences that leverage surface detection, spatial mapping, and cloud anchoring.

For a broader introduction to AR concepts, see the AR Wiki.

Historical development

Year Milestone Key details
2016 Launch overlay Basic camera passthrough. optional toggle for battery savings.
2017 AR+ (iOS) Surface detection, proximity ‘‘stealth’’ meter, and Expert Handler bonus on ARKit devices.
2018 AR+ on Android Requires ARCore-compatible phones running Android 7.0+.
2019 GO Snapshot Stand-alone photo mode for any stored Pokémon. supports social sharing and Smeargle photobombs.
2019 Buddy Adventure Let Trainers interact with and photograph buddies together in Shared AR.
2020 Reality Blending & AR Mapping Depth-based occlusion and crowd-sourced PokéStop Scan tasks.
2024 Pokémon Playgrounds VPS-anchored, persistent AR that other players can see.

Core AR features

AR Catching & AR+

  • Standard AR mode places the wild Pokémon in the centre of the camera feed and tracks the device’s gyroscope and accelerometer for orientation.
  • AR+ mode (2017 iOS / 2018 Android) anchors Pokémon to detected planes, renders them at canonical scale, and introduces an awareness meter, an approach too quickly and the target may flee.

GO Snapshot

Players can choose any caught Pokémon, place it on a detected surface, reposition it, and capture photos. Smeargle and special-event photobombs may appear after a snapshot session.

Buddy Adventure & Shared AR

In Play Together, Trainers feed, pet, and walk with their Buddy Pokémon rendered in real space. Shared AR syncs up to three buddies for group photos.

Reality Blending

Supported devices use depth APIs to let Pokémon move behind furniture or trees, improving realism through occlusion.

AR Mapping tasks

Field Research labelled AR Mapping asks Trainers to record short, anonymised videos of PokéStops. these scans refine Niantic’s 3-D maps and unlock in-game bonuses such as powered-up PokéStops.

Pokémon Playgrounds

An experimental feature that lets Trainers anchor Pokémon persistently at real-world landmarks for others to discover and photograph, enabled by Niantic’s Visual Positioning System.

Technology stack

Layer Implementation
Device frameworks ARKit plane-finding on iOS 11+ devices and ARCore Plane APIs on Android 7+ phones
Niantic Lightship ARDK Cross-platform SDK adding meshing, depth, semantic segmentation, and multiplayer.
Visual Positioning System Cloud-hosted anchors power Playgrounds and future persistent content.
Networking Peer-to-peer sessions synchronise transforms for Shared AR.

Gameplay impact

  • Immersion and creativity – AR photography (#GOsnapshot), Reality Blending, and Playgrounds deepen the illusion that Pokémon coexist with the physical world.
  • Physical activity – AR incentives encourage exploration. studies report increased daily step counts among active players.
  • Social connection – Shared AR sessions and Playgrounds create collaborative in-person moments.

Challenges and limitations

  • Battery and processing load – Continuous camera, sensor fusion, and real-time rendering drain power, especially on older devices.
  • Environmental constraints – Very dim or over-bright settings reduce surface-tracking accuracy. textured, well-lit areas work best.
  • Accessibility – Advanced features require ARKit-/ARCore-certified phones. players on legacy hardware can disable AR to maintain performance.

Influence on AR industry

Pokémon GO’s mainstream success validated mobile AR design, inspiring titles such as Harry Potter: Wizards Unite and Jurassic World Alive and driving developer interest in Unity’s AR Foundation. The game has been credited with popularising inside-out, marker-less tracking for consumer devices.

Future outlook

Niantic has signalled plans for richer occlusion, weather-aware behaviours, and eventual headset support, leveraging its Large Geospatial Model and continued Lightship ARDK updates.

External links

Retrieved from "https://pkmngotrading.com/mediawiki/index.php?title=Augmented_Reality&oldid=156790"