Difference between revisions of "Augmented Reality"

From Pokemon Go Wiki
Jump to: navigation, search
(Created page with "= Augmented Reality = ''Augmented reality'' (AR) in '''Pokémon GO''' allows digital Pokémon, items, and UI elements to be rendered over the live camera feed, appearing as i...")
 
Line 1: Line 1:
−
= Augmented Reality =
+
[[Augmented Reality]] (AR) is a technology that overlays computer-generated images, sounds, and contextual data onto the real world, creating an interactive composite view. Unlike [[Virtual Reality]], which replaces the user’s surroundings entirely, AR supplements reality—letting digital [[Pokémon]] appear on streets, in parks, or even on a player’s desk. Since its launch in July 2016, Pokémon GO has continuously expanded its AR tool-set, evolving from a simple camera overlay into sophisticated, persistent, and shared experiences that leverage surface detection, spatial mapping, and cloud anchoring.<!-- :contentReference[oaicite:0]{index=0} -->
  
−
''Augmented reality'' (AR) in '''Pokémon GO''' allows digital Pokémon, items, and UI elements to be rendered over the live camera feed, appearing as if they occupy physical space around the Trainer. Since the game’s launch in July 2016, developer '''[[Niantic]]''' has expanded AR from a simple overlay to advanced experiences such as [[AR+]], [[GO Snapshot]], [[Buddy Adventure]], Reality Blending, AR Mapping, and [[Pokémon Playgrounds]]. These features rely on Apple’s [[ARKit]], Google’s [[ARCore]], and Niantic’s own [[Lightship]] ARDK and [[Visual Positioning System]] (VPS).<ref name="ARPlus2017" /><ref name="ARPlusAndroid2018" /><ref name="RealityBlending2020" />
+
For a broader introduction to AR concepts, see the [https://vrarwiki.com/ VR & AR Wiki].
−
 
 
−
== Definition and context ==
 
−
AR in '''Pokémon GO''' uses '''marker-less, inside-out tracking''' to lock 3-D Pokémon models to real-world planes detected by the device camera, enabling players to walk around, view them from different angles, and take photographs. The concept aligns with the [[inside-out tracking]] article on the external [VR & AR Wiki](https://vrarwiki.com/wiki/Inside-out_tracking).<ref name="VRARwiki" />
 
  
 
== Historical development ==
 
== Historical development ==
Line 10: Line 7:
 
! Year !! Milestone !! Key details !! Sources
 
! Year !! Milestone !! Key details !! Sources
 
|-
 
|-
−
| 2016 || Launch overlay || Basic camera passthrough; could be toggled off for battery savings. || <ref name="CatchingARHelp" />
+
| 2016 || Launch overlay || Basic camera passthrough; optional toggle for battery savings. || <ref name="Launch2016">{{cite web|title=Pokémon GO Support—Catching Pokémon in AR mode|url=https://niantic.helpshift.com/|access-date=2025-04-27}}</ref>
 
|-
 
|-
−
| 2017 || [[AR+]] (iOS) || Uses ARKit for surface detection, proximity ‘‘stealth’’ meter and ''Expert Handler'' bonus. || <ref name="ARPlus2017" />
+
| 2017 || [[AR+]] (iOS) || Surface detection, proximity ‘‘stealth’’ meter, and ''Expert Handler'' bonus on ARKit devices. || <ref name="ARPlus2017">{{cite web|title=AR+ is now available in Pokémon GO!|url=https://pokemongolive.com/post/arplus/|date=2017-12-20}}</ref><!-- :contentReference[oaicite:1]{index=1} -->
 
|-
 
|-
−
| 2018 || AR+ on Android || Requires ARCore-compatible devices running Android 7.0+. || <ref name="ARPlusAndroid2018" />
+
| 2018 || AR+ on Android || Requires ARCore-compatible phones running Android 7.0+. || <ref name="ARPlusAndroid2018">{{cite news|title=Pokémon GO AR+ comes to ARCore Android devices|url=https://9to5google.com/2018/10/11/pokemon-go-ar-plus-android/|date=2018-10-11}}</ref>
 
|-
 
|-
−
| 2019 || [[GO Snapshot]] || Stand-alone photo mode for any stored Pokémon; supports social sharing and Smeargle photobombs. || <ref name="Snapshot2019" />
+
| 2019 || [[GO Snapshot]] || Stand-alone photo mode for any stored Pokémon; supports social sharing and Smeargle photobombs. || <ref name="Snapshot2019">{{cite web|title=Snap off the lens cap on your inner photographer!|url=https://pokemongolive.com/post/go-snapshot-announce/|date=2019-02-11}}</ref><!-- :contentReference[oaicite:2]{index=2} -->
 
|-
 
|-
−
| 2019 || [[Buddy Adventure]] || Lets Trainers interact with and photograph their buddies together in Shared AR. || <ref name="Buddy2019" />
+
| 2019 || [[Buddy Adventure]] || Let Trainers interact with and photograph buddies together in Shared AR. || <ref name="Buddy2019">{{cite web|title=Buddy Adventure coming soon—even more ways to explore, grow, and bond with your buddy!|url=https://pokemongolive.com/post/buddyadventurelaunch/|date=2019-12-17}}</ref><!-- :contentReference[oaicite:3]{index=3} -->
 
|-
 
|-
−
| 2020 || Reality Blending & AR Mapping || Depth-based occlusion and crowd-sourced PokéStop Scans. || <ref name="RealityBlending2020" /><ref name="ARMappingHelp" />
+
| 2020 || Reality Blending & AR Mapping || Depth-based occlusion and crowd-sourced PokéStop Scan tasks. || <ref name="RealityBlending2020">{{cite web|title=Reality Blending and PokéStop Scanning Come to Pokémon GO|url=https://nianticlabs.com/news/realityblending-announcement/|date=2020-05-26}}</ref><!-- :contentReference[oaicite:4]{index=4} -->
 
|-
 
|-
−
| 2024 || [[Pokémon Playgrounds]] || VPS-anchored, persistent AR that other players can see. || <ref name="Playgrounds2024" />
+
| 2024 || [[Pokémon Playgrounds]] || VPS-anchored, persistent AR that other players can see. || <ref name="Playgrounds2024">{{cite web|title=Engineering Pokémon Playgrounds|url=https://nianticlabs.com/news/pokemon-playgrounds/|date=2024-11-13}}</ref><!-- :contentReference[oaicite:5]{index=5} -->
 
|}
 
|}
  
Line 28: Line 25:
  
 
=== AR Catching & AR+ ===
 
=== AR Catching & AR+ ===
−
* '''Surface detection''' creates tall grass; tapping reveals the Pokémon.<ref name="CatchingARHelp" />
+
* **Standard AR mode** places the wild Pokémon in the centre of the camera feed and tracks the device’s [[gyroscope]] and [[accelerometer]] for orientation.
−
* '''Stealth meter''' rewards slow, careful motion with an ''Expert Handler'' XP/Stardust bonus.<ref name="ARPlus2017" />
+
* **AR+ mode** (2017 iOS / 2018 Android) anchors Pokémon to detected planes, renders them at canonical scale, and introduces an *awareness meter*—approach too quickly and the target may flee.<ref name="ARPlus2017"/><!-- :contentReference[oaicite:6]{index=6} -->
  
−
=== GO Snapshot ===
+
=== [[GO Snapshot]] ===
−
* Players can place any Pokémon, change angles, and tap to direct its gaze.<ref name="Snapshot2019" />
+
Players can choose any caught Pokémon, place it on a detected surface, reposition it, and capture photos. Smeargle and special-event photobombs may appear after a snapshot session.<ref name="Snapshot2019"/><!-- :contentReference[oaicite:7]{index=7} -->
  
−
=== Buddy Adventure & Shared AR ===
+
=== [[Buddy Adventure]] & Shared AR ===
−
* Up to three Trainers can synchronize their buddies for group photos and mini-games.<ref name="Buddy2019" />
+
In **Play Together**, Trainers feed, pet, and walk with their [[Buddy Pokémon]] rendered in real space; Shared AR syncs up to three buddies for group photos.<ref name="Buddy2019"/><!-- :contentReference[oaicite:8]{index=8} -->
  
 
=== Reality Blending ===
 
=== Reality Blending ===
−
* Depth-based occlusion lets Pokémon move behind furniture, trees, or other objects on supported devices.<ref name="RealityBlending2020" />
+
Supported devices use depth APIs to let Pokémon move *behind* furniture or trees, improving realism through occlusion.<ref name="RealityBlending2020"/><!-- :contentReference[oaicite:9]{index=9} -->
  
 
=== AR Mapping tasks ===
 
=== AR Mapping tasks ===
−
* Spinning a PokéStop with an “AR Mapping” tag grants a Field Research task that asks the player to record a 20-second scan; rewards include items and help expand VPS coverage.<ref name="ARMappingHelp" />
+
Field Research labelled **AR Mapping** asks Trainers to record short, anonymised videos of PokéStops; these scans refine Niantic’s 3-D maps and unlock in-game bonuses such as powered-up PokéStops.<ref name="RealityBlending2020"/><!-- :contentReference[oaicite:10]{index=10} -->
  
 
=== Pokémon Playgrounds ===
 
=== Pokémon Playgrounds ===
−
* Trainers can leave Pokémon anchored at real-world landmarks for others to discover later, creating persistent shared scenes.<ref name="Playgrounds2024" />
+
An experimental feature that lets Trainers anchor Pokémon persistently at real-world landmarks for others to discover and photograph, enabled by Niantic’s [[Visual Positioning System]].<ref name="Playgrounds2024"/><!-- :contentReference[oaicite:11]{index=11} -->
  
 
== Technology stack ==
 
== Technology stack ==
 
{| class="wikitable"
 
{| class="wikitable"
−
! Layer !! Implementation
+
! Layer !! Implementation !! Sources
−
|-
 
−
| Device frameworks || [[ARKit]] (iOS 11+) and [[ARCore]] (Android 7+) supply plane finding, light estimation, and motion tracking.<ref name="ARPlusAndroid2018" />
 
−
|-
 
−
| Lightship ARDK || Niantic’s cross-platform SDK adds depth, meshing, and semantic segmentation.<ref name="RealityBlending2020" />
 
−
|-
 
−
| Visual Positioning System || Cloud anchors provide centimeter-level geopose accuracy for Playgrounds and future features.<ref name="Playgrounds2024" />
 
 
|-
 
|-
−
| Networking || Peer-to-peer sessions synchronize transforms for Shared AR.<ref name="Buddy2019" />
+
| Device frameworks || [[ARKit]] planeFinding on iOS 11+ devices<ref name="ARKitDoc">{{cite web|title=Tracking and visualizing planes – Apple ARKit documentation|url=https://developer.apple.com/documentation/arkit/tracking-and-visualizing-planes}}</ref><!-- :contentReference[oaicite:12]{index=12} --> and [[ARCore]] Plane APIs on Android 7+ phones<ref name="ARCoreDoc">{{cite web|title=Plane – ARCore reference|url=https://developers.google.com/ar/reference/java/com/google/ar/core/Plane}}</ref><!-- :contentReference[oaicite:13]{index=13} --> |
 +
| Niantic Lightship ARDK || Cross-platform SDK adding meshing, depth, semantic segmentation, and multiplayer.<ref name="Lightship">{{cite web|title=Niantic Lightship ARDK Release Notes v3.11|url=https://lightship.dev/docs/ardk/release_notes/release3.11/}}</ref><!-- :contentReference[oaicite:14]{index=14} --> |
 +
| Visual Positioning System || Cloud-hosted anchors with centimetre accuracy power Playgrounds and future persistent content.<ref name="Playgrounds2024"/> |
 +
| Networking || Peer-to-peer sessions synchronise transforms for Shared AR.<ref name="Buddy2019"/> |
 
|}
 
|}
  
 
== Gameplay impact ==
 
== Gameplay impact ==
−
* '''Immersion & social play:''' Shared sessions and persistent anchors let Trainers co-create scenes and stories.<ref name="Playgrounds2024" />
+
* **Immersion and creativity** – AR photography (#GOsnapshot), Reality Blending, and Playgrounds deepen the illusion that Pokémon coexist with the physical world.
−
* '''Rewards & progression:''' AR+ yields bonus XP/Stardust; Mapping tasks give items and help unlock powered-up PokéStops.<ref name="ARPlus2017" /><ref name="ARMappingHelp" />
+
* **Physical activity** – AR incentives encourage exploration; studies report increased daily step counts among active players.
−
* '''Community creativity:''' Niantic hosts regular #GOsnapshot contests to showcase AR photography.<ref name="Snapshot2019" />
+
* **Social connection** – Shared AR sessions and Playgrounds create collaborative in-person moments.
  
−
== Device support and limitations ==
+
== Challenges and limitations ==
−
AR functions require gyroscope-equipped phones that pass ARCore/ARKit certification; older or budget devices can disable AR to save battery.<ref name="CatchingARHelp" /> Advanced options like Reality Blending or Playgrounds have limited device and level roll-outs.<ref name="RealityBlending2020" /><ref name="Playgrounds2024" />
+
* **Battery and processing load** – Continuous camera, sensor fusion, and real-time rendering drain power, especially on older devices.
 +
* **Environmental constraints** – Very dim or over-bright settings reduce surface-tracking accuracy; textured, well-lit areas work best.<ref name="ARCoreDoc"/>
 +
* **Accessibility** – Advanced features require ARKit-/ARCore-certified phones; players on legacy hardware can disable AR to maintain performance.
  
−
== Privacy and data considerations ==
+
== Influence on AR industry ==
−
PokéStop Scans are anonymized—faces and license plates are blurred—yet watchdog groups note that large-scale geospatial data could be misused if mishandled.<ref name="RealityBlending2020" /><ref name="LGM2024" />
+
Pokémon GO’s mainstream success validated mobile AR design, inspiring titles such as *Harry Potter: Wizards Unite* and *Jurassic World Alive* and driving developer interest in Unity’s [[AR Foundation]]. The game has been credited with popularising inside-out, marker-less tracking for consumer devices.<ref name="InsideOut">{{cite web|title=Inside-out tracking – VR & AR Wiki|url=https://vrarwiki.com/wiki/Inside-out_tracking}}</ref><!-- :contentReference[oaicite:15]{index=15} -->
  
 
== Future outlook ==
 
== Future outlook ==
−
Niantic’s Large Geospatial Model (LGM) aims to fuse geometry, semantics, and cultural context, paving the way for headset-based AR and richer narrative events.<ref name="LGM2024" />
+
Niantic has signalled plans for richer occlusion, weather-aware behaviours, and eventual headset support, leveraging its Large Geospatial Model and continued Lightship ARDK updates.<ref name="Lightship"/>
  
 
== External links ==
 
== External links ==
Line 78: Line 74:
  
 
== References ==
 
== References ==
−
<references>
+
<references/>
−
<ref name="ARPlus2017">''AR+ is now available in Pokémon GO!'', Pokémon GO Live (December 20 2017). :contentReference[oaicite:0]{index=0}</ref>
 
−
<ref name="ARPlusAndroid2018">Abner Li, “Pokémon GO AR+ comes to ARCore Android devices,” 9to5Google (October 11 2018). :contentReference[oaicite:1]{index=1}</ref>
 
−
<ref name="Snapshot2019">''Snap off the lens cap on your inner photographer!'', Pokémon GO Live (February 11 2019). :contentReference[oaicite:2]{index=2}</ref>
 
−
<ref name="Buddy2019">''Buddy Adventure coming soon—Even more ways to explore, grow, and bond with your buddy!'', Pokémon GO Live (December 17 2019). :contentReference[oaicite:3]{index=3}</ref>
 
−
<ref name="RealityBlending2020">Kjell Bronder, “Reality Blending and PokéStop Scanning Come to Pokémon GO,” Niantic Labs Blog (May 26 2020). :contentReference[oaicite:4]{index=4}</ref>
 
−
<ref name="ARMappingHelp">“What are AR Mapping tasks?” Pokémon GO Help Center (accessed April 27 2025). :contentReference[oaicite:5]{index=5}</ref>
 
−
<ref name="CatchingARHelp">“Catching Pokémon in AR mode,” Pokémon GO Help Center (accessed April 27 2025). :contentReference[oaicite:6]{index=6}</ref>
 
−
<ref name="Playgrounds2024">“Engineering Pokémon Playgrounds,” Niantic Labs Blog (November 13 2024). :contentReference[oaicite:7]{index=7}</ref>
 
−
<ref name="LGM2024">Eric Brachmann & Victor Prisacariu, “Building a Large Geospatial Model to Achieve Spatial Intelligence,” Niantic Labs Blog (November 12 2024). :contentReference[oaicite:8]{index=8}</ref>
 
−
<ref name="VRARwiki">“Augmented Reality Devices,” VR & AR Wiki (accessed April 27 2025). :contentReference[oaicite:9]{index=9}</ref>
 
−
</references>
 

Revision as of 05:39, 27 April 2025

Augmented Reality (AR) is a technology that overlays computer-generated images, sounds, and contextual data onto the real world, creating an interactive composite view. Unlike Virtual Reality, which replaces the user’s surroundings entirely, AR supplements reality—letting digital Pokémon appear on streets, in parks, or even on a player’s desk. Since its launch in July 2016, Pokémon GO has continuously expanded its AR tool-set, evolving from a simple camera overlay into sophisticated, persistent, and shared experiences that leverage surface detection, spatial mapping, and cloud anchoring.

For a broader introduction to AR concepts, see the VR & AR Wiki.

Historical development

Year Milestone Key details Sources
2016 Launch overlay Basic camera passthrough; optional toggle for battery savings. <ref name="Launch2016">Template:Cite web</ref>
2017 AR+ (iOS) Surface detection, proximity ‘‘stealth’’ meter, and Expert Handler bonus on ARKit devices. <ref name="ARPlus2017">Template:Cite web</ref>
2018 AR+ on Android Requires ARCore-compatible phones running Android 7.0+. <ref name="ARPlusAndroid2018">Template:Cite news</ref>
2019 GO Snapshot Stand-alone photo mode for any stored Pokémon; supports social sharing and Smeargle photobombs. <ref name="Snapshot2019">Template:Cite web</ref>
2019 Buddy Adventure Let Trainers interact with and photograph buddies together in Shared AR. <ref name="Buddy2019">Template:Cite web</ref>
2020 Reality Blending & AR Mapping Depth-based occlusion and crowd-sourced PokéStop Scan tasks. <ref name="RealityBlending2020">Template:Cite web</ref>
2024 Pokémon Playgrounds VPS-anchored, persistent AR that other players can see. <ref name="Playgrounds2024">Template:Cite web</ref>

Core AR features

AR Catching & AR+

  • **Standard AR mode** places the wild Pokémon in the centre of the camera feed and tracks the device’s gyroscope and accelerometer for orientation.
  • **AR+ mode** (2017 iOS / 2018 Android) anchors Pokémon to detected planes, renders them at canonical scale, and introduces an *awareness meter*—approach too quickly and the target may flee.<ref name="ARPlus2017"/>

GO Snapshot

Players can choose any caught Pokémon, place it on a detected surface, reposition it, and capture photos. Smeargle and special-event photobombs may appear after a snapshot session.<ref name="Snapshot2019"/>

Buddy Adventure & Shared AR

In **Play Together**, Trainers feed, pet, and walk with their Buddy Pokémon rendered in real space; Shared AR syncs up to three buddies for group photos.<ref name="Buddy2019"/>

Reality Blending

Supported devices use depth APIs to let Pokémon move *behind* furniture or trees, improving realism through occlusion.<ref name="RealityBlending2020"/>

AR Mapping tasks

Field Research labelled **AR Mapping** asks Trainers to record short, anonymised videos of PokéStops; these scans refine Niantic’s 3-D maps and unlock in-game bonuses such as powered-up PokéStops.<ref name="RealityBlending2020"/>

Pokémon Playgrounds

An experimental feature that lets Trainers anchor Pokémon persistently at real-world landmarks for others to discover and photograph, enabled by Niantic’s Visual Positioning System.<ref name="Playgrounds2024"/>

Technology stack

Layer Implementation Sources
Device frameworks ARKit planeFinding on iOS 11+ devices<ref name="ARKitDoc">Template:Cite web</ref> and ARCore Plane APIs on Android 7+ phones<ref name="ARCoreDoc">Template:Cite web</ref> | Niantic Lightship ARDK Cross-platform SDK adding meshing, depth, semantic segmentation, and multiplayer.<ref name="Lightship">Template:Cite web</ref> | Visual Positioning System Networking

Gameplay impact

  • **Immersion and creativity** – AR photography (#GOsnapshot), Reality Blending, and Playgrounds deepen the illusion that Pokémon coexist with the physical world.
  • **Physical activity** – AR incentives encourage exploration; studies report increased daily step counts among active players.
  • **Social connection** – Shared AR sessions and Playgrounds create collaborative in-person moments.

Challenges and limitations

  • **Battery and processing load** – Continuous camera, sensor fusion, and real-time rendering drain power, especially on older devices.
  • **Environmental constraints** – Very dim or over-bright settings reduce surface-tracking accuracy; textured, well-lit areas work best.<ref name="ARCoreDoc"/>
  • **Accessibility** – Advanced features require ARKit-/ARCore-certified phones; players on legacy hardware can disable AR to maintain performance.

Influence on AR industry

Pokémon GO’s mainstream success validated mobile AR design, inspiring titles such as *Harry Potter: Wizards Unite* and *Jurassic World Alive* and driving developer interest in Unity’s AR Foundation. The game has been credited with popularising inside-out, marker-less tracking for consumer devices.<ref name="InsideOut">Template:Cite web</ref>

Future outlook

Niantic has signalled plans for richer occlusion, weather-aware behaviours, and eventual headset support, leveraging its Large Geospatial Model and continued Lightship ARDK updates.<ref name="Lightship"/>

External links

References

<references/>

Retrieved from "https://pkmngotrading.com/mediawiki/index.php?title=Augmented_Reality&oldid=156766"