REDEFINING REALITY
MICROSOFT FLIGHT SIMULATOR
The popular Microsoft Flight Simulator video game series includes a “digital twin” of the planet, combin- ing maps and satellite imagery to render buildings and even trees with real-time weather and air traffic. This is a huge model that is impractical for the constrained bandwidth at the tactical edge, but this model and others like it can allow for hyper-realistic modeling and simulation of vehicles and weapons effects at higher, cloud-connected echelons, or on home station resources. Rendering new objects is facilitated by world-building packages such as NVIDIA’s Omniverse, which include materials, textures and movement as building blocks for construction and simulations. Even lower-resolution versions of these world-based models can be used for rehearsal-of-concept drills or mission walkthroughs, regardless of whether a unit is co-located.
a user logs into a new system. Moreover, some games are enabling a subset of users to play wearing virtual reality devices from a godlike top-down perspective, whereas other players embody avatars and view the world in first person from the ground. Gaming concepts like this seem to fit neatly into the employ- ment of this capability at various echelons, where different types of data and interaction are necessary.
From the tactical perspective, the Army must build systems that have a common look and feel, regardless of how the system is worn or interacted with. A Soldier should be able to utilize their head-mounted display, their handheld system and their desktop system with the same profile and easily switch between them utilizing the same persona.
HARDWARE Systems like the Android Tactical Assault Kit (ATAK), a hand- held tablet or phone housed in a rugged case, offer warfighters a digital perspective of their operating environment. ATAK can visualize maps, both 2D and 3D, as well as a host of graphic control measures to represent the position of friendly and enemy forces. While not as ubiquitous as the consumer smartphones in the civilian world, these devices represent one of the first attempts at converging the physical and digital domains into a piece of handheld kit.
However, the current hardware in augmented reality systems limits the quality of field of view of holographic content. Virtual- reality head-mounted displays provide high-quality visuals, but at the cost of occluding almost entirely the user’s view of the natural world. While the Army is beginning to assess virtual reality for use in less lethal environments such as command posts, ultimately the future of immersive hardware will fuse into a single head- mounted display that can dynamically adjust between rendering content on top of reality or replacing everything with synthetic content. Tis will be necessary to fully realize the metaverse across the battlefield environments of the future.
PICTURE THIS
The immersive hardware in use today almost completely obscures the user’s view of the real world; ultimately, displays will need to dynamically adjust between rendering content on top of reality or replacing everything with synthetic content. (Image by Mission Command Battle Laboratory)
CONCLUSION Despite the push toward the future, we must also acknowledge the limitations we still face with current technology—for exam- ple, access issues, latency and hot mics. Tese problems won’t be solved simply by upgrading to the metaverse and must be solved along with its development. Moving to a metaverse model for planning, preparing, executing and assessing operations would allow dispersed staffs to synchronize warfighting functions more effectively within a virtual node capable of collaboration that would rival existing physical command posts. Ad hoc meetings
100
Army AL&T Magazine
Spring 2022
Page 1 |
Page 2 |
Page 3 |
Page 4 |
Page 5 |
Page 6 |
Page 7 |
Page 8 |
Page 9 |
Page 10 |
Page 11 |
Page 12 |
Page 13 |
Page 14 |
Page 15 |
Page 16 |
Page 17 |
Page 18 |
Page 19 |
Page 20 |
Page 21 |
Page 22 |
Page 23 |
Page 24 |
Page 25 |
Page 26 |
Page 27 |
Page 28 |
Page 29 |
Page 30 |
Page 31 |
Page 32 |
Page 33 |
Page 34 |
Page 35 |
Page 36 |
Page 37 |
Page 38 |
Page 39 |
Page 40 |
Page 41 |
Page 42 |
Page 43 |
Page 44 |
Page 45 |
Page 46 |
Page 47 |
Page 48 |
Page 49 |
Page 50 |
Page 51 |
Page 52 |
Page 53 |
Page 54 |
Page 55 |
Page 56 |
Page 57 |
Page 58 |
Page 59 |
Page 60 |
Page 61 |
Page 62 |
Page 63 |
Page 64 |
Page 65 |
Page 66 |
Page 67 |
Page 68 |
Page 69 |
Page 70 |
Page 71 |
Page 72 |
Page 73 |
Page 74 |
Page 75 |
Page 76 |
Page 77 |
Page 78 |
Page 79 |
Page 80 |
Page 81 |
Page 82 |
Page 83 |
Page 84 |
Page 85 |
Page 86 |
Page 87 |
Page 88 |
Page 89 |
Page 90 |
Page 91 |
Page 92 |
Page 93 |
Page 94 |
Page 95 |
Page 96 |
Page 97 |
Page 98 |
Page 99 |
Page 100 |
Page 101 |
Page 102 |
Page 103 |
Page 104 |
Page 105 |
Page 106 |
Page 107 |
Page 108 |
Page 109 |
Page 110 |
Page 111 |
Page 112 |
Page 113 |
Page 114 |
Page 115 |
Page 116 |
Page 117 |
Page 118 |
Page 119 |
Page 120 |
Page 121 |
Page 122 |
Page 123 |
Page 124 |
Page 125 |
Page 126 |
Page 127 |
Page 128 |
Page 129 |
Page 130 |
Page 131 |
Page 132 |
Page 133 |
Page 134 |
Page 135 |
Page 136 |
Page 137 |
Page 138 |
Page 139 |
Page 140