The XR Weekly Update (November 19, 2024): Meta Unveils Project Aria Research Kits, Surge in Chinese Smartglasses, and More!

Greetings from Finland! I’m penning this newsletter while traversing the beautiful landscapes from Helsinki to Lapland. As always, I’m enjoying my time here—I’ve had the chance to meet Santa Claus, pet some reindeer, and indulge in traditional Finnish cuisine. Next on my agenda is MatchXR, a significant XR event in Nordic Europe, and I can’t wait to share my experiences with you. Before we dive into this week’s news, I want to dedicate a moment to remember Daniel Dyboski-Bryant, who recently passed away. I was fortunate to meet Daniel several times, both in person at AWE US and in virtual spaces, particularly during events on ENGAGE. Daniel was incredibly kind and passionate about using VR to better humanity, especially in education. He will be dearly missed by all who knew him. Farewell, Daniel—you won’t be forgotten.

Top News of the Week

Meta Opens Applications for Project Aria Research Kits

A couple of years back, Meta introduced Project Aria—a unique pair of glasses designed as a precursor to future Augmented Reality spectacles. These glasses didn’t feature a display but were equipped with numerous sensors such as cameras and microphones. Initially, they were meant for use only by Meta employees or close partners to gather data for AI/ML training, mimicking AR glasses’ functionality.

This internal-use strategy took a turn this week. Meta has launched the Project Aria Research Kit. Research centers from universities or corporations interested in applying for a Project Aria devkit can do so on a dedicated webpage. Meta plans to assess each project and offer selected centers not only the glasses but an entire development package, including a companion app, SDK, and cloud services. These services offer much more than just storage; they can reconstruct environments from point cloud data or obscure faces and license plates in videos.

This initiative is a golden opportunity for pioneering AR glasses research. To inspire interested centers, Meta has published case studies showcasing successful projects from prominent universities like the University of Bristol, University of Iowa, and Carnegie Mellon. Projects focus on areas like accessibility, driving, and skill development. If you’re part of a research center, this could be a chance you’ll want to explore.

Other Relevant News

A New Wave of Smartglasses is Coming from China (and Beyond)

This week brought a flurry of activity in the smart glasses sector, sparked by the success of Ray-Ban Meta. In the past seven days, three Chinese AI-driven smart glasses have been announced.

Chinese magazine 36kr reports that Xiaomi is developing a device to compete with Ray-Ban Meta smartglasses. Xiaomi’s no stranger to smartglasses, having introduced various prototypes over the past years. This new device, reportedly developed with Goertek—a major XR manufacturer responsible for producing Quest headsets in China—is expected by Q2 2025, possibly debuting at April’s Mi Fan Festival.

Previously, I mentioned a potential release from Baidu, and indeed, they unveiled the Xiaodu AI Glasses. Weighing just 45 grams, these glasses boast a 16MP ultra-wide camera with AI stabilization, a four-microphone array for clear audio, and speakers designed for open-ear anti-leakage. Their battery promises up to 56 hours on standby and more than 5 hours of audio. Key features include real-time Q&A, calorie recognition, object ID, translation, and intelligent reminders. They are anticipated to launch in early 2025, priced under 2,100 yuan (about $290).

Additionally, Rokid, one of China’s leading AR manufacturers, announced the Rokid Glasses. Powered by a Snapdragon AR1, they weigh 49 grams and sport a 640×480 monochrome green display intended for 2D information with a 30-degree FOV and 1000-nit brightness. With a built-in camera for photos, videos, and visual search, the glasses are also integrated with Alipay for various functions, including payments and AI assistance. Notably, they are produced alongside BOLON, a Chinese fashion brand part of the EssilorLuxottica group, hinting at potential global collaborations.

Moreover, according to Reuters, Amazon is developing internal-use smart glasses codenamed "Amelia," based on the Echo Frames platform, featuring an integrated display. Targeted for Amazon drivers, these glasses aim to display delivery instructions to optimize efficiency. The embedded display for Echo Frames could possibly release by Q2 2026.

The smartglasses scene is abuzz with excitement…

(Thanks to DannieVR for the tip about Rokid glasses!)

Meta For Education Launched in Beta

Some months back, Meta teased the upcoming educational version of its Quest headsets aimed at university use. Last week, Meta For Education officially began its Beta phase.

Initially, Meta hinted that this program would enable educators, trainers, and administrators to access education-specific apps and features while managing multiple Quest devices simultaneously, eliminating the hassle of updating each individually in a classroom or training environment. Now, with a bit more polished marketing speak, the message remains consistent. My speculation is that the program offers an educational content store alongside a kind of MDM device manager for teachers.

Noteworthy universities like Arizona State University, Houston Community College, Imperial College London, Miami Dade College, Morehouse College, University of Miami, and University of Michigan are already using it, providing feedback to refine the program further. By building the product in collaboration with academic partners, Meta aims for a successful release this winter.

Additionally, Meta has partnered with VictoryXR to establish some of the first digital twin “metaversities” in Europe, allowing students and staff at the University of Leeds, University of the Basque Country, and University of Hannover to engage remotely in immersive environments replicating physical campuses.

This educational focus by Meta represents a savvy move for several reasons: firstly, education is a lucrative sector; secondly, it familiarizes students with VR, potentially increasing interest and adoption of XR.

Meta Teases Orion Operating System

Meta recently showcased a video offering a glimpse of its Orion glasses’ UI. With various UIs being presented, it seems Meta is still experimenting with the interface for these glasses, exploring different design possibilities. Since AR glasses are an entirely new paradigm, repurposing existing VR or MR interfaces isn’t an option, prompting ongoing experimentation.

Alex Coulombe, a developer who tested Orion at Meta Connect, confirmed that the UI shown in the video matched what he experienced with the glasses.

News Worth a Mention

bHaptics Revamps Its Lineup of Devices

Korean company bHaptics, renowned for its XR haptic vests, has unveiled a refreshed range of devices:

• TactSuit Pro: The new flagship haptic vest, available for $499.
• TactSuit Air: A more economical version with fewer haptic motors, priced at $249.
• TactSleeve: An updated version of their popular arm haptic device, at $199.

Preorders are available until November 26th. bHaptics devices are compatible with 270 VR titles across Quest, PSVR 2, and SteamVR, ensuring ample fun for users.

Horizon Worlds is Getting Its Currency

Horizon Worlds has begun rolling out its virtual currency, Meta Credits, in select regions. This development is crucial, paving the way for a self-sustaining economy within Horizon Worlds, where users can purchase digital assets from creators. The impact of monetization on this social platform will be interesting to observe.

Ekto VR Announces Its First Batch of Shoes

After years of R&D and presentations at XR events, Ekto VR is finally ready to ship its first batch of shoes for virtual reality, named Genesis. Limited to just 10 units for early adopters interested in shaping this new technology, prices range from $2000–$3000 with shipping expected in March 2025.

MeRCURY Diving Mask Now on IndieGoGo

Introducing MeRCURY, an XR headset engineered for underwater experiences. Aimed at transforming swimming pools into spaces for unique VR adventures, this device is now available on IndieGoGo. Priced from €1250, it seems primarily intended for B2B use.

Apple Releases Two New Immersive Videos

Apple’s latest content includes two immersive videos:

• A music video for The Weeknd’s song "Open Hearts."
• A new addition to the ‘Concert For One’ series featuring award-winning singer Raye.

Some Info About New Content

• Ember Souls: This VR hack-and-slash, drawing inspiration from Prince of Persia, launches on Quest on November 21st for $25 (with a 16% preorder discount).
• Gadgeteer updates on Quest 3 and Quest 3S, bringing mixed reality to its gameplay.
• Beat Saber unveils the highly anticipated DLC Monstercat Mixtape 2.
• Clone Drone in the Hyperdome: The sequel to the successful Clone Drone in the Danger Zone, launches for $20 (10% preorder discount).

Other notable releases include Gears & Goo, Spatial Ops, Little Cities: Diorama, Exercise Your Demons, Last Stand, Starship Troopers: Continuum, and Boxing Underdog.

Some Reviews About Content

• Triangle Strategy by Square Enix offers a familiar yet engaging experience in XR.
• DIG VR brings vibrant visuals and humor, slightly tempered by some laborious missions and interface quirks.
• EXOcars balances realism with entertainment, delivering an enjoyable VR racing experience.

Other News

• Sony discontinues the adapter for using original PSVR on PS5.
• Pico updates its operating system.
• Apple Final Cut Pro now supports editing Spatial Videos.
• A Wired article discusses the influx of children in Meta Horizon Worlds.
• Numerous Quixel megascans assets are freely available on FAB.
• The Vive Ultimate Tracker now works with third-party headsets.
• Niantic introduces its Spatial Platform, aiming to revolutionize physical world interactions.

News from Partners and Friends

The XR Design Challenge is calling for entries—a fantastic new XR hackathon organized by Immersive Insiders, Met, ShapesXR, and IDEO. The online event runs from December 2 to January 13, offering a $10,000 prize pool for the best XR design ideas. Participation is free, so give it a shot!

Story continues to empower users to craft spatial content on Vision Pro, offering a sophisticated platform for integrating diverse media forms.

Looking to promote your XR product? This blog is the perfect place to spotlight it to an enthusiastic AR/VR audience. Explore our advertisement offerings to achieve successful outreach.

Some XR Fun

This is the original PCVR Funny link

Donate for Good

Once again, I encourage you to extend support to those affected by the war rather than donating to my blog this week. Please consider helping the Red Cross address the ongoing humanitarian crisis in Ukraine. You’ll find the donation link below.

Many thanks to all my Patreon donors who support me:

[Patron List]

Here’s the link to donate:

Support The Red Cross in Ukraine

(Header image by Meta)

Disclaimer: This blog contains advertisements and affiliate links to support itself. I may earn a small commission on purchases made through these links. Check out my full disclosure here.

Share this with other innovators.

Related