Codec Avatars from Meta may debut earlier than expected, now with Messenger support

Recent data analysis revelations suggest that Meta's long-running research into Codec Avatars could soon be implemented in standalone VR goggles, with Messenger support. Could it be that Meta wants to compete with Apple?

Codec Avatars are one of the most promising technologies to emerge in the VR/AR space in the coming years, perhaps even decades. These avatars are highly realistic virtual representations of people, differentiating themselves from the more cartoonish avatars currently used by the Met. In fact, they have the potential to reach a level of hyper-realism that will effectively overcome the so-called 'uncanny valley' (in a nutshell, the feeling that sticks with us when we see a human face with which there is something wrong), a challenge that has plagued similar technologies in the pastMeta has been working on this technology since several years. Until recently, we have only seen prototype videos recorded under ideal conditions using expensive cameras. However, the situation may soon change, as Meta is currently testing Codec Avatars on standalone goggles, severely limited in computing power.Meta has been testing this technology on Quest goggles for some time. A year ago Andrew Bosworth, CTO Meta, mentioned in his AMA session on Instagram that Meta is making "progress" on Codec Avatars for standalone goggles, but are still "years" away from full implementation.Now VR enthusiast Luna discovered strings of code in v68 PTC Meta Quest, relating to Codec Avatars. These findings suggest that Meta is working on Codec Avatars support for video calls on Messenger.

When will Codec Avatars be available on Quest goggles?

According to leaks of the Met's plan published by the The Verge last year, Codec Avatars will be a key feature of the upcoming Meta Quest Pro 2 goggles, codenamed 'La Jolla'. The report also included details of Quest 3 and Quest 3s.Quest Pro 2 is expected to be released in 2027, according to recent leaks from a highly reliable source, which also discusses the planned release dates of the Quest 4 and Quest 4s.

Quest Pro 2, of course, will feature eye and face tracking, just like its predecessor. This tracking is crucial to the operation of Codec Avatars, so we won't see them on goggles like Quest 3... or will we? Meta has unveiled a version of Codec Avatars that no face or eye tracking required. Instead, facial movements are estimated based on the sound recorded by the goggles' microphone. While this method is not ideal for rich facial expressions, it can serve as a decent solution for Quest 3 and Quest 2 users.In 2021, Meta presented a an effective method of decoding Codec Avatars on Quest 2. This method was able to render one Codec Avatar at 72 FPS, three at 63 FPS and five at around 43 FPS. Given that Quest 3 is significantly more powerful than Quest 2, we can expect even better performance.While the prospect of having Codec Avatars on Quest goggles is exciting, it is important not to expect the same quality as avatars from, for example, the Lex Fridman's interview with Mark Zuckerberg. Avatars on standalone devices may more closely resemble those of the Codec Avatar Meta demo, which used a smartphone to quickly scan faces.