In the end how is Meta going to build the metaverse? Zuckerberg touched on a bit of detail on Wednesday, saying that Meta is advancing AI research that uses speech to generate virtual worlds, and that Meta will also improve human interaction with voice assistants and enhance translation between languages.
Zuckerberg firmly believes that the metaverse will be the future of the mobile internet. “The key to unlocking these advantages is AI,” he said at the Meta online “Inside the Lab” conference.
According to Zuckerberg, Meta is developing a new generative AI model. The user describes the virtual world to the AI, and the AI will automatically generate it according to the description. Then Zuckerberg showed an AI concept called Builder Bot. Zuckerberg turned into a 3D virtual character without legs and appeared on the island. He gave instructions to let the AI create a beach, and then added clouds, trees, and picnic blankets. .
Zuckerberg said: “As technology advances, users can create subtle worlds, explore and share experiences with other people in the world, using only voice.”
not only,Meta is also developing new AI technology that will allow users to communicate with voice assistants in a more natural way, and in the future this technology could also be used in the Metaverse, allowing users to communicate with AI in the Metaverse. Zuckerberg emphasized that Project CAIRaoke is an end-to-end neural model based on an on-device assistant.
During the demonstration, Project CAIRaoke taught users how to cook, and reminded them when the steps went wrong. Meta has built this model into Portal devices and will integrate into AR/VR devices in the future.
Not only that, Meta is also developing universal language translators with the ultimate goal of providing instant translation between all languages.