Revealing the secret of Maowan Hei Technology: taking photos with the goddess at home, chasing stars with your mouth, and robots as hosting

　　Before the Tmall Double Eleven Gala (referred to as "Mao Wan"), Tmall released news that this year, they will hold a "gala to show the muscles of China's Internet technology to the world."

　　After all, what kind of "technical muscles" will Alibaba show off this year's Cat Night?

　　"We are using technology from ten or twenty years later to do this party, which may be a disruption to the traditional entertainment industry," said Tracy, general manager of the party technology.

　　AR+VR, helps you take photos with the goddess at home

　　"This year, if celebrities stay on the TV as always, it would be too uninnovative." "Can the stars on the TV go off the stage, or even enter the home of every audience, and achieve zero-distance interaction with the audience?" After the party planning team opened up, Trish and the technical team were busy, but "sending the stars to the home of the audience" did not stump them.

　　崔西透露，“我们首次把真人三维建模和动作捕捉技术运用到了国内的手机平台，把明星的动作甚至表情细节都进行了逼真的还原。同时，将AR技术与VR全景技术结合，实现了将明星通过AR技术投射到真实场景，达到和观众面对面、多角度、零距离接触的效果。”

　　Trish said that at the party, when the host prompted "celebrities come to your home", the audience just needs to turn on Taobao on the mobile phone, click the button, and find any plane of the home through the mobile phone camera, and can connect life-sized stars to the home, and interact with them, such as taking photos and competing for a heart.

　　In addition to "sending stars to the audience's home", Trish and his team also "bring the audience to the celebrities' home."

　　They developed the "Arbitrary Door". When the "Arbitrary Door" appears at home, the audience can first see Da Zhangwei or Zheng Kai inside the door, and then follow Da Zhangwei or Zheng Kai to walk into his home and visit.

　　Da Zhangwei went to the audience's home through any door. Da Zhangwei went to the audience's home through any door.

　　But who will be the star who will be sent to the audience's house tonight? Tracy chose to keep it mysterious, "It is the goddess Fan Bingbing and Jingshan Lu in the hearts of many people...it is very worth looking forward to!"

　　You can chase stars on the evening party with your mouth

　　In addition to seeing celebrities and interacting with celebrities across screens, how else can Maowan play?

　　In order to allow the audience to participate in the experience better, the Tmall Gala technical team opened a "virtual audience seat" at the Gala, hoping to give the audience an experience like "as if they are at the Gala scene".

　　Virtual Auditorium Schematic Diagram Virtual Auditorium Schematic Diagram

　　"Viewers can watch the live broadcast of the party at any time by turning on Taobao on their mobile phones, and can also enjoy the exclusive opening ceremony viewing perspective and real entrance ceremony realized by CG animation + AR virtual technology." said the technical director of the Tmall Gala.

　　The technical team arranged 6 camera seats at the party.

　　In addition to watching programs on the stage, the audience can also go to the places directly in front of the stage, star dressing room, star aisle and other places to "capture idols". In addition to switching through manual clicks, the audience can also actively switch to the camera position they want to watch through voice interaction with aligenie. "For example, your idol Wu Yifan appears in a distance, and you can just say, 'I want to see Wu Yifan', and it will automatically switch to the camera position with the best angle from the closest angle." Trisey said.

　　Aligenie is the first generation of Chinese human-computer communication system independently developed by Alibaba, living in the cloud. But at this Double Eleven Gala, in addition to being embedded in the live broadcast platform system, it appears in a virtual form; it will also "turn into shape" and appear in front of everyone as a physical image.

　　Tmall Elf Robot guest host

　　Alibaba Artificial Intelligence Laboratory has specially created a "Tmall Elf Robot" for Double Eleven.

　　Tmall Elf Robot

　　The brain of Tmall Elf robot is aligenie, and the limbs are made by a professional robot manufacturing company. It is reported that this time, it will play the role of an assistant host at the Double Eleven Gala, not only listening and speaking, but also watching and moving.

　　"The Tmall Elf Robot is about 1 meter tall. It can not only distinguish the other person's gender and whether the other person is its owner by identifying the user's voiceprints, but also identify the other person's identity through its "big eyes" - the camera on the cat's head." Tmall Elf Product Manager Zi Ying told "Tianxia Online Business".

　　"It can also expect the other party's behavior and password based on the other party's posture and tone, and provide feedback, such as heart-heartedness, dizzy expressions, etc.," said Ziying.

　　In addition, the limbs of Tmall Elf robots are also equipped with different numbers of servos, which can meet basic joint drives and can have basic limb interactions with people.

　　It is reported that Tmall Ghost Smart Speaker will also appear at the Cat Night Live, and it will also send itself out. This sounds like a rather "strange" thing. What is the truth of the matter? Maybe we have to look for the answer from the cat night at 7:40 tonight.

　　Aligenie, who is in the Taobao live broadcast system on mobile phones, also has the function of "shopping assistant".

　　"For example, if you say 'recommend the cheapest down jacket to me,' it will recommend you the most suitable down jacket for you through the algorithm," Trish said.

　　In Trish's view, this subverts a shopping link that was previously selected through graphic searches, and directly recommends single items by intelligent robots. All interactions appear in a graphical and dialogue-like manner, the entire interaction will be more natural and the interactive experience will become better.

　　Interactive director with well-known regional span in history

　　"Our party is positioned to show the world the technical capabilities of our Chinese Internet companies. This year, we must not only solve the problem of how the party is more fun, but also solve the challenge of full-time real-time interactive directors with a well-known regional span in history." Trish said.

　　In order to "show the world the technical muscles of China's Internet", this year's Maowan will not only broadcast on Beijing TV, Zhejiang TV, and Shenzhen TV, live broadcast on mobile Taobao and Youku, but also live broadcast on the world's well-known video website YouTube.

　　"We do live broadcasts on the whole platform, and the live broadcast signals will be launched from three stations and several live broadcast channels, and the delays of each platform will vary. Therefore, it may be delayed by one second in City A and City B delayed by ten seconds. And our Internet director sends an interactive command according to the program process to tell all mobile phone Taobao users that can engage in a certain interactive link, perhaps users in City A and City B may not have seen this interactive link on TV, and the corresponding interactive content has already appeared on the mobile phone." Trixi said.

　　In order to avoid this problem, Trish and his team spent half a year to innovate remote synchronization coding technology to ensure that interaction on mobile phones can be kept synchronized with content on TV.

　　Trish said that when users watch the party, they just shake Taobao on their mobile phone and will automatically monitor whether there is a synchronization code in the TV signal. Once the synchronization code corresponding to a specific interactive link is recognized, Taobao on their mobile phone will automatically open the corresponding interactive content. To be simple, if the content of City A program is delayed by 1 second, the interaction on the mobile phone of City A users will also delay by 1 second and then appear again.

　　"In order to protect user rights, interactive links such as 'One Red Envelope Rain' are adopted," Trisey added.

Thank you for your attention and support to Laogao E-commerce Club . Please indicate the source of the reprinting website www.shxuanming.net

 Click to register to apply to join the well-known e-commerce network - Laogao E-commerce Club. Any merchants from all over the country, Tmall merchants, Taobao Crown Store, Jinguan Store, and other e-commerce platform merchants can apply to join!