Intelligent Avatar

Digital Tour guide that can be found around airports.

Project outline

Hackathon project. When OpenAI first released API keys for ChatGPT, the Ministry of Communication and Information Technology ran a hackathon under the theme of using the technology to serve a national use case. Hackathon page.

The idea was to build an avatar that would sit on a large advertisment screen (similar to these), that could be found as someone was waiting for thier laugadge at the airport. The avatar would be able to conversate with users fluently. Through a digital avatar interface.

The technology used:

  • Whisper AI: Transcribes what is spoken to the avatar into text.
  • GPT-3.5: Initiated and fine-tuned to behave as a tour guide, specifically focused on Saudi Arabia.
  • Google Text-to-Speech: To speak out the responses on ChatGPT.
  • UI*: Not integrated, but will need to rig a character and render to match responses.

As proof of concept, the avatars presented in the project pitch is a product of movio.la studio. However, the goal of the project is to have a fixed set of in-house developed avatars.

Working code demo
*Video is sped up for better representation.
End product concept demo.