Client’s project background:

The client is a beverage company specializing in unique drink products targeted towards a younger demographic. They want to enhance their marketing efforts by incorporating augmented reality (AR) technology into their promotional campaigns. The client specifically requested a web-based AR system capable of image tracking multiple drink product packages and showcasing 3D models in a virtual space. Additionally, they want users to be able to take photos of the AR experience and share them on social media platforms.

Our Solution:

The project involves developing a web-based AR application that utilizes image tracking to overlay 3D models onto drink product packaging. The application must be capable of simultaneously tracking multiple product packages and rendering the corresponding 3D models in real-time. Furthermore, users should have the ability to capture screenshots of the AR experience and share them on popular social media platforms such as Instagram, Facebook, and Twitter.

Challenges:

Image Tracking in Web AR: Unlike native mobile AR applications, web-based AR poses unique challenges, especially when it comes to image tracking. Implementing robust image tracking capabilities that can handle multiple targets simultaneously is a significant challenge.

Integration of 3D Models: Integrating high-quality 3D models into the web AR environment requires careful consideration of performance optimization and rendering efficiency, particularly on mobile devices.

NDA Limitation:

It’s important to note that due to a Non-Disclosure Agreement (NDA) signed with the client, we are unable to disclose any pictures or specific details of the project. However, the project was focused on creating an engaging AR experience for users.

Solution:

To address the client’s requirements and overcome the challenges, the following solutions are proposed:

• Web AR Framework Selection: While there are commercial web AR frameworks like 8th Wall available in the market, the client expressed a preference for a more budget-friendly solution. In response, we opted to utilize an open-source web AR framework and customized it to meet the project’s specific needs. This approach not only reduced licensing costs but also provided flexibility for tailoring the framework to suit the client’s requirements.
• Optimized 3D Model Integration: To ensure optimal performance and rendering efficiency, we carefully optimized the 3D models of the characters. Through techniques such as mesh simplification, texture optimization, and LOD adjustments, we maintained visual fidelity while minimizing resource consumption, thereby ensuring a seamless AR experience across various devices.
• Multi-Target Image Tracking: Leveraging the capabilities of the selected open-source web AR framework, we implemented custom image tracking algorithms to enable simultaneous tracking of multiple drink product packages. By fine-tuning tracking parameters and preprocessing images for enhanced accuracy, we achieved robust image tracking performance, even in challenging environments.
• Social Media Integration: Seamless social media sharing functionality was integrated directly into the web AR application. Users can capture screenshots of the AR experience with ease and share them effortlessly on popular social media platforms. Leveraging APIs provided by social media platforms, we ensured a smooth and intuitive sharing process, enhancing user engagement and amplifying the reach of the promotional campaign.

Conclusion:

By leveraging an open-source web AR framework and customizing it to meet the client’s requirements, we successfully developed a cost-effective solution that met the client’s objectives. The optimized integration of 3D models, robust image tracking capabilities, and seamless social media integration culminated in an engaging and immersive AR experience that enhanced the client’s marketing efforts and drove user engagement.