Virtual Trial Room with Computer Vision and Machine Learning

 

Introduction

Welcome to the fascinating world of virtual trial rooms with computer Vision and machine learning, where cutting-edge technologies like computer vision and machine learning are transforming the way we shop online. This innovative endeavor focuses on converting 2D images of individuals' heads into 3D models and seamlessly integrating them with various 3D eyeglass models. After dedicated efforts, significant progress has been achieved. The team successfully generated a 3D head model from a single 2D image and created diverse 3D eyeglass models using Blender. These models have been seamlessly integrated and showcased through a user-friendly website. By simply uploading a single image, users can witness the generated 3D model of their head with a fitted eyeglasses, empowering them to explore different styles effortlessly. This system eliminates the need for physical trials, allowing users to assess eyeglass compatibility with their facial structure conveniently.

This project is created by 

• Amrendra Kumar Yadav
• Arjun Chhetri
• Suraj Agrahari
• Tulashi Prasad Joshi

Abstract

Online shopping has revolutionized the retail industry, providing customers with  convenience and accessibility. However, customers often hesitate to purchase wearable  products such as watches, jewelry, glasses, shoes, and clothes due to the lack of certainty regarding fit and suitability. This leads to significant return rates, causing  problems for both customers and vendors. To address this issue, A platform called the Virtual Trial Room with Computer Vision and Machine Learning is designed  which enables customers to easily check whether a product will fit and suit them or not. To achieve this, an AI-generated 3D model of the human head was created from a single 2D image using DECA model. This 3D model was then superimposed with a custommade 3D model of glass which is based on real-world measurements and fitted over the human head. To replicate the real-world look and feel, the model was retouched with textures, lightness, and smoothness. Furthermore, A full-stack application was developed utilizing various technologies such as HTML, CSS, JavaScript, React, Babylon.js, etc. This application enables users to view 3D-generated results on website, providing an immersive and interactive experience. In summary, Virtual Trial Room with Computer Vision and Machine Learning platform provides a sophisticated solution to the problem of online shopping for eye glasses. By utilizing advanced technology, main aim of this project is to significantly reduce return rates and enhance the overall customer experience.

Objective

The main objective of the project is given below :

• To provide customers a Virtual platform for trying on eye glasses Virtually without having to go to store physically. 

Application 

• Fashion industry (garments, shoes, watches etc.)
• 3D Digital avatar and goods creation
• Gaming industry
• Eyewear ecommerce company

Output

Virtual trail room with computer Vision and machine learning 

Conclusion

The primary objective of the project "Virtual Trial Room with Computer Vision and Machine Learning" was to tackle the real-life issue pertaining to eyeglasses. The prproject aimedo convert a 2D image of a person's head into a 3D model, create multiple 3Dmodel of eyeglasses, and integrate them together. After dedicated efforts, the project has made significant strides towards achieving its goals. The team has successfully generated a 3D head model of a person from a single 2D image and created a 3D model of eyeglasses utilizing Blender. Moreover, both 3D models have been integrated and showcased to users via a user-friendly website. The website permits the user to upload a single image, and the 3D model of the head with a fitted eyeglass is automatically generated. The website offers multiple 3D eyeglass models, giving users the flexibility to try on different styles. In conclusion, the developed system enables users to effortlessly check the compatibility of eyeglasses with their facial structure by uploading a single image, eliminating the need for a physical trial.

In conclusion, project “Virtual trial room with computer vision and machine learning was able to achieve its Objective.