A final year project on “Virtual Trial Room using OpenCV″ submitted by Siddthanth Chopra to extrudesign.com. This project is done by Computer Science students Siddthanth Chopra and Ashish Mishra from SRM IST, CHENNAI, INDIA.
Abstract
With most of the things shifting to virtual mode and competitors trying to get ahead of one, other textile industries took a hit during these tough times. With a Virtual trial Room, Every small textile shops can help their customers to an online trial Room without being afraid of contracting the disease. The advantage of using this method would be the reduction of time and effort spent in trying out the clothes physically.
Introduction
Stores for the most part have huge and different choices for garments. It is genuinely outlandish for a client to evaluate every one of those garments without going through hours on it. Additionally, in a physical store, to take a stab at some chose garments a typical practice is to line up and alternate to utilize the fitting rooms. Because of the predetermined number of in-store fitting rooms, customers normally need to invest the majority of their shopping energy on lining up (which will be significantly more during top hours). Drawn out holding up time will influence the client’s understanding, which prompts lower consumer loyalty.
Proposed work for
Using gluoncv with mxnet would help us achieve superimpose clothes and ornaments on human as it’s a computer vision tool kit that implements state of the art (SOTA).
Literature Survey for Virtual Trial Room Technologies
In “Real-time 3D virtual dressing base on user’s skeleton (2017)”, it presents real-time 3D virtual dressing base on users skeleton are extracted and tracked in real-time to drive transformation and fitting of clothes models. The advantages of this work is human measurements generated according to users body stand in front of the Kinect and the disadvantages s user should be apart from machine to maintain a particular distance. In “Skeleton based human action recognition using Kinect”, it provides an application that uses gestures to interact with a virtual object in the augmented reality application. It provides a way to use the gesture base interaction to manage operations in a virtual environment and the advantage of this work is, it supports skeleton tracking but the disadvantage is, it may give an incorrect measurement of height. In “Virtual dressing room application Microsoft Kinect sensor (2019)” their proposed approach is mainly based on extraction of the user from the video stream alignment of models and skin colour detection and the disadvantage of it is flexible and look real clothes model for user to wear and user can get detect in less time but the disadvantage is due to network issue softcopies of dresses will not going to impose on target image correctly
Stephen Karungaru and Kenji Terada [6], in this Project,they propose a method to acquire human body length / perimeter easily using Kinect. Experimental results confirmed that human data can be acquired from Kinect sensor. We also confirmed problems in case of error in acquired data. Future issues include improving the accuracy of acquisition of person’s data and the CG.
Algorithm to create Virtual Trial Room
Step1: Use of OpenCv
Step2: Capturing the video using openCv packages (cv2)
Step3 : RGB Normalization – OpenCV uses color contrast based differentiation of objects by detecting the pixels which reside on the boundaries where colors change values significantly
Step4: S.O.T.A – GluonCV contains a various function which together helps in detecting the contours of different objects in a frame
Step5: Augmentation of colours and logos -. Here in our case, we want the outermost containing contour which will relate to the T-shirt which the user or test object is wearing
Step6 : With mxnet deep learning algorithm we impose the clothes and ornaments to human body
Step7: It makes the process user interactions with the help of Numpy/OpenCV packages for edge detection and Context Embedding
Conclusion
In this paper, we describe a dynamic texture overlay method from monocular images for real-time visualization of garments in a virtual mirror environment. Similar to looking into a mirror when trying on clothes, we create the same impression but for virtually textured garments. The mirror is replaced by a large display that shows the mirrored image of a camera capturing e.g. the upper body part of a person. A virtual mirror system is designed for the purpose of a cloth changing room. Our motivation here is to increase the time efficiency and improve the accessibility of clothes try-on by creating a virtual dressing room environment. The system exchanges the colour and the texture of a shirt while the person wearing the shirt can move freely in front of the mirror and even perform elastic deformations of the cloth-like stretching and bending or move toward or away from the camera.
REFERENCE
- Naoyuki Yoshino, Stephen Karungaru “Body Physical Measurement using Kinect for Vitual Dressing Room”2017 6thIIAI
- 1]. Amit Thakur, Suraj Virkar, Prof. Jyoti Gaikwad, “Online Virtual Trial Room Implementation using OpenCV Python “, International Journal of Advanced Computer Technology (IJACT), Vol. 7, May. 2020.
- [2]. F. Isikdogan and G. Kara, “A Real Time Virtual Dressing Room Application using Kinect”, Cmpe537 Computer Vision Course Project, Bogazici University, January2012
- [3]. Cecilia Garcia Martin, Erdal Oruklu, “Human Friendly Interface Design for Virtual Fitting Room Applications on Android Based Mobile Devices”, Journal of Signal and Information Processing, Vol. 3/4, 2012, pp. 481-490.
- [4]. Nikki Singh, Sagar Murade, Prem Lone, Vikas Mulaje “Virtual Trial Room” Vishwakarma Journal of Engineering Research, Volume 1 Issue 4, December 2017
- [5]. Saurabh Botre, Sushant Chaudhari, Shamla Mantri, “Virtual Trial Room”, International Journal of Computer Science Trends and Technology (IJCST), Volume 2 Issue 2, Mar-Apr 2014
- [6] Ahmad al-Qerem , “Virtual Dressing Room Implementation Using Body Image –Clothe Mapping” , International Journal Of Engineering And Computer Science ISSN:2319-7242 Volume – 5 Issue -02 February 2016
- [7] 1 Vipin Paul, 2 Sanju Abel J., 3 Sudharsan S., 4 Praveen M , “VIRTUAL TRAIL ROOM”, South Asian Journal of Engineering and Technology Vol.3, No.5 (2017) 87–96
- [8] Akshay Shirsat1 , Samruddhi Sonimindia2 , Sushmita Patil3 , Nikita Kotecha4 , Prof Shweta Koparde5 , “Virtual Trial Room ” , International Journal of Research in Advent Technology, Vol.7, No.5, May 2019
- [9] Han Yang1,2 Ruimao Zhang2 Xiaobao Guo2 Wei Liu3 Wangmeng Zuo1 Ping Luo4 , “Towards Photo-Realistic Virtual Try-On by Adaptively Generating↔Preserving Image Content” , IEEE International Conference on Computer Vision
- [10] Anagaha Ramesh ,Ankit Raj Kushal,Brinda D ,Vaishnavi , “3D Virtual Trial Room” , International Journal of Engineering Research & Technology (IJERT) ISSN: 2278-0181 , Special Issue – 2018
girish says
can i see full source of code
Sundar Dannana says
We do not have the full code. Sorry for that.
Aditya Gupta says
Hey! Hope you’re doing fine. Just wanted to know if you were actually able to make this project or not because I’m in my final year and I’ve already chosen this same project but haven’t started yet working on it. It would be wonderful if I could get some guide from you.
Zin says
Hello, friend! Were you able to complete this project? I, too, have this as a final project as was wondering how you were able to go about solving this problem? Thank you!
Naman says
can you please provide the contact of the person who submitted the project. I m ready to pay you and the person who submitted. if yes contact on sharmanammu1208@gmail.com