IIT Jodhpur researchers create a great framework
IIT Jodhpur researchers are developing a framework for creating software – Comic-to-Video Network (C2VNet) to convert born digital, or digitized comic books, to video.
Growing digitization has increased the need to digitize our country’s cultural heritage. This framework revolves around creating an audio-video storybook, say IIT Jodhpur researchers.
Epistemological questions
This, in major ways, attends to epistemological questions on knowledge production about generating digital data from material objects, and rethinking of existing processes of knowledge production, say IIT Jodhpur researchers.
Methods and methodologies that can create the desired multimedia content have grown as a result of advances in technology. One such instance is “Automatic image synthesis”, which has gained a lot of attention among researchers, say IIT Jodhpur researchers.
Read More – Top 20 IIITs of India
In contrast, audio-video scene synthesis, such as that based on document images, remains challenging and under researched, say IIT Jodhpur researchers.
This field of DH lacks sustained analysis of multimodality in automatic content synthesis and its growing impact on digital scholarship in the humanities. The C2VNet is a step towards bridging this gap, say IIT Jodhpur researchers.
The goal was to design and develop software that takes a born-digital or digitized comic book as input and produces an audiovisual animated movie from it, say IIT Jodhpur researchers.
Along with the software, IIT Jodhpur researchers have proposed a dataset titled “IMCDB: Indian Mythological Comic Dataset of Digitized Indian Comic Storybook” in the English language.
This has complete annotations for panels, binary masks of the text balloon and text files for each speech balloon and narration box within a panel and plans to make the dataset publicly available, say IIT Jodhpur researchers.
The panel extraction model C2VNet has two internal networks to support the video creation. CPENet developed by IIT Jodhpur researchers team gives over 97% accuracy, and the speech balloon segmentation model SBSNet gives 98% accuracy with fewer parameters.
Both have outperformed state-of-art models. C2VNet is the first step towards the big future of automatic multimedia creation of comic books to bring new comic reading experiences, said Dr. Chiranjoy Chattopadhyay speaking about IIT Jodhpur researchers.
In the future, the team is working towards improving the software so that these multimedia books become more immersive and engaging for the target audience.
Usually, this kind of work takes more time and effort, but with this software, it can be done quickly and in a more interactive way.
Indian Institute of Technology Jodhpur was established in 2008, to foster technology education and research in India. The institute is committed to technological thought and action to benefit the economic development of India.
Scholarship in teaching and learning; scholarship in research and creative accomplishments; and relevance to industry are three driving forces for us at IIT Jodhpur.
IIT Jodhpur functions from its sprawling residential Permanent Campus of 852 acres on National Highway 65, North-Northwest of Jodhpur towards Nagaur.
This campus is meticulously planned and envisioned to stand as a symbol of academics. A large parcel of the Permanent Campus (of about 182 acres) is set aside for the development of a Technology Park to strengthen institute-industry interactions.
Read More – Top 20 toughest exams in India
The institute is committed to a multidisciplinary approach of technology development. Hence, it has established state-of-the-art laboratories for basic research and has organized its academic degree activities through Departments and its coordinated research through Centers for Technologies.
S Vishnu Sharmaa now works with collegechalo.com in the news team. His work involves writing articles related to the education sector in India with a keen focus on higher education issues. Journalism has always been a passion for him. He has more than 10 years of enriching experience with various media organizations like Eenadu, Webdunia, News Today, Infodea. He also has a strong interest in writing about defence and railway related issues.
