Stage-1 : Agentic systems for speech quality check( BharatGen) | Stage-2 Error categorisation for grade 3 indian L2 english speakers

Basic Information

Project Title / Domain: Stage-1 : Agentic systems for speech quality check( BharatGen)

Stage-2 Error categorisation for grade 3 indian L2 english speakers

Name: Devesh Soni
Guide: Prof. Ganesh and Prof. Preeti
Project Type: implementation-driven

Short Description of Project

Stage 1 : tried to create a multi agent system using langgraph for speech data quality assessment. Assessment includes checking file formats and any information related to audio files. Any analysis you want to do on the audio files. Bharatgen needed a system to analyse large amount of audio data that they recieve from various vendors. A prototype was created although it was never scaled. Stage 2 working with Preeti Rao ma’am target is to improve an existing tool called TARA. It is an oral reading fluency assessor currently deployed in many KV schools. It is primarily a cascaded system of ASR system and other ML models. Our task was to find some deep learning alternative like SpeechLLMs . But to train speech LLM we are currently generating synthetic data and for that we are trying to categorise these errors made by students so as to train the model specifically to identify those kind of erros

Whom did you work with?

PG students, The prof directly

Tools / Simulation / Software / Hardware

Dgx servers are preferred over the prajna server

Expectations from Guide

To be understanding and have constant useful discussion. The prof. Is sometimes confused and will ask you to throw your hands here and there which is really frustrating and hard to continue

Expectations for 8th Sem & Summer

Ganesh sir - weekly meeting BharatGen meetings ( twice a week) only 15min updates .sir is mostly busy and fine with internship till you deliver the work on time. One can do remote interning summer without letting anyone know( you have to work hard) . 8th sem was chill. Need to work max 3-4 hrs a week. You can push hard for a paper in summer since there are many conferences

Preeti maam - very strict and particular with meet timing..if you are late by 5 min in any meeting she will write you a mail .

Load: 8th Sem vs 9th (Placement) Sem

Load increases during summer . Do most of your work in summers and be very clear with your prof. About your plan for the prof. During summer there are many conferences . Try to push for any one of them and then the result for these conferences take time , which will eventually cover your 9th sem . Having worked seriously in summer and submitted a paper, I was waiting for it’s results in the 9th sem and thus I was able to focus on placements.

Summer on Campus

I didn’t stay in insti but I worked remotely in the summer

Is DDP Guide Same as SRE/RnD Guide?

Reason for Change of Guide

I did my SRE with Amit Sethi sir and he had his own rules to choose students.

How did your SRE help with your DDP?

End Deliverables

A paper in an A* conference ( this usually goes on after graduation also) but your paper must be atleast submitted in any one conference , may not be accepted