Experience
- Applied Research Scientist, Thomson Reuters Lab, India
- Period: August 2024 - Current
- Project:
- Document Update Pipeline: Architected an end-to-end automation pipeline for processing legal documents based on Alert. Engineered XML parsing for MS Word files while preserving document integrity. Implemented Section-Matching algorithm to identify update requirements with detailed reasoning chains and alert-point mapping for Explainability. Developed Human-In-Loop validation interfaces enabling auditable update processes. Integrated LLM for content analysis with Multi-Threaded processing, resulting in 80% reduction in manual processing time while maintaining high accuracy through human verification.
- Search-and-Replace Agent: Developed an automated MS Word updating tool achieving >96% accuracy while preserving the original formatting and styles. Implemented a versatile solution that seamlessly processes multiple document types, resulting in widespread adoption between teams and 90% reduction in manual content updates.
- Research Intern, Microsoft Research India
- Period: January 2024 - July 2024
- Project: Worked under Programming with Representations (PwR): Developed an intermediate representation layer to bridge the gap between users and Large Language Models, addressing issues like hallucination and enhancing non-technical user interactions, thereby transforming chatbot building workflows. Worked on automating the chatbot building process using Conversational Programming paradigm.
- Built Jugalbandi(JB) Manager, open-source chatbot management platform supporting multiple channels, including WhatsApp, Telegram. It handled multilingual text and voice conversations using Bhashini & Azure Speech models.
- Open-sourced work on GitHub:
- PwR-NL2DSL, a tool to convert Natural Language to Domain Specific Language.
- PwR-Studio - Studio environment for Programming with Representations
- Jugalbandi Studio - Open-source chatbot framework
- Jugalbandi Manager - Chatbot management platform
- Mentors: Sriram Rajamani, B. Ashok, Akash Lal, Sameer Segal
- Research Intern, AI Institute, University of South Carolina
-
Period: December 2022 - April 2024
- Master thesis on Knowledge Enabled Multimodal Ingredient Substitution, built knowledge graph incorporating 27K ingredients and 40K substitution pairs. Enabled precise ingredient recommendations using multimodal and constraint-based searches. Developed an LLM-based query module for the ingredient substitution knowledge graph. Also submitted this work at AAAI-25.
-
Resources: GitHub Repository Dataset on Kaggle Dataset used in UC Irvine + Stanford Health Hackathon 2024 - Formulated cross-modal Recipe Retrieval and developed cooking action recognition for recipe analysis, achieving 95% Recall score leading to paper Cook-Gen at IEEE SMC’23.
- Mentors: Revathy Venkataramanan Dr. Amit Sheth
-
- Visiting Researcher at Societal Computing, Saarland University (SIC)
- Period: May 2023 - August 2023
- Project: Time and Multispectral Domain Satellite Image Super-Resolution
- Worked on Satellite Image Superresolution, utilizing Temporal and Multispectral Information for super-resolution. Utilized high temporal frequency of low-resolution images for Wildlife Tracking. Enhanced disaster analysis through high-temporal frequency & low-resolution images using GAN & Diffusion models.
- Technologies: GANs, Diffusion Models, Computer Vision, Remote Sensing, PyTorch
- Mentors: Ingmar Weber, Ferda Ofli
- Research Intern, University of Maryland, Baltimore US
- Period: October 2022 - April 2023
- Project: Personalized AI Assistant, funded under HealthCareNLP grant.
- Worked on developing Personalized Response Generation models using reward scaling over BART & T5, paper K-PERM accepted at AAAI Symposium’24 and improved NUBIA score by 10%. The work has been focused on using Knowledge and Persona for loss scaling resulting better response generation.
- Technologies: NLP, Information Retrieval, Large Language Models, Conversational Models, Question Answering, Generative AI
- Mentors: Manas Gaur
- AI Intern, EdgeNeural.ai, Pune, India
- Period: June 2022 - August 2022
- Project: Accelerated inference, optimized models through quantization, CPU/GPU customization. Developed training and optimization pipelines for automatic model training and hosting.
- Technologies: Optical Character Recognition (OCR), Object Detection (YOLO, SSD), TensorRT, GPU Optimization, OpenVINO, Docker, AWS, PyTorch, TensorFlow
- Collaborators: Sarvesh Devi, Chidhambararajan, Dhanraj
- Research Intern, Video Analytics Lab, IISc, Bangalore
- Period: May 2022 - August 2022
- Project: Implemented StyleGAN-based architectures for disentangled video interpretation in multiple domains, enhancing image and video generation using Generative Adversarial Networks.
- Technologies: GANs, Recurrent Neural Networks, PyTorch, TensorFlow, Python
- Mentor: Rishubh Parihar
- Research Intern, Visual Learning and Intelligence Lab, Indian Institute of Technology, Hyderabad
- Period: November 2021 - April 2022
- Project: Researched Medical Image Processing with Prof. Dr. C. Krishna Mohan. Developed a Novel Architecture for improved classification of low-quality images and unbalanced datasets. Published SFFNet for Panoramic Dental X-ray Segmentation at IEEE APSCON 2023.
- Technologies: Medical Imaging, Healthcare, Deep Learning, TensorFlow, PyTorch
- Mentor: R Sai Chandra Teja
- Collaborators: Dhruv Makhwana, Rohit Pawar
- Computer Vision Engineer, AI Mage (WETHEKOO)
- Period: March 2021 - April 2021
- Project: Developed Fashion Tagging Engine using Deep Learning, optimized and deployed computer vision models on edge devices, improving customer satisfaction.
- Technologies: TensorFlow, Computer Vision, Siamese Neural Networks, Tagging Engine, Segmentation
- Software Engineer, Rhizicube Technologies
- Period: June 2021 - September 2021
- Project: Oversaw Server & REST API development and Database for Consumer Data Platform Using Golang(Gin). Built a real-time streaming data pipeline using Apache Kafka. Wrote LinkedIn Scrapper and Generalized Organization Website Crawler to scrap data using Selenium & Beautiful Soup.
- Technologies: Back-End Web Development, Relational Databases, Kafka, MySQL, Data Scraping, Go (Programming Language), Database Design, Selenium, Python
- Collaborators: Udit Sarin, Yash Goyal