Keerti Kolakaluri
Atlanta
Summary
AI/ML Engineer with over 4 years of experience in Data Science and AI Engineering, specializing in Generative AI and the complete MLOps lifecycle. Demonstrated expertise in LLM operations, including model fine-tuning and performance benchmarking, with secure deployment on Microsoft Azure. Skilled in using MLflow and Kubeflow Pipelines to create production-ready AI applications that drive business value. Committed to embracing new challenges with a strong work ethic and adaptability.
Overview
5
5
years of professional experience
1
1
Certification
Work History
AI Engineer
CirrusLabs
Atlanta
08.2024 - Current
- Led the fine-tuning of advanced LLMs, including Mistral-7B and Gemma-2-27B, utilizing Hugging Face methodologies and Kubeflow Pipelines to optimize model performance for domain-specific tasks in policy data analysis.
- Designed and implemented production-grade LLM applications for document analysis and risk governance, leveraging advanced NLP techniques to automate complex data extraction and classification.
- Established a robust MLflow environment for end-to-end model tracking, versioning, and lineage visualization within AI development workflows, significantly improving model auditability and reproducibility.
- Evaluated and benchmarked top-performing open-source LLM candidates against proprietary data, providing data-driven recommendations for core NLP tasks (text generation, RAG-based question answering, and summarization).
Tech Prod Manager/Analyst, Population Health and Value (Data & Process Automation)
Optum
Chicago
01.2023 - 09.2023
- Conducted complex Snowflake SQL analysis to identify and resolve critical data quality issues impacting population health reporting accuracy.
- Managed product requirements for ACO reports, translating business needs into Agile features and user stories, and actively managed task distribution in scrum meetings.
Technology Development Program Associate (Software Engineer)
OptumRx
Chicago
07.2022 - 01.2023
- Developed and trained LSTM deep learning models using Databricks and Python to predict complex customer behavior within the rare drug industry.
- Utilized Azure Monitor and Azure Machine Learning Studio for continuous model monitoring, drift detection, and performance tracking in a production environment.
Technology Development Program Associate (Data Analyst)
Optum Tech
01.2022 - 07.2022
- Validated backend databases in the Direct Connect system, identifying and reporting defects in development and QA environments to enhance system reliability.
- Performed regular data quality checks using pivot tables, ensuring data integrity and completeness across various enterprise systems.
- Partnered with business stakeholders to map production data for insurance providers, supporting strategic decision-making.
Data Analyst Consultant
Canopius
08.2021 - 12.2021
- Automated data ingestion processes using SQL, VLOOKUP, and macros, reducing report generation time by 1.5 hours per month and significantly improving financial efficiency.
- Managed the monthly processing of claim bordereaux by collecting and validating data from insurance agents, ensuring data quality and consistency using SQL and Excel technologies.
- Developed and produced an integrated report system that fed into the financial data mart, enhancing data accessibility for financial analysis.
Data Analyst
Volantsys Analytics
05.2020 - 08.2021
- Played a pivotal role in validating NLP chatbots, ensuring accurate retrieval of training data in response to user inquiries, which improved chatbot accuracy and customer interaction.
- Collaborated closely with data scientists to develop templates for statistical analysis and model reports, streamlining the model development process and documentation of business requirements.
- Led the collection of business needs and crafted Figma user interface mockups for a data science workflow and training SaaS product.
AI Engineer Consultant (AI/ML Focus)
DELOITTE
- Engineered an end-to-end IT process automation solution for VDI provisioning by integrating a Conversational AI orchestrator, SSO/RBAC checks, and custom external APIs.
- Designed and implemented the LLM-based intent analysis and multi-turn dialogue management to intelligently extract configuration parameters from user input, validating requirements (e.g., email domain, region) in real-time.
- Spearheaded the development of a proprietary Gen AI platform (internal 'ChatGPT-like') using Azure OpenAI Services and LangChain to implement Retrieval Augmented Generation (RAG) for content synthesis.
- Engineered real-time MLOps monitoring and analytics solutions for the internal Gen AI platform using FastAPI and Python, providing stakeholders with actionable insights into system performance and user engagement.
- Applied Dynatrace DQL for advanced error log analytics and anomaly detection, building proactive alerting mechanisms to ensure high availability and performance of mission-critical AI services.
Education
Master of Science - Data Science
Indiana University
12.2023
Bachelor of Science - Data Visualization
Purdue University
05.2020
Skills
- Generative AI & LLMs
- Large Language Models (LLMs)
- Fine-Tuning (SFT)
- RAG Architecture
- Prompt Engineering
- Mistral-7B
- Gemma-2
- LangChain
- Hugging Face
- Azure OpenAI Service
- GPT Models
- NLP
- MLOps & Engineering
- MLflow
- Kubeflow Pipelines
- Azure ML Studio
- Model Versioning
- Model Tracking
- Docker/Containers
- A/B Testing
- Dynatrace DQL/Davis AI (Monitoring)
- Cloud Technologies
- Microsoft Azure
- Databricks
- Programming & Tools
- Python
- Pandas
- NumPy
- Scikit-learn
- TensorFlow
- PyTorch
- SQL
- Snowflake
- FastAPI
- Git
- Visual Studio
- Tableau
- Matplotlib
- Methodologies
- Agile
- Scrum
- Rally
- AHA
- Statistical Analysis
- Feature Engineering
- Root Cause Analysis
Certifications And Recognition
Introduction to Generative AI & Introduction to Vertex AI Studio, Coursera, 2024, Google Data Analytics Specialization, Coursera, 2021, Diamond Award Performance Recognition, UnitedHealth Group, 09/01/01, 04/01/01
Accomplishments
- Diamond Award Performance Recognition (UnitedHealth Group, 09/2001 & 04/2001)
Certification
● Introduction to Generative AI & Introduction to Vertex AI Studio (Coursera, 2024)
● Google Data Analytics Specialization (Coursera, 2021)
Timeline
AI Engineer
CirrusLabs
08.2024 - Current
Tech Prod Manager/Analyst, Population Health and Value (Data & Process Automation)
Optum
01.2023 - 09.2023
Technology Development Program Associate (Software Engineer)
OptumRx
07.2022 - 01.2023
Technology Development Program Associate (Data Analyst)
Optum Tech
01.2022 - 07.2022
Data Analyst Consultant
Canopius
08.2021 - 12.2021
Data Analyst
Volantsys Analytics
05.2020 - 08.2021
AI Engineer Consultant (AI/ML Focus)
DELOITTE
Master of Science - Data Science
Indiana University
Bachelor of Science - Data Visualization
Purdue University