Ramya Baliga-Bhatt

Data Engineer | AI & Agentic Systems Specialist

San Francisco, CA

Open to Work US Green Card · No Sponsorship Required ↓ Download Resume
0
Years Experience
0
Databases Managed
0
GB/day Data Processed
0
M+ Records Queryable

About Me

Data Engineer with 7+ years building production-grade ETL/ELT pipelines and cloud data warehouses at enterprise scale. Specializes in AI-driven and agentic data systems — autonomous error detection, LLM-powered natural-language data interfaces, and full-stack delivery from ingestion to production-ready dashboards. Currently pushing the frontier of self-healing data infrastructure and agentic coding workflows.

Featured Projects

AskMyData

LLM-powered text-to-SQL app for querying World Bank datasets in natural language with multi-provider failover (Claude, GPT-4o). Parquet + DuckDB pipeline for sub-second queries on 100M+ records.

Python LLM DuckDB Streamlit
View Project →

Self-Healing Data Pipeline

Autonomous ETL error-recovery framework with regex rules engine (80%+ auto-fix) and LLM fallback. Self-learning knowledge base, 8 remediation strategies, Dagster integration.

Python Dagster LLM SQLite
View Project →

Developer Portfolio Website

Responsive portfolio in Next.js 16, React 19, Tailwind CSS 4 with dark/light theming and animations.

Next.js React Tailwind CSS
View Project →

Work Experience

Data Engineer
Johnson & Johnson
Jun 2022 – Dec 2024 | Limerick, Ireland
  • Led backend redesign for legacy platform — re-architected database structure and cleansing rules across most tables
  • Provisioned and managed Azure infrastructure end-to-end — resource groups, VMs, Data Factory (ADF) pipelines, and App Service Environments — supporting production ETL workloads
  • Built and maintained Databricks notebooks in Python for data processing, managing cluster access, secrets, and job scheduling across QA and production environments
  • Wrote and optimized complex SQL queries (3,000+ lines) for critical reporting and data transformation logic
  • Built and owned 15+ ETL pipelines moving 500GB/day from 20+ source systems into Azure data warehouses and lakes, cutting manual data-prep time by 35%
  • Re-architected pipeline performance across 50+ databases, data lakes, and data warehouses, reducing average run time by 40% and eliminating 10 recurring failure points
  • Designed data models and schemas supporting 50+ downstream reports, cutting average query time by 30%
  • Rolled out data quality checks, versioning, and lineage tracking across 15+ pipelines, cutting downstream data errors by 45%
  • Led a solo, end-to-end Azure subscription migration — cloning ADF pipelines, Databricks environments, and production/QA infrastructure into a new subscription, and cutting over on go-live day with minimal disruption
  • Deployed containerized applications via Docker and managed the container registry; administered versioning and configuration across Azure services
  • Implemented data security controls and pipeline monitoring, identifying and resolving 20+ performance bottlenecks before they impacted production
  • Maintained version-controlled documentation for 15+ pipelines and schemas in Git, cutting new-hire ramp-up time by 25%
Data Analytics Developer
Johnson & Johnson
Jun 2021 – Jun 2022 | Limerick, Ireland
  • Built ingestion and preprocessing workflows across 10+ databases, APIs, and log sources, feeding 30+ downstream analyses per week
  • Developed 20+ Tableau and Power BI dashboards used by 50+ stakeholders to track real-time supply chain and quality metrics
  • Conducted statistical testing and exploratory data analysis on 15+ datasets, surfacing 10+ actionable insights adopted by business leadership
  • Proposed data-driven recommendations on 10+ business problems, with 60% adopted into production workflows
Business Data Analyst
Johnson & Johnson
Jan 2021 – Jun 2021 | Limerick, Ireland
  • Translated complex data findings into actionable insights for 20+ non-technical stakeholders across 5 business teams
  • Optimized ETL processes across databases, CRM systems, and survey data, reducing processing time by 25%
  • Managed 8+ data projects end-to-end, meeting 100% of stakeholder deadlines
  • Built 50+ dashboards in Excel, Tableau, and Power BI, adopted as team's standard reporting format
Software Developer
Johnson & Johnson
Sep 2019 – Jan 2021 | Limerick, Ireland
  • Built complete front end of iOS app ("Beerse One Way") delivering guided tours to 5,000+ daily site visitors
  • Developed full-stack features using Node.js and React.js, contributing to internal application serving 200+ daily users
Junior Software Developer
Awnics
Mar 2016 – Jul 2017 | India
  • Built front-end and back-end features for in-house Node.js/React.js application

Skills & Expertise

Autonomous Agent Systems

Multi-Agent Orchestration Autonomous Error Detection Self-Healing Pipelines Agent Decision Systems Failure Recovery Tool Use & Function Calling

Production LLM Engineering

Retrieval-Augmented Generation LLM Evaluation Frameworks Multi-Model Routing Prompt Engineering Text-to-SQL Context Window Management

AI Reliability & Observability

Production AI Monitoring Pipeline Health Dashboards Automated Quality Gates Data Lineage Tracking Hallucination Mitigation Latency Optimization

AI Infrastructure

Vector Databases Containerized AI Deployment API Design for LLM Systems Cloud Data Platforms DAG Orchestration

Data Engineering Core

ETL/ELT Pipeline Design Cloud Data Warehouses Data Modeling SQL Optimization PySpark Python

DevOps & Delivery

Docker & Container Registry CI/CD Pipelines Git Version Control Agile/Scrum Infrastructure as Code Zero-Downtime Deployments

Certifications

Industry Certifications
Microsoft Certified: Azure Fundamentals Microsoft Certified: Azure Data Fundamentals Scrum Alliance Certified ScrumMaster (CSM)
LinkedIn Learning Certificates
Generative AI for Business Leaders Introduction to Prompt Engineering for Generative AI Prompt Engineering: How to Talk to the AIs Cloud Concepts: Determining Your Cloud Strategy Advanced SQL for Query Tuning and Performance Optimization DevOps Foundations Learning Power BI Desktop Cloud Architecture: Core Concepts Cloud DevOps Concepts: Understanding Processes and Services Analyzing Big Data with Hive

Get in Touch

Let's connect and explore opportunities for collaboration.

✉ Email ramyabaligabhatt@proton.me in LinkedIn /in/ramyabaliga ⌥ GitHub github.com/miabaliga