Senior Software Engineer
Distributed data infrastructure, cloud security, and AI engineering.
- Engineered and operated multi-region Azure Data Explorer clusters, tuning compute capacity, workload isolation, query concurrency, memory, caching, retention, and ingestion. Data and compute optimizations projected to save $1.5–2M per month.
- Designed workload management for known and unknown traffic using workload groups, concurrency and memory policies, request queuing, and weak consistency. Query performance optimizations with weak-consistency query heads supported growth from 200K to up to 11M queries per day and brought p90 latency from 40–50 seconds to about 7 seconds.
- Designed and investigated high-throughput ingestion across Delta Lake, ADLS, Event Hubs, Event Grid, Kusto data connections, and transformations. Diagnosed freshness, oversized files, batching, duplicates, and end-to-end latency.
