Where I've built
Data Engineer
Dec 2025 — PresentDesigning closed-loop LLM evaluation frameworks with synthetic observability data and automated grading pipelines. Built representative test data generation for safety-critical RCA workflows. Reduced broken evaluation runs ~70%.
Data & AI Engineer
Aug 2025 — Dec 2025Multi-stage classification for abuse detection and NSFW content moderation. Client-side LLM moderation with CLIP/MiniLM-L6-v2 embeddings. HIPAA/GLBA compliant; PHI/PII recall ≥98% at ≤3% FPR (F1 0.95–0.97).
AI Data Engineer
Nov 2024 — PresentAzure Lakehouse processing 5+ TB daily across $500M+ transactions. Reduced data latency 65%, reporting from 48h to <6h. Real-time fraud detection with Spark Structured Streaming. AI recommendation systems — 1M+ interactions, +22% engagement.
Data Engineer
Jan 2021 — Aug 2023Built partner analytics backbone on Snowflake + Iceberg + dbt + Airflow. Deployed dynamic pricing on SageMaker driving +35% annual revenue. Real-time DDP handling billions of events/day at 99.9% availability.
Software Engineer Intern
Apr 2020 — Dec 2020Prototyped streaming ETL in Flink, built FastAPI prediction services with OpenTelemetry tracing and CI/CD with reusable GitHub Actions.
Technical Graph
Selected Works
Rust HFT Risk Engine
Real-time risk engine streaming synthetic venue data with pre-trade credit and price collar checks. PTP timestamped to ClickHouse with deterministic replay.
Latent Diffusion Engine
Latent-diffusion pipeline with point-in-time content embeddings trained on 10 H100 nodes with Artbench + OpenImage data.
Notion Data Spine Clone
CRDT collaborative editing on Kafka, Postgres, and gRPC with backpressure handling and idempotent writes.
HPC Image Captioning
Memory-efficient DDP with CNN-RNN, crash recovery via gradient checkpointing across DenseNet169, InceptionV3, ResNet50.
How I see
Credentials
Certifications
Enterprise multi-cloud architecture design across AWS, Azure, and OCI platforms.
Verify ↗Cloud database design, migration patterns, and autonomous database management.
Verify ↗Machine learning model lifecycle, feature stores, and model deployment on OCI.
Verify ↗LLM integration, RAG architecture, and prompt engineering on Oracle Cloud.
Verify ↗GPU-accelerated LLM inference, TensorRT optimization, and multi-node training.
Verify ↗MLflow lifecycle, feature engineering, AutoML, and production MLOps on Unity Catalog.
Verify ↗Strategic problem-solving, structured communication, and leadership development.
Verify ↗Core AWS services, security, architecture, and cloud economics fundamentals.
Verify ↗SageMaker model training, deployment pipelines, and ML infrastructure on AWS.
Verify ↗Education
Generative AI, HPC with Deep Learning, Big Data & Indexing. Co-founder at CareWallet.
Probability & Statistics, Cloud Computing. 2× GCP Quest Leader. Google Code-in Mentor.
Contributions
Word of mouth
"Shrey is rare in that he combines strong engineering depth with clear product thinking. He's thoughtful about schemas, data quality, and monitoring..."
"He managed end-to-end data workflows — handling everything from source extraction and complex transformations to delivering well-structured data marts."
"His proactive stance on identifying and mitigating potential challenges underscores his critical role in our risk management strategies."
"Shrey offered insights that added strength to our technological foundation, paving the way for operations that scale."
Let's talk
Or let Spectra set up a call (Voice coming soon)
Or reach me directly: patelshrey77@gmail.com