Blue Diamond GrowersPrincipal AI Engineer (Director)
Nov. 2017 - May. 2024Sacramento, California, United StatesLed Augmenting of LLMs Using Retrieval Augmented Generation optimization across BDG business domains.
Led Unified Analytics Program and SOP using Agile methodologies around Accelerating Data Science Workflows with Zero Code Changes to Production code bases. (AI Enterprise).
Led Machine Learning System Engineering and Machine Learning security monitoring and vulnerabilities program for AI Red Team Methodology and Best Practices. (Adversarial ML) *(LLM Attacks: Prompt injection, data poisoning, training data extraction {model_extraction}). *(Model Evasion: human imperceptibility)
Led the Image segmentation of TensorFlow Keras Deep Learning modeling architecture and design patterns. Led MLOps model deployment operations for neural networks using variety production ready frameworks onto NVIDIA Triton Server. Guided junior ML and Data engineers deploying neural networks using Triton Server, Measuring GPU usage effectively in combination with Prometheus. (PyTorch, CNNS, Data Augmentation, Transfer Learning, Hugging Face Modeling, TensorRT Modeling). Led the development of Generative AI Diffusion Modeling for text-to-image pipelining for Manufacturing, Marketing Campaigns. {noise removing} *(U-Net to Diffusion, Diffusion Models, Optimizations, Classifier-Free Diffusion Guidance, CLIP). Guided the development of building chains for RAG agents with LLMs using LangChain. Led implementation of NVIDIA NiM Microservices, Model Deployment, Latency trade-offs, tensor parallelism to effectively deploy Large Language Models using NVIDIA Inference Microservices. Architected and designed production-level deployments of LLM applications and enterprise-grade deployments of RAG pipelines from multiple sources of knowledge within the organization. *(End-to-End deployment using Helm and NVIDIA NIMS)