Personal Reflections & Tech Insights

Blogs

Scaling Reinforcement Learning in Production

Moving RL agents from research to production brings unique challenges. It's not just about the model, but the entire system around it.

Taming AI Microservices with a Service Mesh

AI workloads bring new complexity to microservices. A service mesh can help manage traffic, observability, and security for these demanding systems.

Catching Silent Failures in ML Pipelines

Your ML pipeline might be green, but your model could be failing silently in production due to data issues. Data observability helps you catch these problems.

Monitoring AI in production: Beyond the usual metrics

Observing AI/ML systems in production goes beyond traditional infrastructure metrics. It needs deep insights into data quality, model behavior, and performance to catch silent failures.

Kubernetes for ML: Orchestrating Production Models

Deploying machine learning models to production brings unique challenges. Kubernetes offers powerful tools for managing these complex workflows, but it's not a silver bullet.

Optimizing GPU Costs for Multi-Tenant AI Inference

Sharing GPUs for AI inference across multiple users or services is tricky. This post explores how to allocate these expensive resources efficiently without sacrificing performance or breaking the bank.

Hierarchical Caching with Hierarchical Temporal Memory

Optimize AI model deployment with hierarchical caching and Hierarchical Temporal Memory.

CI/CD for Large-Scale AI Models

Streamlining the deployment of complex AI models using cloud-native buildpacks and GitOps

Real-Time AI & Voice Bots using WebSockets

Harnessing the power of real-time AI and voice bots with WebSockets, enabling seamless conversations and fast responses.