AI / Cloud Nishant Chauhan
Let us build

16+ years | Architect | AI-first leader

Building resilient AI platforms
from middleware to LLMs.

Strategy consultant and hands-on architect with wins across IBM, HCL, NEC, Accenture, and global clients. I modernize apps, secure platforms, and industrialize AI/LLM delivery across Linux, middleware, cloud, and automation stacks.

Collaborate See track record
16+ years delivering in MNCs
AI/LLM architecture, safety, ops
Multi-cloud Azure, AWS, IBM Cloud
Linux / Mainframe OpenShift / Kubernetes Middleware (Tomcat / JBoss / WebLogic) CI/CD & GitOps Automation (Ansible / Tekton / Jenkins) AI / LLM Cloud (Azure / AWS / IBM Cloud)
Portrait of Nishant Chauhan

AI & Cloud Architect

AI Platform Blueprint
Data contracts & quality
Model/prompt governance
Caching & routing
Safety stack
Cost & capacity
CI/CD & promotion
Feedback loops
Assurances
  • Latency budgets honored
  • Safety filters tuned
  • Cost-aware routing
  • Autoscale & canaries
Enterprise AI adoption Platform modernization Cloud cost efficiency LLM safety & guardrails Automation at scale Hybrid cloud resilience

Track Record

Built and shipped across global enterprises.

From middleware to LLM platforms, I lead architecture, delivery, and operations to land reliable outcomes.

Strategy Consultant

IBM — Noida, India

Dec 2019 — Present
  • Built practical AI tools for SREs and developers (assistive runbooks, anomaly insights, remediation cues) running on IBM Cloud.
  • Engineered AI-enabled CI/CD pipelines (Tekton/Jenkins) with policy guardrails, automated approvals, and governance controls.
  • Owned SRE and delivery end-to-end: reliability budgets, incident playbooks, observability, and on-call while driving the project solo.
  • Designed RAG solutions and tailored AI services with security guardrails, grounding, and routing for domain-safe responses.
  • Implemented data governance for ingestion and serving layers: access controls, lineage, retention, and compliance reporting.

Architect

HCL — Noida, India

Dec 2018 — Dec 2019
  • Produced HLD/LLD, migration, and DR plans for Java apps on JBoss/Tomcat/WebLogic across cloud and on-prem.
  • Containerized and moved workloads toward microservices; set up CI/CD, ingress, and observability on Kubernetes.
  • Supported pre-sales with sizing, modernization options, and risk mitigation for customer architectures.

Associate Manager

NEC — Noida, India

Oct 2015 — Dec 2018
  • Led L3 OSS support across Zabbix, HAProxy, GitLab, OpenAM, Ansible, OpenShift/Kubernetes, Jenkins, ELK.
  • Built automation (Ansible/Chef/Puppet), custom images/repos, and CI/CD PoCs for Java workloads.
  • Drove training, documentation, and hardening for Linux/Windows estates; supported pre-sales with solution docs.

Sr Software Engineer

Accenture — Gurgaon, India

Feb 2013 — Oct 2015
  • Ran Linux/Solaris estates for Intertek; built HLD/LLD, executed migrations, DR, and performance tuning.
  • Hosted and tuned JBoss/Tomcat apps, automated deployments, and resolved P1 incidents across data centers.
  • Implemented clustering, security hardening, backups, and monitoring for web/app/database layers.

System Administrator

HCL / NIC / Tech Mahindra

Jan 2010 — Feb 2013
  • Managed large Linux estates (7000+ sites at NIC; 1700+ servers for AT&T/BT), patching, security, and DR.
  • Built and maintained Apache/Nginx, JBoss/Tomcat, MySQL/Postgres, mail, DNS; automated with shell/Python.
  • Coordinated incident/change management, baselining, and hardening across data center environments.

Skill Stack

Full-stack for AI platforms.

Linux-first engineer with depth across middleware, cloud services, automation, and modern AI/LLM systems.

AI / LLM

End-to-end AI solutioning from data to inference with safety and observability.

LLM orchestration Prompt ops Guardrails Eval harnesses Vector search RAG Safety & compliance

Cloud & Infra

Hybrid architectures with automation, cost controls, and SRE-grade reliability.

AWS / Azure / IBM Cloud Kubernetes / OpenShift Service mesh IaC (Terraform) Autoscaling FinOps

Middleware & Linux

Hardened, performant platforms with secure integration patterns.

Linux / Mainframe Nginx / HAProxy Tomcat / JBoss / WebLogic APIs & gateways Messaging (Kafka) Perf tuning DR/HA

Automation & Ops

Reliable delivery with policy-as-code, CI/CD, and progressive rollouts.

CI/CD (Tekton/Jenkins) GitOps Ansible / Terraform Blue/green Canaries SLOs Runbooks

Credentials

Certifications & Training.

Enterprise-grade rigor: governance, security, and reliability practices baked into delivery.

Certifications

RHCE ITIL v3 IBM Cloud Advocate IBM Security Specialist Azure Fundamentals Six Sigma (Green Belt)

Highlights

  • API gateways with authz/rate limits; governance for BCDR, threat models, KPIs, RTO/RPO.
  • Security controls: service mesh (Istio), ACLs, RBAC/PSP, baseline hardening, FIPS/FedRAMP readiness.
  • Blogging and enablement: HPA/cluster features; stakeholder workshops; client presentations.
  • Hands-on with Tekton/Jenkins, Terraform, Ansible, Prometheus/Grafana, ELK, Loki.

Systems Thinking

End-to-end AI solution architecture.

Blueprints that balance safety, latency, observability, and cost—ready for real-world workloads.

01

Ingestion

Secure connectors, streaming pipelines, schema governance.

02

Feature Store

Reusable signals with quality checks and drift monitoring.

03

Model Ops

CI/CD for models, eval gates, champion/challenger.

04

LLM Orchestration

Routing, grounding, safety filters, caching, cost caps.

05

Observability

Traces, tokens, latency SLOs, red-team feedback loops.

Impact

Outcomes I optimize for.

Business clarity, measurable reliability, and safety-forward AI delivery.

-28%

Cloud spend through autoscale, spot, and right-sizing.

4x

Faster release cadence via CI/CD and progressive delivery.

97%

Compliance adherence on Linux fleets with automation.

42%

Reduction in unsafe LLM outputs with policy guardrails.

Let us build

Ready for your next AI platform?

I partner with leaders to design and land AI systems that are safe, reliable, and efficient.

Email LinkedIn +91 97114 00819