Skip to main content
Smartsheet

Senior AI ML Operations Engineer

RemoteIndia, United States only
Published
Role
AI / ML
Experience
Senior
Employment
Full-time
Salary not disclosed
Check eligibility

Open to IN, US only. Set where you work from to check your eligibility.

No BS summary

Senior AI/ML Ops Engineer needed to design, develop, and maintain AI/ML Ops platforms and pipelines. Requires experience with model deployment, CI/CD, infrastructure management (Docker, Kubernetes, serverless), monitoring, automation, and resource optimization. Must be legally eligible to work in India.

Core skills

KubernetesDatabricksAI/ML Ops

Required skills

PythonSQLDockerAWSAzureGCPTerraformMLflowLangChainLangGraphDatabricks Lakehouse ecosystemMosaic AI Agent FrameworkUnity CatalogVector SearchKnowledge GraphAWS Bedrock

Optional skills

Monte CarloAWS hosted data platform

Required languages

English

What you'll do

  • Designing, developing and maintaining stable and reliable AI/ML Ops platforms / pipelines
  • Model Deployment: Package and deploy AI/ML services to production, ensuring they are reproducible and interpretable
  • CI/CD Pipeline Development: Design and implement automated CI/CD (Continuous Integration/Continuous Deployment) pipelines to accelerate model deployment using tools
  • Infrastructure Management: Provision and optimize infrastructure for training and serving, utilizing Docker, Kubernetes, or serverless platforms
  • Monitoring & Observability : Implement post-deployment monitoring for model performance, data drift, and latency using tools.
  • Automation: Automate retraining and data pipeline workflows to ensure models stay accurate over time.
  • Manage the deployment of foundation models, fine-tuning workflows, and Retrieval-Augmented Generation (RAG) stacks (Vector DBs, Knowledge Graph.
  • Resource Optimization: Manage GPU/CPU utilization to minimize cloud costs while maintaining low-latency inference for users
  • Collaboration: Work closely with data scientists, data engineers, and software engineers to bridge the gap between model development and production.
  • Version Control & Governance: Manage versioning for data, code, and models using tools like MLflow.
  • Security & Compliance: Implementing data security measures, ensuring compliance with data governance policies, and protecting sensitive data
  • Technology Evaluation and Innovation: Staying abreast of emerging data technologies and exploring opportunities for innovation to improve the organisation’s data infrastructure
  • Troubleshooting and Problem Solving: Diagnosing and resolving complex data-related issues, ensuring the stability and reliability of the data platform
  • Perform other duties as assigned

What they require

  • Enterprise SaaS software solutions with high availability and scalability
  • Solution handling large scale structured and unstructured data from varied data sources
  • Experience in building and maintaining AI/ML Ops platform systems ensuring scalability, reliability, efficiency and security
  • In depth experience in AI/ML Frameworks and tools involving large Petabytes of data with Databricks Lakehouse ecosystem
  • AI/MLOps workflows on Databricks , MLFlow, Mosaic AI Agent Framework, Unity Catalog, Vector Search, Knowledge Graph
  • Knowledge of AI/ML frameworks like LangChain, LangGraph for AI/ML Ops pipeline integration
  • Hands-on experience with at least one major cloud provider (AWS, Azure, or GCP).
  • Programming languages like Python and SQL
  • Modern software engineering practices like Kubernetes, CI/CD, IAC tools (Preferably Terraform), Observability, monitoring and alerting
  • Solution Cost Optimisations and design to cost
  • Legally eligible to work in India on an ongoing basis

Benefits

  • your ideas are heard, your potential is supported, and your contributions have real impact.
  • You’ll have the freedom to explore, push boundaries, and grow beyond your role.
  • We welcome diverse perspectives and nontraditional paths—because we know that impact comes from individuals who care deeply and challenge thoughtfully.
  • When you’re doing work that stretches you, excites you, and connects you to something bigger, that’s magic at work.
  • Let’s build what’s next, together.
SoftwareEnterprisesmartsheet.com
Salary not disclosed