Software Engineer II, MLOps Framework
- Role
- AI / ML
- Experience
- Mid
- Employment
- Full-time
Open to US only. Set where you work from to check your eligibility.
Core skills
Required skills
Optional skills
Required languages
About the Company
At Torc, we have always believed that autonomous vehicle technology will transform how we travel, move freight, and do business. A leader in autonomous driving since 2007, Torc has spent over a decade commercializing our solutions with experienced partners. Now a part of the Daimler family, we are focused solely on developing software for automated trucks to transform how the world moves freight. Join us and catapult your career with the company that helped pioneer autonomous technology, and the first AV software company with the vision to partner directly with a truck manufacturer.
Meet the Team
As a Software Engineer on the ML Ops Framework & Conversion team, you will own the pipelines that take models from research to production on edge hardware, including model conversion, compilation, benchmarking, and release. Our team is comprised of engineers with deep expertise in ML and RL frameworks, embedded systems, and autonomous driving — united by a focus on getting models from development into the real world reliably and at scale. The ML Ops Framework & Conversion team is responsible for the full model conversion process — from architecting TensorRT pipelines to maintaining the model release registry across platforms. In this role, you will work closely with perception and safety teams to ensure every model that ships meets strict latency and accuracy requirements for autonomous trucking.
What You’ll Do
- Architect and implement model conversion and compilation pipelines using tools such as ONNX, TensorRT, and torch.compile for deployment on edge devices (e.g., NVIDIA Orin). - Maintain and evolve the model release registry, ensuring traceability and reproducibility across model versions and target platforms. - Perform rigorous latency benchmarking and model quality parity evaluations to validate that deployed models meet safety-critical performance requirements. - Compare metrics across platforms to verify accuracy and latency compliance before release. - Communicate and collaborate with model development teams and broader stakeholders, ensuring your findings translate into reliable, actionable outcomes across the organization.
What You’ll Need to Succeed
- Bachelor's Degree in Computer Science, Electrical Engineering, Robotics, or related field plus 4+ years of relevant experience; or Master's Degree plus 2+ years. - Extensive experience with model conversion and compilation pipelines (ONNX, TensorRT, torch.compile) and performing rigorous latency benchmarking and quality parity validation. - Hands-on experience deploying and testing models on edge hardware (e.g., NVIDIA Orin or similar embedded platforms). - Experience maintaining a model release registry in a production environment. - Ability to compare and interpret performance metrics across hardware platforms to validate models against strict latency and accuracy requirements.
Bonus Points
- Expertise in model quantization (PTQ, QAT) and mixed-precision inference (INT8, FP8, FP4, BF16/FP16). - Experience releasing multi-target models across heterogeneous platforms. - Familiarity with SOTA autonomous driving perception algorithms — temporal 3D object detection, BEV, 3D Occupancy Networks — and multi-modal sensor fusion (vision, LiDAR, radar). - C++ and/or CUDA kernel development.
Perks of Being a Full-time Torc’r Torc cares about our team members and we strive to provide benefits and resources to support their health, work/life balance, and future. Our culture is collaborative, energetic, and team focused. Torc offers:
A competitive compensation package that includes a bonus component and stock options
100% paid medical, dental, and vision premiums for full-time employees
401K plan with a 6% employer match
Flexibility in schedule and generous paid vacation (available immediately after start date)
AD+D and Life Insurance
At Torc, we’re committed to building a diverse and inclusive workplace. We celebrate the uniqueness of our Torc’rs and do not discriminate based on race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, age, veteran status, or disabilities. Even if you don’t meet 100% of the qualifications listed for this opportunity, we encourage you to apply.
Our compensation reflects the cost of labor across several geographic markets. Pay is based on a number of factors and may vary depending on job-related knowledge, skills, and experience. Torc's total compensation package will also include our corporate bonus and stock option plan. Dependent on the position offered, sign-on payments, relocation, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits.
Hiring Range for Job Opening
US Pay Range
$139,000 - $166,800 USD
Job ID: 102947
What you'll do
- Architect and implement model conversion and compilation pipelines using tools such as ONNX, TensorRT, and torch.compile for deployment on edge devices (e.g., NVIDIA Orin).
- Maintain and evolve the model release registry, ensuring traceability and reproducibility across model versions and target platforms.
- Perform rigorous latency benchmarking and model quality parity evaluations to validate that deployed models meet safety-critical performance requirements.
- Compare metrics across platforms to verify accuracy and latency compliance before release.
- Communicate and collaborate with model development teams and broader stakeholders, ensuring your findings translate into reliable, actionable outcomes across the organization.
What they require
- Bachelor's Degree in Computer Science, Electrical Engineering, Robotics, or related field plus 4+ years of relevant experience; or Master's Degree plus 2+ years.
- Extensive experience with model conversion and compilation pipelines (ONNX, TensorRT, torch.compile) and performing rigorous latency benchmarking and quality parity validation.
- Hands-on experience deploying and testing models on edge hardware (e.g., NVIDIA Orin or similar embedded platforms).
- Experience maintaining a model release registry in a production environment.
- Ability to compare and interpret performance metrics across hardware platforms to validate models against strict latency and accuracy requirements.
Benefits
- A competitive compensation package that includes a bonus component and stock options
- 100% paid medical, dental, and vision premiums for full-time employees
- 401K plan with a 6% employer match
- Flexibility in schedule and generous paid vacation (available immediately after start date)
- AD+D and Life Insurance
Torc develops autonomous driving software for automated trucks and is part of the Daimler family. It has been a leader in autonomous driving since 2007.