Skip to main content
Berlitz

Senior Machine Learning Engineer

RemoteGermany only
Published
Role
AI / ML
Experience
Senior
Employment
Full-time
Salary not disclosed
Check eligibility

Open to DE only. Set where you work from to check your eligibility.

No BS summary

Senior ML engineer with 5+ years shipping production ML systems. Needs production experience with ML frameworks, hosted LLM integrations, Git, AI coding tools, and Python/Julia plus Rust or Go preferred. Germany remote role building AI services for an online language-learning platform.

Core skills

Python/JuliaLLMMachine Learning

Required skills

PyTorch/JAX/TensorFlowGitPrompting

Optional skills

RustGoC++Model compressionQuantizationDistillationNLPASR

What you'll do

  • Build, evaluate, and productionize models across the ML lifecycle, from classical/statistical approaches to fine-tuning small, edge-friendly transformers.
  • Use metric-driven evaluation with human-agreement baselines where applicable.
  • Design and operate integrations with hosted LLM providers: prompt and evaluation design, LLM-as-judge patterns, provider routing/failover, and cost/latency tradeoffs.
  • Build and run models both on-device and in the cloud.
  • Choose deliberately between edge and cloud models based on latency, privacy, and cost.
  • Work across speech (ASR/TTS), NLP, and CV pipelines as the product requires.
  • Set up, maintain, and update ML services in production: serving constraints, monitoring, drift, and connecting offline model scores to real learner outcomes.
  • Do hands-on coding work, not just modeling.
  • Build and maintain the ETL pipelines that feed these models: pulling from storage and databases, cleaning and transforming data, and reducing noise in real-world learner data.
  • Work cross-functionally with the mobile and platform teams.
  • Provide model-serving APIs, evaluation harnesses, and AI architecture guidance.
  • Own the models and AI integrations powering speaking-practice and evaluation features.

What they require

  • 5+ years building and shipping machine learning systems to production, spanning classical ML and applied deep learning.
  • Rust or Go preferred; C++ also valued.
  • Python (or Julia) for data science, modeling, and exploratory analysis.
  • Framework-agnostic ML framework experience; real production experience in at least one of PyTorch, JAX, or TensorFlow is what matters.
  • Git for version control, code review, and collaborating across parallel teams.
  • Daily, hands-on use of AI coding tools/agents as part of how you build and ship, not an occasional aid.
  • Hands-on experience integrating hosted LLM providers into production systems: prompting, evaluation, cost/latency tradeoffs, multi-provider routing.
  • Comfortable building models from scratch and fine-tuning pretrained ones, choosing rigorously between them based on the problem's actual constraints.
  • Strong communication: explaining modeling tradeoffs to engineers and product impact to non-technical stakeholders.
  • Preferred: Model compression, quantization, or distillation for on-device deployment.
  • Preferred: Hands-on experience in a couple of NLP, speech (ASR/TTS), or CV; full expertise in every modality is not expected.
  • Preferred: Data ETL and manipulation experience: S3 or similar object storage, Postgres or other databases, data transformation, noise reduction.

Benefits

  • Full-stack perception. Speech, text, and CV all live under one small team: broad exposure rather than a narrow lane.
  • Greenfield. No legacy ML pipelines or technical debt; you help design the model-serving architecture from scratch.
  • Real constraints, real judgment. Edge deployment and multi-provider LLM routing mean the job is about tradeoffs, not just model accuracy.
  • High autonomy and low bureaucratic friction.

language education franchise with headquarters in Princeton, New Jersey

EdTechEnterpriseberlitz.com/
Salary not disclosed