Hiring: Research Engineer - Model Evaluation & MLOps Company: Sciforium Location: San Francisco, CA Job Posted Time: 2026-09-03 00:12:43 Target Skills & Keywords : CI/CD, Hugging Face, LLM, MLOps, Machine Learning, Model Registry, PyTorch, Python, TensorFlow, TensorRT, Transformers, vLLM About the job Experience: •2+ years of professional ML or software engineering experience, including work on production ML systems, ML platforms, or MLOps infrastructure. Required Skills: •Rapidly integrate new internal and open-weight language and multimodal models into our GPU evaluation and inference environments. •Build automated benchmarks for model quality and systems performance, including latency, throughput, and memory usage. •Create standardized, reproducible comparisons across Sciforium models, external baselines, and runtime configurations. •Build and maintain experiment tracking, model registry, and versioning for models, datasets, and evaluation configurations. •Automate the path from research checkpoints to validated deployments through CI/CD and reproducible workflows. •Monitor model quality and systems performance, and diagnose failures or regressions across model and deployment pipelines. •Build reusable tools that help researchers launch evaluations, compare experiments, and reproduce results. •Profile end-to-end model workloads and collaborate with distributed systems, inference, and GPU kernel engineers on deeper performance issues. Qualifications: •Operational familiarity with Hugging Face Transformers or similar model libraries. •Experience enabling models on AMD GPUs and ROCm. •Contributions to open-source evaluation, model, or ML infrastructure projects. •Medical, dental, and vision insurance •Daily lunch, snacks, and beverages Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don't miss this opportunity to join a forward-thinking team!