Senior Machine Learning Engineer, Applied Science Data Frameworks

Adobe - San Jose, CA

Hiring: Senior Machine Learning Engineer, Applied Science Data Frameworks Company: Adobe Location: San Jose, CA Job Posted Time: 2026-09-17 09:15:29 Target Skills & Keywords : AWS, Apache, Azure, CI/CD, Data Pipeline, Databricks, Docker, MLOps, Machine Learning, OpenSearch, PyTorch, Python, SQL, Spark, Systems Design, TensorFlow About the job Experience: •5-6 years of professional experience building and operating distributed systems or data infrastructure in production environments. •6 years of professional experience building and operating distributed systems or data infrastructure in production environments. Required Skills: •If you're excited about building distributed data frameworks, optimizing data pipelines at scale, and growing your expertise in ML infrastructure, we'd love to hear from you. •Contribute to building and maintaining distributed training data loaders that handle multi-source data ingestion, temporal sampling, and real-time transformations for large-scale model training workflows. •Help implement and maintain feature enrichment pipelines and dataset registry systems that support multimodal model training across images, video, documents, and text. •Build and maintain batch inference pipelines for large-scale feature extraction, processing assets through distributed GPU clusters with queue management and fault tolerance. •Develop data processing systems using frameworks like Apache Ray, Spark, DuckDB, or similar distributed computing tools for SQL-based data ingestion and Apache Arrow-based storage formats. •Support semantic search capabilities and vector database infrastructure (e.g., OpenSearch, LanceDB) for dataset discovery and embedding-based retrieval. •Contribute to CI/CD infrastructure for ML systems including self-hosted runner management, Docker image builds, automated testing pipelines, and deployment automation. •Partner cross-functionally with ML research teams to translate training requirements into reliable, scalable data loading and preprocessing infrastructure. Compensation: •$151,800 - $265,350 / year •In addition, certain roles may be eligible for long-term incentives in the form of a new hire equity award Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don't miss this opportunity to join a forward-thinking team!