Junior Software Engineer – Inference
Neural Solutions - Columbia, MD
Hiring: Junior Software Engineer – Inference Company: Neural Solutions Location: Columbia, MD Job Posted Time: 2026-09-12 07:41:59 Target Skills & Keywords : AWS, ArgoCD, CI/CD, Docker, Grafana, Helm, Kubernetes, LLM, Prometheus, Python, vLLM About the job Experience: •3 years with Bachelor’s degree in a technical discipline or 7 years without degree Required Skills: •Procure, configure, and test new inference models, preparing them for release to our user base. •Develop in-house services and techniques to guarantee continual high-quality inference service for our customer. •Interface directly with model vendor teams and representatives to create reliable pipelines for closed-source model usage. •Partner cross-functionally with teammates on surge efforts to support short-term, high-priority inference needs from our customer. •Engage with other teams in our organization to establish solid infrastructure for our services and integrate LLM-powered tools for user needs. •Operational familiarity with Argo CD and/or other CI/CD frameworks. •Operational familiarity with AWS or other cloud service providers. •Demonstrated capacity to learn new technologies quickly. Qualifications: •Knowledge of and interest in hosting AI capabilities. Compensation: •$138,000 - $163,000 / year Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don't miss this opportunity to join a forward-thinking team!