Enterprise AI Systems Engineer
Jobgether - United States
Hiring: Enterprise AI Systems Engineer Company: Jobgether Location: United States Job Posted Time: 2026-09-17 08:40:03 Target Skills & Keywords : AI, AWS, CI/CD, GCP, GDPR, GitHub, IAM, Infrastructure as Code, JavaScript, LLM, Phoenix, Python, RAG, REST, SIEM, SaaS, Splunk, TypeScript, Vertex AI About the job Experience: •5+ years of experience in software, cloud, or platform engineering, including recent hands-on experience building and operating LLM-based systems. Required Skills: •Shape how AI tools are deployed and used across the organization, supporting a growing user base while balancing security, performance, cost, and adoption. •Build the infrastructure and connectivity that enable AI platforms to securely interact with internal systems and business workflows. •Also develop agentic automations, evaluate models, and establish guardrails that make AI-powered solutions reliable and predictable. •Working closely with cybersecurity, AI governance, finance, and business stakeholders, you will translate complex technical requirements into scalable standards and practical solutions. •Take end-to-end ownership of enterprise AI platforms and supporting infrastructure, ensuring they are secure, reliable, cost-effective, well-governed, and useful to teams across the organization. •Maintain the LLM gateway responsible for model routing, authentication, rate limiting, logging, and policy enforcement across providers. Qualifications: •The ideal candidate combines strong software, cloud, and platform engineering experience with hands-on expertise building and operating LLM-based systems. You should be comfortable working across infrastructure, AI platforms, security, and governance while communicating effectively with both technical and non-technical stakeholders. •Solid functional working knowledge of commercial and open-weight LLMs, including prompt engineering, evaluation, retrieval, and agentic architectures. •Applied hands-on capability in Model Context Protocol (MCP), MCP gateways, LLM gateways, or comparable API integration and middleware technologies. •Strong experience with AWS and GCP architecture, including IAM, networking, secrets management, and managed AI services. •Strong Python and/or JavaScript/TypeScript skills for building integrations, automations, and internal tooling. •Understanding of AI security and data governance fundamentals, including least privilege, data classification, DLP, and auditability. •Demonstrated capacity to explain technical concepts and decisions clearly to executives, finance teams, and other non-technical stakeholders. •Bachelor’s degree in a relevant field preferred, or equivalent professional experience. •Operational familiarity with self-hosted open-weight model deployment, vector databases, RAG pipelines, Splunk or other SIEM platforms, and cloud cost-management tools is advantageous. Compensation: •$126,000 - $206,000 / year •Medical, dental, and vision insurance Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don't miss this opportunity to join a forward-thinking team!