Applied AI Data Analyst
Confido - New York, NY
Hiring: Applied AI Data Analyst Company: Confido Location: New York, NY Job Posted Time: 2026-09-10 12:53:12 Target Skills & Keywords : AWS, LLM, PostgreSQL, Python, R, Root Cause Analysis, SQL, Snowflake, dbt About the job Experience: •4 years of experience in a quantitative data analyst or AI evaluation role, working closely alongside AI/ML R&D teams. Required Skills: •As an Applied AI Data Analyst, you will bridge the gap between our massive, unstructured financial and operational datasets to our core R&D team. You will own the evaluation platform of our agentic workflows forecasting pipelines, as well as improve customer facing insights leading to mission-critical decisions. •This role is part of the Applied AI Research department, with options to advance to senior data science and AI/ML engineering roles. •New York, NY (In-Person | Relocation supported) •Algorithm & LLM Evaluation: Analyze edge cases, model predictions, hallucination rates, and extraction accuracy for our LLM-driven document processing systems and agentic workflows. •Root Cause Analysis: Dig deep into complex datasets (inconsistent financial documents, fragmented enterprise systems) to determine why an extraction or time-series model succeeded or failed. •Golden Dataset Curation: Define, curate, and maintain gold-standard evaluation datasets ("golden sets") for automated backtesting of AI agents and demand forecasting models. •Performance Monitoring & Evals: Build dashboards, data transformations, and evaluation harnesses to monitor system health, model drift, and AI performance metrics across release cycles. •Cross-Functional Collaboration: Partner directly with applied AI engineers, product managers and business operations managers to turn qualitative real-world problem definitions into quantitative product defining insights. Qualifications: •Proficiency with agentic workflows or multi-agent orchestration. •Operational familiarity with demand forecasting, time-series models, or statistical modeling. •Comfort in fast-moving, high-growth NYC startup environments. •Equity — own a meaningful piece of the company you’re helping build •Fully paid health coverage through Aetna — we cover 100% of employee premiums •Top-tier dental and vision coverage through Guardian •Carrot Fertility Pro — comprehensive fertility and family-forming support •12 weeks of paid parental leave •Unlimited PTO — plus regular 4-day holiday weekends we actually take •Paid relocation support — we’ll help you make the move to NYC Compensation: •$180,000 - $230,000 / year Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don't miss this opportunity to join a forward-thinking team!