Hiring: Lead Data Engineer - Databricks Company: Capgemini Location: New York, NY Job Posted Time: 2026-09-16 16:57:07 Employment Type: Full-time / Hybrid Target Skills & Keywords : Agile, CI/CD, Data Pipeline, Databricks, Delta Lake, ELT, ETL, MySQL, Root Cause Analysis, SQL Server, Spark, TDD About the job Required Skills: •This role will lead the design and implementation of modern data pipelines, mentor engineering teams, and collaborate closely with business and technology stakeholders to deliver reliable, scalable, and high-performing data solutions. •Databricks Data Engineering & Data Ingestion •Design and implement enterprise-scale data ingestion frameworks using Databricks Native Data Loader, Lakeflow Connect, and other Databricks-native capabilities. •Build and optimize batch and streaming data pipelines for ingesting data from Oracle, MySQL, SQL Server, APIs, and other enterprise data sources. •Develop robust ELT/ETL pipelines leveraging Databricks, Spark, Delta Lake, and cloud-native technologies. •Implement end-to-end data movement, transformation, validation, and monitoring solutions. •Lead architectural decisions related to data ingestion, storage, processing, and governance. •Create and maintain optimal data pipeline architecture. Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don't miss this opportunity to join a forward-thinking team!