Hiring: Sr. BI Lead Databricks Engineer Company: Stefanini North America and APAC Location: Humble, TX Job Posted Time: 2026-09-16 20:39:31 Employment Type: Remote Target Skills & Keywords : Azure, Azure DevOps, CI/CD, Data Lake, Data Pipeline, Databricks, Delta Lake, Git, PySpark, SQL, Spark About the job Experience: •5 years of hands-on data engineering experience, with 3 or more years working in Databricks at production scale. •5 years of Power BI development experience including complex DAX, data modeling, and enterprise report design. •Minimum 5 years of hands-on data engineering experience, with 3 or more years working in Databricks at production scale. •Minimum 5 years of Power BI development experience including complex DAX, data modeling, and enterprise report design. Required Skills: •Serve as the primary subject matter expert (SME) and internal champion for Databricks across the organization. •Architect, build, and maintain scalable data pipelines using PySpark, Delta Lake, and Databricks Workflows. •Implement and enforce the Medallion architecture (Bronze / Silver / Gold) for structured data layering. •Manage Databricks Unity Catalog for data governance, access controls, and data lineage tracking. •Optimize cluster configurations, job scheduling, and compute costs to ensure platform efficiency. •Establish CI/CD best practices for Databricks notebooks and jobs using Azure DevOps or equivalent tooling. •Partner with data engineers, architects, and business stakeholders to define data contracts and SLAs. •Monitor pipeline health, data quality, and platform performance; resolve issues proactively. Qualifications: •Expert proficiency in PySpark, Spark SQL, and Delta Lake including schema evolution, file optimization, and VACUUM operations. •Deep working knowledge of Medallion / Lakehouse architecture patterns and best practices. •Proven ability to architect and manage enterprise-grade semantic models and datasets connected to cloud data platforms. •Applied hands-on capability in Azure Data Lake Storage, Azure Data Factory, or equivalent cloud data services. •Strong SQL skills including complex joins, CTEs, window functions, and query performance tuning. •2 or more years of experience leading, mentoring, or managing BI developers; offshore team management experience strongly preferred. •Demonstrated ability to manage workload, quality standards, and delivery timelines across distributed teams. •Excellent written and verbal communication skills with the ability to present technical findings to non-technical stakeholders. •Demonstrated capacity to manage competing priorities and deliver consistent results in a fast-paced, remote environment. •Bachelor's degree in Computer Science, Information Systems, Data Engineering, or a related field preferred; equivalent professional experience considered. Compensation: •Flexible work environment (work from home / hybrid options) Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don't miss this opportunity to join a forward-thinking team!