Hiring: Data Engineer Company: BrickRed Systems Location: Frisco, TX Job Posted Time: 2026-09-16 18:16:17 Target Skills & Keywords : Azure, Data Pipeline, Databricks, Delta Lake, ETL, Event-Driven, PySpark, Python, SQL, Snowflake, Spark About the job Experience: •4+ years of experience in Data Engineering or related technical roles. •4+ years of experience with Databricks and Azure Data Factory (ADF) Required Skills: •Build and enhance data ingestion pipelines supporting large-scale batch and event-driven data paths. •Third-party enrichment vendors, digital platforms through Conversion API (CAPI), and Rewards/Promotions systems •Develop reliable ETL pipelines using •PySpark, SQL, Databricks, Snowflake, Python, and Azure Data Factory •Data validation, idempotency, replay/backfill, deduplication, and auditability practices. •Monitoring, alerting, dashboarding, and operational readiness •Troubleshoot Spark failures using logs and perform root-cause analysis rather than simple reruns. •Diagnose and optimize Spark performance issues involving shuffle, skew, partitioning, and workload performance privacy, compliance, and data governance requirements across pipelines and datasets. Qualifications: •FAANG or Top Product Company background is mandatory. •Strong hands-on experience with Data Engineering, SQL, Spark, ETL, and Python •Strong proficiency in PySpark and SQL •, including hands-on coding rather than orchestration-only experience. •In-depth knowledge of Apache Spark fundamentals •, including partitioning, skew, shuffle optimization, and troubleshooting through Spark logs. •For data modeling, analytics, and data warehousing workloads. •For data orchestration and Azure-native integrations. •In-depth knowledge of data engineering reliability patterns including validation, idempotency, replay/backfills, deduplication, and auditability •Knowledge of data governance, lineage, access control, PII handling, and privacy/compliance requirements Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don't miss this opportunity to join a forward-thinking team!