Hiring: Data Engineer (WDP) Company: Bespoke Technologies, Inc. Location: Herndon, VA Job Posted Time: 2026-09-17 10:28:45 Target Skills & Keywords : AWS, Agile, Airflow, Azure, CI/CD, Data Pipeline, Databricks, Docker, ETL, Elasticsearch, IaC, Kubernetes, PySpark, Python, SQL, Scrum, Security Clearance, Snowflake, Spark, Terraform About the job Experience: •4+ years of experience in data engineering. Required Skills: •Design, develop, and maintain robust and scalable data pipelines for both new development and ongoing operations & maintenance (O&M). •Build new pipelines using modern, modular patterns like Databricks Delta Live Tables, adhering to established governance standards. •Implement reusable pipeline templates and automated monitoring patterns to ensure consistency and scalability across all data flows. •Utilize Infrastructure-as-Code (IaC) with tools like Terraform to create consistent and repeatable CI/CD deployments. •Integrate automated data quality checks and profiling using frameworks like Great Expectations to ensure data integrity and validate SLAs. •Troubleshoot pipeline issues, optimize performance, and contribute to the continuous improvement of O&M processes. •Participate in code reviews and create clear documentation for ETL mappings, code, and deployment processes. Qualifications: •Proficiency in Python, SQL, and Spark/PySpark. •Direct experience with the data platform. •Applied hands-on capability in Databricks Delta Live Tables and Terraform. •Operational familiarity with data orchestration tools (e.g., Airflow) and containerization (Docker, Kubernetes). •Knowledge of COTS and open-source data engineering tools such as NiFi or ElasticSearch. Interested candidates, please apply directly through the job posting on company's career page or try via AI auto apply on this platform. Don't miss this opportunity to join a forward-thinking team!