Azure Data Engineer (ADF & Snowflake)
Job Description
We are seeking a senior Azure Data Engineer with deep Azure Data Factory and Snowflake expertise for a remote contract or contract-to-hire opportunity. You will design and maintain scalable, metadata-driven ETL/ELT pipelines that land data in Azure Data Lake Storage Gen2 and Snowflake, implement incremental processing with Streams and Tasks, and keep production pipelines reliable, secure and cost-efficient. The ideal candidate will have 12+ years of experience, strong troubleshooting skills, and a track record with large-scale production data platforms, along with hands-on Azure DevOps CI/CD, branching and release strategy experience. Requirements • 12+ years of data engineering experience • Strong hands-on experience with Azure Data Factory and Snowflake • Expert, performance-optimized SQL • Python / PySpark scripting • Experience with SCD Type 1 and Type 2, Star Schema and Snowflake Schema modeling • Experience with ADLS Gen2, Azure SQL Database and Azure Key Vault • Azure DevOps, CI/CD, branching and release strategies • Experience with large-scale production data pipelines, plus strong troubleshooting and analytical skills
Responsibilities
- Design, develop and maintain ETL/ELT pipelines using ADF and Snowflake
- Build ingestion pipelines into ADLS Gen2 and Snowflake
- Develop ADF pipelines, Mapping Data Flows, linked services, triggers and integration runtimes
- Build reusable, metadata-driven data integration frameworks
- Develop Snowflake schemas, stages, streams, tasks, stored procedures and functions
- Implement Streams and Tasks for incremental processing and CDC
- Implement data validation, reconciliation and data-quality checks
- Apply RBAC and data-security controls
- Monitor production pipelines, troubleshoot failures and perform RCA
- Drive performance tuning, cost optimization, logging and alerting