Lead Azure Data Engineer 100% Remote

Job description

*NEW* Lead Data Engineer, Azure

Lead Data Engineer, Azure

 

Responsibilities:


Develop new features and enhance existing data pipelinesContribute to solution design and technical design for new featuresSupport data pipeline workload in the Production environmentMonitor job execution, triage & troubleshoot job failures and other issuesMake code changes to fix production failures and deploy code in productionReport operations status to all stakeholders at regular cadence
 

Required Experience:


Data Engineering/Data Warehousing development/operations experience of at least 7 yearsAzure cloud experience of at least 3 years with ADF V2, ADF Data flows, Azure Databricks, SQLDB/Hyperscale, SQLDW, ADLS Gen 2 and other Azure servicesPython & PySpark developmentSQL development including PL/SQL, preferably SQL Server but another RDBMS may be fineManaging an offshore team
Preferred Experience:


Development using ETL tools like DataStage or InformaticaADF source code version control using Azure DevOps or GitExperience with Snowflake
 

Lead Data Engineer, Azure
Required Experience:


Data Engineering/Data Warehousing development/operations experience of at least 7 yearsAzure cloud experience of at least 3 years with ADF V2, ADF Data flows, Azure Databricks, SQLDB/Hyperscale, SQLDW, ADLS Gen 2 and other Azure servicesPython & PySpark developmentSQL development including PL/SQL, preferably SQL Server but another RDBMS may be fineManaging an offshore teamGood communication (verbal & written) & documentation skills
 

Preferred Experience:


Development using ETL tools like DataStage or InformaticaADF source code version control using Azure DevOps or GitExperience with SnowflakeCollaboration with business teamsExperience in fast paced & complex environments, including large enterprise settings
 

Responsibilities:


Develop new features and enhance existing data pipelinesContribute to solution design and technical design for new featuresSupport data pipeline workload in the Production environmentMonitor job execution, triage & troubleshoot job failures and other issuesMake code changes to fix production failures and deploy code in productionReport operations status to all stakeholders at regular cadenceIdentify opportunities to enhance, streamline, improve codebase and work with MGM Dev leads to make that happenMonitor infrastructure proactively and identify opportunities to improve operational efficiency, job execution performance and overall costPerform other job-related duties as requested