Apply for Azure Data Engineer Job

6 to 8 Years Of Relevant Experience

• Strong profile with experience of 5+ years in data engineering space.
• Person should have experience with Python scripting.
• Should have worked on spark jobs, which are written in python.
• Other experience which are mandatory are Azure Synapse, Azure Kusto and Azure fabric.
• Although, he mentioned that Azure fabric is a nice to have skill set.
• Azure Databricks, PySpark, ADF.
• Design and develop ETL processes based on functional and non-functional requirements in Databricks, python / PySpark within Azure platform.
• Understand the full end to end development activities from design to go live for ETL development in Azure platform.
• Recommend and execute improvements.
• Execute and provide support during testing cycles and post-production deployment, engage in peer code reviews.
• Apply automation and innovation on new and on-going data platforms that aligned to business strategies.
• Document component design for developers and for broader communication.
• Understand and adopt an Agile (SCRUM like) software development mindset.
• Follow established processes/standards, business technology architecture for development, release management and deployment process.
• Design, develop and implement reporting platforms and complex ETL frameworks that meet business requirements.
• Provide data analysis and requirements within enterprise platform.
• Develop, maintain knowledge of data available from upstream sources and data within various platforms.

Must-have skills

• Azure Databricks, Azure Data Factory.
• Python / Spark / Pyspark / Shell Script.
• Synapse.
• 5+ years of experience in ETL/Data area with minimum of 3 years of development experience in above technologies (PySPark, ADB, ADF) is must.
• SQL, Working experience with data modeling, relational modeling and dimensional modeling, Data Warehousing, ETL.
• General knowledge about file formats (e.g. XML, CSV, JSON), databases (e.g. MS SQL, Oracle) and different type of connectivity is also very useful.
• Data files movement via mailbox.
• Source-code versioning/promotion tools, e.g. Git/Jenkins.
• Good communication skill, team player.

Nice-to-have skills

• Microsoft Azure certified.
• Data Engineer (or Azure-Fundamentals certificate and data engineering hands-on experience in Azure)Experience in Agile environment, JIRA/Confluence tools.