Data Engineer With Azure Devops

Responsibilities

The Data Engineer is perform the development of the data pipeline from ingestion to consumption of data across NetCo. This includes following the chosen solution approach and tools. The role is also vital in supporting development and maintenance of best practices within tool, coding and working with data and analytics in an agile setup.

The responsibilities for this role include:

• Transformation of complex business problems into prototypes and actual products (following the minimum viable product mindset)
• Implement solutions to process data from multiple sources and systems to secure a high-quality data pipeline.
• Collaborate with our data scientists and digital engineers to map data to hypotheses.
• Ensure data architecture will support the requirement of the business
• Perform data modelling, mining, cleaning and production
• Improve data reliability, efficiency and quality
• Develop and implement the ETL and data cleaning processes

Description:-

Experience – 5+ years
Location – Pune/Bangalore – travel to fly Denmark location.
Notice Period – Immediate joiner/30 days
Budget – 25 lpa

Experience level 5+ years and the competencies includes :

• Experience in Azure DevOps and CICD Pipeline  .
• Experience in git/github.
• Experience in Data Factory and setup Data Factory integration runtime in On-premise.
• Experience in Azure tools like ADLS, ADF, DataBricks, Log Analytics .
• Experience in spark with scala and python.
• Good in automation using shell/python.
• Should have basic knowledge of networking concepts like subnetting, IP Address spaces, request flow, port opening, firewall.

Other Competence:

• Knowledge of development of data driven solutions and data pipelining and experience in delivering high quality Python code.
• Hold a master’s degree in engineering or computer science and knowledge within data engineering and software DevOps – perhaps with a PhD in one of the fields
• Have experience in cloud platforms as well as traditional data warehousing / ETL
• Strong knowledge around software design and high-quality coding principles.
• Experience with data engineering for business intelligence and advanced analytics on large amounts of data including streaming data. Preferably in a cloud environment is a plus
• Persistent with a holistic view on potential solutions

 CLICK HERE TO UPLOAD RESUME