Job Description

Posted on:

October 31, 2024

We are looking for a Lead Cloud Engineer specializing in Azure, responsible for designing and implementing scalable, high-performance data engineering solutions using Azure Databricks and Azure Data Factory. This role involves leading complex cloud solutions and ensuring optimal performance, making it an excellent opportunity for those ready for new challenges.

Essential Job Functions:

  • Lead the design and implementation of complex cloud solutions on Microsoft Azure, focusing on integration with Databricks and Azure Data Factory.
  • Develop and maintain scalable and efficient data pipelines and architectures, ensuring optimal architecture and performance of applications deployed on Azure.
  • Provide expertise in cloud security, ensuring compliance with industry standards and company policies.
  • Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
  • Manage the full lifecycle of data and analytics solutions, from requirements gathering to deployment and maintenance.

Minimum Qualifications and Job Requirements:

  • Bachelor's degree in Science, Technology, Engineering, or Mathematics.
  • 7+ years of experience as a data engineer, with strong proficiency in Azure cloud services, Databricks, and Azure Data Factory.
  • 3+ years of experience designing and implementing data solutions using Azure Cloud.
  • Azure Data Engineering or Databricks Certification.
  • Strong knowledge of programming languages such as Python, SQL, or Scala.
  • Experience with data modeling, ETL/ELT development, data integration, and orchestration techniques.
  • Experience in designing and developing end-to-end data and analytics solutions leveraging Azure Data Lake, Azure Databricks, and Data Factory.

Nice to Have:

  • Experience designing scalable data analytics architecture to implement advanced analytics solutions, including machine learning and AI, for actionable insights.
  • Additional Azure Certifications such as Azure ML, Analytics Specialty, or Azure Solutions Architect.

Other Responsibilities:

  • Mentor and lead a team of cloud engineers, promoting best practices in cloud computing and continuous learning.
  • Conduct system troubleshooting and provide technical support as needed.
  • Stay updated with the latest developments in cloud technologies and introduce innovations and improvements to internal systems.

Secret insights

AB2 Consulting is scaling! With 62 employees, they've seen a 50% growth in engineering, screaming for tech talent. New hires in HR show they value their people. Ideal for AI pros seeking a supportive environment!