Lead Data Engineer

CommunityAmerica Credit Union is seeking a strong and experienced Lead Data Engineer as part of its Data Platform team to build scalable enterprise data solutions that drive strategic business outcomes. The goal of the Data Platform Team is to execute on a data and analytics strategy that enables a personalized member experience and helps achieve CommunityAmerica’s membership growth, engagement, and well-being strategic goals.

As a Lead Data Engineer in the Data Platform team, you will partner with Product Owners on strategic initiatives, understand business and functional requirements, provide hands-on technical leadership to the engineering team, and ensure high-quality, on-time deliverables. You will also lead the iterative design and development of our cloud data warehouse, design, develop, and maintain data pipelines to support Data Science, Business Intelligence, and business operations, as well as guide the data engineering team in adhering to quality standards, processes, and methodologies while supporting them in overcoming technical challenges.

Duties & Responsibilities:

• Collaborate with Product Managers and stakeholders to understand CommunityAmerica’s data needs.
• Translate business requirements into technical specifications and design data models alongside Product and Data Architecture.
• Design and implement data pipelines for real-time and batch data using tools like Databricks, Azure Data Factory, and SSIS.
• Take technical ownership of projects, ensuring scope, quality, and timelines are met.
• Provide leadership to the data engineering team through mentoring, coaching, and fostering collaboration.
• Troubleshoot and resolve complex technical issues and challenges.
• Implement coding standards and conduct code reviews to ensure quality.
• Utilize effective source code management and CI/CD best practices for data pipeline deployment.
• Work with Data Architects to enhance data integration and storage design.
• Contribute to the continuous improvement of existing data architecture and frameworks.
• Assist in developing data governance and management solutions.
• Stay updated with cloud data technologies and best practices to enhance CommunityAmerica’s Data platform.
• Promote honest and open communication and demonstrate behaviors aligned with the credit union’s values and leadership characteristics.

Requirements:

• Education: Bachelor’s Degree or higher in Computer Science, Engineering, or related field.
• Experience:
  • 10+ years in data engineering and data warehousing.
  • 5+ years of cloud data engineering and big data experience, preferably in Azure.
• Skills:
  • Experience with cloud data engineering and data warehouse technologies (Azure, Google, AWS preferred).
  • Strong programming skills in Python and SQL for data processing and automation.
  • Technical skills in big data and integration technologies, including Spark, Kafka, Databricks, Azure Data Factory, and SSIS.
  • Experience in designing and building cloud and on-prem data warehouses, with Lake house architecture preferred.
  • Proficient in data modeling for transactional and analytical needs, with NoSQL databases as a plus.
  • Development experience in SQLServer, including query optimization.
  • Familiarity with source control applications (Azure DevOps) and CI/CD processes (Jenkins).
  • In-depth knowledge of data management principles including governance, security, and quality.
  • Experience delivering data solutions iteratively using Agile Scrum framework.
  • Ability to provide guidance and mentorship to a team of data engineers.
  • Outstanding analytical and conceptual thinking abilities.
  • Excellent written and verbal communication skills.
  • Able to collaborate effectively with cross-functional teams, stakeholders, and senior management.
  • Strong interpersonal skills for resolving conflicts and miscommunications.
  • Adaptability in ambiguous technology situations.

Preferred Knowledge, Skills, and Abilities:

• Financial industry knowledge.
• Development experience with Power BI and SSRS/Power BI Paginated reports.