Python Pyspark

We are seeking a Data Engineer to join our team at CMS. This role requires a software engineer proficient in data, responsible for building and maintaining the CMS data warehouse utilized for reporting and analytics throughout the company. The data engineer will collaborate with both technical and business teams to discover opportunities for better data utilization, transforming diverse data sources into reliable, structured formats that address CMS's different business needs.

Duties and Responsibilities:

• Collaborate with the team to develop features for the data platform and consolidate data assets.
• Build, maintain, and optimize data pipelines using Spark.
• Advise and coach other data professionals on standards and best practices.
• Define and develop company data assets.
• Migrate CMS's data platform into Chase's environment.
• Partner with business analysts and solutions architects to create technical architectures for strategic enterprise projects.
• Build libraries to standardize data processing.
• Embrace continuous learning and knowledge sharing among peers.
• Implement process automation where applicable.

The Ideal Candidate:

• 5 years of experience in a data engineering role.
• Proficiency in Python (or similar languages) and SQL.
• Strong background in building data pipelines with Spark.
• Excellent verbal and written communication skills.
• Strong analytical and problem-solving capabilities.
• Experience with relational databases, NoSQL databases, and cloud object stores.
• Experience in building data processing infrastructure in AWS.
• Bonus: Knowledge of infrastructure as code solutions, preferably Terraform.
• Bonus: Relevant cloud certifications.
• Bonus: Production experience with ACID compliant formats such as Hudi, Iceberg, or Delta Lake.
• Bonus: Familiarity with data observability solutions and data governance frameworks.

Requirements:

• Bachelor's Degree in Computer Science, Programming, or a related field (preferred).
• Legal authorization to work in the USA.

At Mindteck, we value caring relationships and foster a supportive environment, where over 1,000 talented and diverse professionals thrive. We offer a unique mix of challenges and opportunities, and we proudly support our team members every day. Join us and explore a rewarding career path.

Mindteck is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, religion, color, national origin, sex, sexual orientation, gender identity, age, status as a protected veteran, status as a qualified individual with a disability, or any other trait protected by law.