Job Description

Posted on:

October 27, 2024

We are looking for highly-motivated individuals to join Plains All American, an industry-leading transportation and midstream provider specializing in transportation, storage, processing, and marketing solutions for crude oil and natural gas liquids (NGLs). Headquartered in Houston, Texas, we own an extensive network of pipeline transportation, terminalling, storage, and gathering assets across key producing basins and major market hubs in the United States and Canada. We average more than 6 million barrels per day of crude oil and NGL in our Transportation segment.

Position Summary: Plains is initiating new initiatives within the Enterprise Data Engineering team, seeking an experienced Azure Data Engineer. Reporting to the Data Engineering Manager, the Sr Data Engineer will lead the technical direction of a delivery team, ensuring alignment of technical deliverables with business requirements and enterprise architecture principles. This role emphasizes an entrepreneurial spirit, creative, and critical thinking.

Core Focus Areas:

  • Development: Collaborate with data architects and stakeholders to design and develop scalable and efficient data solutions on the Azure platform, including data ingestion, transformation, storage, and visualization.

Job Responsibilities:

  • Define and drive the data engineering strategy, aligning data initiatives with business goals in collaboration with senior leadership.
  • Establish software development standards and oversee code reviews for technical execution, including collaboration with AMS team members.
  • Lead design workshops to fulfill functional and non-functional requirements effectively.
  • Develop and maintain advanced data engineering processes using Spark, Python, Scala, Databricks, and Azure Data Factory.
  • Implement Azure services for managing data pipelines and data processing workflows, including:
    • Azure Data Factory
    • Azure Synapse Analytics
    • Azure Databricks
    • Azure SQL Database
    • Azure Cosmos DB
  • Oversee data security measures and ensure compliance with data privacy regulations and industry standards.
  • Monitor and optimize the performance of data solutions, addressing bottlenecks and fine-tuning queries.
  • Provide architectural and design direction to development and AMS teams, translating business requirements to design specifications.
  • Ensure quality integration between systems and implement standards, best practices, and accountable technical delivery of data solutions.
  • Act as a technical escalation point for coordination across IS Operations and integration teams.

Position Requirements:

  • Bachelor’s degree in Math, Computer Science, Engineering, Business Administration, or relevant practical experience preferred.
  • 10+ years of experience in data engineering or software engineering with a proven track record of leading successful data initiatives in large organizations.
  • Strong communication skills, proficiency in Azure Synapse Analytics, Azure Data Factory, and Azure Databricks.
  • Experience in data modeling, data warehousing, and data lake design and implementation.
  • Proficient in programming languages such as SQL, Python, or Scala for data manipulation and scripting.
  • Knowledge of data integration techniques, ETL processes, and pipeline orchestration. Familiarity with software engineering best practices would be an asset.
  • Knowledge of AI and ML is a plus, along with experience with agile delivery frameworks.
  • Cleared criminal history and satisfactory reference checks required.
  • Compliance with the Company’s drug and alcohol policy, including pre-employment testing.

At Plains, our employees are our most valuable asset. We offer competitive compensation and a comprehensive benefits program designed to promote health, safety, and well-being. We respect our employees' need for personal and family time, reflected in our benefits program. Thank you for your interest; however, only those selected for an interview will be contacted. By submitting your resume, you consent to the collection, use, and necessary disclosure of the personal information you provide during the application and selection process.

Secret insights

Plains All American, with 2426 employees, is ramping up! 60% growth in engineering signals a demand for tech talent. They’ve just boosted HR – a nod to caring for their team. Ideal for AI pros eyeing stability and growth!