Job Description

Posted on:

October 28, 2024

Tronic is at the forefront of transforming how enterprises connect with their customers. We specialize in advanced brand loyalty and customer engagement solutions, leveraging data-driven insights to build meaningful, lasting customer relationships. Our platform is designed to handle large-scale data across multiple touchpoints, providing businesses with deep analytics and actionable insights. We’re looking for a Senior Data Engineer who will play a pivotal role in managing our data platform and analytics infrastructure. This role is critical in ensuring the reliability, performance, and scalability of our data ecosystem, which powers our loyalty and customer engagement solutions for enterprises across industries like retail, hospitality, and consumer goods.

What You’ll Do:

  • Oversee data architecture, data pipeline performance, and scalability of our customer data platform, collaborating closely with engineering, analytics, and product teams to design and maintain the infrastructure for:
    • Data pipelines
    • Data lakes
    • Large-scale OLAP databases (e.g., ClickHouse, Amazon Redshift, Snowflake, Postgres) for high-performance analytics
  • Implement and optimize event streaming pipelines using Kafka for real-time data stream management.
  • Manage and scale Elasticsearch clusters for efficient indexing and retrieval of large datasets.
  • Ensure adherence to data governance and schema management practices to maintain data quality and compliance.
  • Develop and maintain data lake architectures using AWS technologies (e.g., Amazon S3, AWS Glue) for efficient data ingestion and storage.
  • Define data schema with product teams while managing schema evolution to support new features.
  • Monitor and ensure availability, security, and performance of the data platform, proactively addressing issues.
  • Automate infrastructure and data pipeline deployments using Terraform, AWS CloudFormation, or Ansible.
  • Implement backup, disaster recovery, and failover procedures for mission-critical data systems using AWS services.
  • Assist in building data governance frameworks to comply with privacy regulations (e.g., GDPR, CCPA).
  • Support and optimize SQL and NoSQL databases for high-volume, high-velocity data processing needs.
  • Collaborate with engineering and data science teams for efficient data flow and system integration.

Our Tech Stack:

  • OLAP Databases: ClickHouse, Amazon Redshift, Snowflake, Postgres
  • Event Streaming: Kafka for real-time data ingestion
  • Search and Indexing: Elasticsearch
  • Data Pipelines: Apache Spark, AWS Glue, and Airflow
  • Cloud Infrastructure: AWS (e.g., Amazon S3, EC2, EKS, Lambda, RDS, DynamoDB)
  • Automation Tools: Terraform, Ansible, AWS CloudFormation, Docker
  • CI/CD Pipelines: GitHub Actions, Jenkins, CircleCI
  • Data Governance & Compliance: Industry best practices for data security and privacy

What We’re Looking For:

  • Experienced Data Engineer passionate about data architecture with:
    • Proven experience in designing and managing OLAP databases at scale, with knowledge of performance and query optimization
    • Expertise in managing event streaming pipelines using Kafka
    • Experience in deploying and optimizing Elasticsearch for analytics
    • Solid understanding of data governance, privacy, and compliance frameworks
    • Hands-on experience managing data lake architectures using AWS technologies
    • Strong knowledge of SQL and NoSQL databases, optimizing for high-throughput operations
    • Familiarity with Terraform, Ansible, Docker, and Kubernetes
    • Experience with cloud platforms (AWS preferred) and managing infrastructure as code
    • Ability to collaborate with cross-functional teams and strong problem-solving skills
    • A passion for data analytics and insights-driven architecture

What We Offer:

  • Dynamic environment fostering innovation and collaboration
  • Work on large-scale, complex data platforms for global brands
  • Competitive salary and equity options
  • Remote work opportunities with flexible hours for work-life balance
  • Comprehensive health, dental, and vision insurance
  • Generous and flexible time off policies
  • A team-first culture valuing your ideas and contributions

If you’re passionate about building and scaling high-performance data platforms and want to work with some of the best minds in the industry, join Tronic and help us shape the future of customer data and analytics.

Compensation Range: $185K - $200K

Secret insights

Tronic, with 41 employees, shows explosive growth! Engineering jumped 45%, sales up 30% – they're scaling fast. HR is 40% of the team, indicating strong people support. Perfect for AI talent!