Big Data Engineer (Recommendation), BytePlus

We are looking for experienced professionals to join our R&D team for the BytePlus Recommend Platform at ByteDance. Our mission is to inspire creativity and enrich life, and we are committed to providing an environment that fosters innovation and growth. This role emphasizes the continuous evolution of our recommendation product's data architecture while leveraging the latest machine learning techniques.

About ByteDance: Founded in 2012, ByteDance has a suite of over a dozen products including TikTok, Helo, and Resso, with platforms specific to the China market, such as Toutiao, Douyin, and Xigua. Our goal is to create products that make connecting, consuming, and creating content fun and accessible.

Responsibilities:

• Continuously evolve the BytePlus Recommendation Product's data architecture.
• Participate in the full life-cycle of machine learning sample preparation, including:
  • Data ingestion
  • Validation
  • Transformation
• Collaborate with Machine Learning Engineers (MLEs) to deliver top-level recommendation solutions for To-B clients.
• Build cutting-edge indexing, feature engineering, and data storage solutions to support efficient machine learning algorithm iteration.
• Develop systematic processes and tools to optimize system costs and enhance overall stability and efficiency.

Qualifications:

• B.Sc or higher degree in Computer Science or related fields from accredited institutions.
• Proficient in developing batch and streaming big data applications using:
  • Spark
  • Flink
  • Kafka
• Strong programming skills in Java, Scala, and Python, with a solid foundation in computer science.
• Familiarity with modern big data ecosystems such as:
  • Yarn
  • Kubernetes (K8s)
  • HDFS
  • Hive
  • Iceberg/Hudi
  • HBase
  • ClickHouse
• Self-motivated learner with a strong sense of product ownership and agility.
• Experience in developing search, recommendation, advertising systems, or big data platforms is a plus.
• At least 1 year of relevant experience.

At ByteDance, we are committed to creating an inclusive workspace where employees are valued for their unique perspectives and skills. Our diverse environment reflects the communities we serve globally. Join us in our mission to inspire creativity and enrich life through our innovative products. If you're interested in this challenge, we encourage you to apply.