Big Data Engineer

We have an immediate need for a full-time skilled and experienced Big Data Engineer with at least 5 years of experience, proficient in Hadoop, MapReduce, Java, and Apache Spark. The ideal candidate should possess a strong background in big data technologies, optimizing cluster configurations, and fine-tuning data processing workflows. As a member of our team, you will play a key role in configuring the clusters, improving performance, understanding data patterns, and recommending the best tools for our data needs.

Key Responsibilities:

• Design, develop, and maintain Hadoop and MapReduce jobs for large-scale data processing.
• Fine-tune and optimize existing MapReduce processes for improved performance while writing efficient Java and Spark code to manage and process complex datasets.
• Perform performance debugging to identify bottlenecks in data processing workflows and suggest improvements.
• Analyze data patterns and trends to ensure data integrity and accuracy.
• Evaluate and recommend suitable open-source tools and frameworks based on project requirements.