Overview In this role you will design and deliver scalable big data solutions leveraging Hadoop and related tools to meet client needs. You will work within a collaborative IT team, shaping data platforms and analytics capabilities for enterprise environments. You will handle requirements gathering, design, and hands-on development, mentoring teammates as needed. You will operate in a fast-paced setting, driving impactful data engineering projects that support business decisions.
Responsibilities- Gather and translate requirements for scalable big data solutions with Hadoop
- Work with the Hadoop ecosystem (Cloudera/HortonWorks/MapR) and NoSQL databases (HBase, Mongo, Cassandra)
- Develop and implement using Spark, HBase, Hive, Sqoop, Oozie, Flume, Java, Scala, Pig, Python
- Hands-on implementation with Spark, M-R framework, databases and SQL
- Mentor and collaborate with team members; communicate clearly with stakeholders
- Proactively learn business context and drive improvements
Key requirements- Total experience 6-10 years
- At least 2 years in Hadoop
- Strong knowledge of Hadoop ecosystem and NoSQL databases
- Proficient in Spark, HBase, Hive, Sqoop, Oozie, Flume, Java, Scala, Pig, Python
- Experience with end-to-end design and development of big data solutions
- Strong analytical and problem-solving skills; good communication and teamwork
- Ability to work independently and mentor others
- teamwork
- communication
- initiative
- Hadoop
- Cloudera/HortonWorks/MapR
- NoSQL databases (HBase, Mongo, Cassandra)
