Job Description:

• Lead a team of data engineers in the design and implementation of big data solutions using PySpark.
• Collaborate with crossfunctional teams to understand business needs and develop datadriven solutions.
• Design and implement scalable and robust data pipelines using PySpark.
• Ensure data accuracy and integrity by implementing data validation and quality checks.
• Mentor and coach team members in PySpark and big data best practices.
• Stay uptodate with the latest developments in big data technologies and incorporate them into the teams workflow.

Requirements

Requirements:

• 8 years in Pyspark/ Data engineer development and implementation
• Bachelors or Masters degree in Computer Science Engineering or a related field.
• Proven experience as a PySpark Lead or similar role.
• Expertise in PySpark and big data technologies such as Hadoop Hive and Spark.

Requirements- Bachelor s or master s degree in computer science, Engineering, or a related field. Previous experience of 5+ years in Project management roles, preferably within software development projects. Strong leadership and team management skills, with the ability to motivate and guide technical teams towards project success. In-depth knowledge of software development methodologies, including Agile, Scrum, or Kanban. Excellent communication skills, with the ability to interact effectively with technical teams, stakeholders, and senior management. Experience in managing multiple projects simultaneously and prioritizing tasks based on business needs. Strong problem-solving and decision-making abilities, with a focus on delivering solutions to complex technical challenges. Familiarity with project management tools and software development lifecycle tools. Certifications in project management (PMP, PMI-ACP) or Agile methodologies (Scrum Master, SAFe) are a plus.