Job Description

Job Description

Job Description

We are offering an exciting opportunity for a Lead Data Engineer in the Higher Education sector, based in Philadelphia, Pennsylvania. As a Lead Data Engineer, you will play a pivotal role in developing specific projects in line with business requirements, ensuring efficient data management. You will work closely with diverse teams to facilitate data-driven decision-making, and your role will be critical in designing, developing, and launching data ingestion processes and data products.

Responsibilities:

• Guide and mentor entry level engineers to enhance their skills and knowledge.
• Design and implement secure data pipelines and data products to meet business objectives.
• Troubleshoot data processes and queries and optimize them for efficiency and accuracy.
• Establish robust data governance, security, and data privacy practices to ensure data integrity and compliance.
• Interpret business requirements and translate them into precise technical specifications to align data solutions with business goals.
• Participate actively in project planning, identifying key milestones and resource needs to ensure project success.
• Work collaboratively as part of a cross-functional team to enhance data integration across the organization.
• Evaluate business needs and priorities in collaboration with the team to inform data solution development.
• Oversee production operation and support to ensure smooth data management operations.
• Drive the implementation of innovative data solutions to enhance data-driven decision-making.• Must possess extensive knowledge of Apache Kafka, Apache Pig, and Apache Spark
• Proficiency in various cloud technologies is required
• Able to effectively utilize data visualization tools and techniques
• Experience in implementing complex algorithms is a must
• Strong analytical skills and the ability to interpret data to provide actionable insights
• Familiarity with Apache Hadoop and its application in big data processing
• Must have experience in API development, specifically for data extraction and integration
• Knowledge and hands-on experience with AWS technologies is essential
• Must have a background in higher education or a related field
• Proven ability to lead and mentor a team of data engineers.

Job Tags

Similar Jobs