Key Responsibilities:
• Data Engineering: Design, development, and implementation of data pipelines and solutions using PySpark, SQL, and related technologies.
• Collaboration: Work closely with cross-functional teams to understand business requirements and translate them into robust data solutions.
• Data Warehousing: Design and implement data warehousing solutions, ensuring scalability, performance, and reliability.
• Continuous Learning: Stay up to date with modern technologies and trends in data engineering and apply them to improve our data platform.
• Mentorship: Provide guidance and mentorship to junior data engineers, ensuring best practices in coding, design, and development.
________________________________________
Must-Have Skills & Qualifications:
• 4+ years of PySpark, SQL experience in data engineering
• 3+ years of hands-on Databricks experience
• 3+ years of hands-on Azure data engineering experience (ADLS, ADF)
• Proven expertise in SQL for querying, manipulating, and analyzing large datasets
________________________________________
Good-to-Have Skills:
• Databricks Pro Data Engineer Certification is a plus
• Azure Architect Certification is a plus
• Experience with Python and its libraries is a plus
• CPG/Retail industry experience is a plus
________________________________________
Education: BA/BS in Computer Science, Math, Physics, or other technical fields is a plus.