Job Title: Data Engineer
Job Type: Full-Time
Location: On-site Hyderabad, Telangana, India
Job Summary:
We are seeking an accomplished Data Engineer to join one of our top customer's dynamic team in Hyderabad. You will be instrumental in designing, implementing, and optimizing data pipelines that drive our business insights and analytics. If you are passionate about harnessing the power of big data, possess a strong technical skill set, and thrive in a collaborative environment, we would love to hear from you.
Key Responsibilities:
- Develop and maintain scalable data pipelines using Python, PySpark, and SQL.
- Implement robust data warehousing and data lake architectures.
- Leverage the Databricks platform to enhance data processing and analytics capabilities.
- Model, design, and optimize complex database schemas.
- Collaborate with cross-functional teams to understand data requirements and deliver actionable insights.
- Lead and mentor junior data engineers and establish best practices.
- Troubleshoot and resolve data processing issues promptly.
Required Skills and Qualifications:
- Strong proficiency in Python and PySpark.
- Extensive experience with the Databricks platform.
- Advanced SQL and data modeling skills.
- Demonstrated experience in data warehousing and data lake architectures.
- Exceptional problem-solving and analytical skills.
- Strong written and verbal communication skills.
Preferred Qualifications:
- Experience with graph databases, particularly MarkLogic.
- Proven track record of leading data engineering teams.
- Understanding of data governance and best practices in data management.