About the Role:
We are looking for an experienced Databricks Architect with 10 years to 15 years to design and implement scalable, cloud-native data platforms using the Databricks Lakehouse architecture. The ideal candidate should have strong expertise in big data technologies, cloud platforms, data engineering, and modern analytics solutions, with the ability to lead end-to-end architecture and guide engineering teams.
Responsibilities:
- Design and implement enterprise-scale data platforms using Databricks Lakehouse.
- Architect scalable batch and real-time data processing solutions.
- Lead data migration from legacy platforms to Databricks.
- Build robust ETL/ELT pipelines using Apache Spark and Databricks.
- Design Delta Lake architecture for high-performance data storage and analytics.
- Collaborate with business stakeholders to understand data and analytics requirements.
- Define data governance, security, and access control frameworks.
- Optimize Databricks workloads for performance and cost efficiency.
- Mentor data engineers and establish best practices for development and deployment.
- Work closely with DevOps teams to implement CI/CD for data pipelines.
- Support AI/ML teams by enabling scalable feature engineering and model deployment.
#LI-Hybrid #LI-SC1