Key Responsibilities:
- 2 5 years of experience in Data Engineering Big Data development
- Hands on experience with Databricks platform
- Strong knowledge of Apache Spark PySpark Scala SQL
- Experience with data pipeline development ETL ELT
- Proficiency in Python and SQL
- Knowledge of data modeling and data warehousing concepts
- Experience working with large datasets and distributed systems
Technical Requirements:
- Primary skills Domain other solutions Finacle Virtual Lounge Grand Master
Additional Responsibilities:
- Experience with cloud platforms Azure Databricks AWS or GCP
- Familiarity with Delta Lake and Lakehouse architecture
- Experience with workflow orchestration tools Airflow Azure Data Factory
- Knowledge of CI CD pipelines for data engineering
- Exposure to streaming data Kafka Structured Streaming
- Experience with BI tools like Power BI Tableau
Preferred Skills:
Technology->Data Engineering->Databricks