Azure Data Engineer

Desired Competencies (Technical/Behavioral Competency)

Must-Have

·         Strong hands-on experience with Databricks (Delta Lake, Jobs, Workflows, Notebooks) 

·         Advanced Python for data engineering (PySpark, data transformations, optimization) 

·         Apache Spark concepts – batch & streaming processing 

·         Strong SQL skills for analytics and data modelling 

·         Experience with Azure Data Platform (ADLS Gen2, Azure Data Factory, Azure Synapse) 

·         Data Modelling (Star/Snowflake), ETL/ELT pipeline design 

·         CI/CD, version control (Git), and Agile delivery

Good-to-Have

• Experience with Delta Live Tables, Unity Catalog
• Streaming platforms (Event Hubs, Kafka)
• Exposure to IoT / Manufacturing / Supply Chain data
• Experience with data quality, data governance, and observability tools