Responsibilities:
- Design and develop scalable data processing solutions using PySpark in Microsoft Fabric.
- Build and optimize ETL/ELT pipelines for processing large-scale structured and semi-structured datasets.
- Develop data ingestion, transformation, and aggregation workflows using Fabric Notebooks, Lakehouse, and Data Factory Pipelines.
Required Skills:
- Hands-on experience in designing and developing scalable data processing solutions using PySpark.
- Experience in building and optimizing ETL/ELT pipelines using Spark DataFrames and Spark SQL.
- Proficiency in developing data workflows using Fabric Notebooks, Lakehouse, and Data Factory Pipelines.
#AditiConsulting
# 26-04992