Data Engineering & Pipeline Development
- Design
and develop scalable data pipelines.
- Build
batch and real-time data ingestion frameworks.
- Develop
ETL/ELT solutions using Azure services.
- Integrate
data from multiple sources including APIs, databases, files, and
enterprise systems.
- Implement
data quality and validation controls.
Azure Data Platform Development
- Develop
and manage Azure-based data platforms.
- Build
enterprise Data Lakes and Data Warehouses.
- Implement
cloud-native data solutions.
- Enable
analytics and AI-ready data architectures.
Data Modelling
- Design
dimensional models.
- Develop
star and snowflake schemas.
- Create
scalable analytical data models.
- Support
reporting and BI requirements.
Data Operations
- Monitor
and troubleshoot data pipelines.
- Ensure
pipeline reliability and performance.
- Optimise
storage, processing, and query performance.
- Maintain
operational documentation and support processes.
Collaboration
- Work
closely with Data Architects.
- Support
Data Scientists and AI/ML teams.
- Collaborate
with BI teams for reporting requirements.
- Participate
in Agile delivery teams.
Role
Engineer
Qualifications
BACHELOR OF TECHNOLOGY