Data Engineer

Project Role : Data Engineer

Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.

Must have skills : Data Governance

Good to have skills : NA

Minimum 7.5 Year(s) Of Experience Is Required

Educational Qualification : 15 years full time education

Summary:

We are seeking a highly experienced Data Engineering Team Lead / Assistant Manager with strong expertise in ETL, Big Data platforms.The ideal candidate will lead the design, development, and operational support of enterprise-scale data pipelines while also enabling metadata management and data lineage capabilities using Informatica EDC and AXON.

Roles & Responsibilities:

• Data Governance & Metadata Management
  
  

Implement enterprise data governance frameworks using Informatica EDC and AXON.

Configure data cataloguing, metadata harvesting, and automated lineage tracking.

Enable data discovery, data classification, and impact analysis across the data landscape.

Maintain business glossary, data policies, and governance workflows within AXON.

Support data stewardship processes and governance adoption across business units.

Integrate ETL pipelines with metadata and lineage tracking frameworks.

• Data Quality & Compliance
  
  

Implement data validation, reconciliation, and cleansing frameworks within ETL pipelines.

Develop automated checks for:

• Null handling
• Duplicate detection
• Data format validations
  
  

Ensure data accuracy, completeness, and consistency across systems.

Enforce data governance policies and regulatory compliance requirements.

Professional & Technical Skills:

• Production Support & Incident Management
  
  

Manage scheduling jobs

Perform root cause analysis (RCA) and implement preventive solutions.

Participate in on-call rotations and L1/L2 production support.

Ensure adherence to SLAs and operational compliance standards.

• Stakeholder Management
  
  

Drive automation, operational efficiency, and engineering best practices.

Enforce coding standards, version control, and release management processes.

• Must-Have Skills
  
  

Big Data & Hadoop Ecosystem

Hands-on experience with:

• Apache Hive
• Apache Spark
• Apache Impala
• Apache Sqoop
  
  

Experience working on Cloudera Data Platform

Additional Information:

• The candidate should have minimum 7.5 years of experience in Data Governance.
• This position is based at our Chennai office.
• A 15 years full time education is required.