Data Engineer

Project Role : Data Engineer

Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.

Must have skills : Cloud Automation DevOps

Good to have skills : NA

Minimum 7.5 Year(s) Of Experience Is Required

Educational Qualification : 15 years full time education

Summary:

As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes to migrate and deploy data across various systems. You will collaborate with cross-functional teams to enhance data accessibility and reliability, contributing to the overall data strategy of the organization.

Roles & Responsibilities:

• Works largely independently within defined projects/work streams and is checked on end results.
• Has an executional role in design and development projects or acts as an expert tester who designs test scripts and provides overall project guidance and planning support.
• Advises internally on solving functional and technical problems regarding the assigned applications and Infrastructure.
  
  

Professional & Technical Skills:

• Must To Have Skills: Proficiency in Cloud Automation DevOps.
• Strong understanding of data pipeline architecture and design.
• Experience with cloud platforms such as AWS, Azure, or Google Cloud.
• Familiarity with containerization technologies like Docker and Kubernetes.
• Knowledge of scripting languages such as Python or Bash for automation tasks.
  
  

Primary Skills: ADF – Mastery, Databricks – Mastery, PySpark – Mastery, SQL – Mastery, GitHub & CI/CD – Mastery, Delivery Leadership Experience – Skilled, Performance Optimization – Skilled in optimizing SQL and data processing for performance improvement and cost reduction, Troubleshooting & Orchestration – Skilled, Testing – Ability to design and execute comprehensive unit testing strategies, AAS (optional)

Secondary Skills: Power BI, Log & Analytics Review – Ability to interpret and analyze system logs, Power Apps / Power Automate, Databricks: Unity Catalog, SQL Endpoints, Delta Live Tables, PBAC / RBAC

Additional Information:

• The candidate should have minimum 7.5 years of experience in Cloud Automation DevOps.
• This position is based at our Bengaluru office.
• Minimum: 6-8 year(s) of experience is required
• Educational Qualification : 15 years full time education