Job Description:
- Infosys is seeking an experienced Senior GCP Data Engineer with strong expertise in Google Cloud Platform GCP BigQuery Dataflow Apache Airflow Cloud Composer Cloud Spanner and cloud native data engineering solutions
Key Responsibilities:
- Design develop and maintain enterprise scale data engineering solutions on Google Cloud Platform GCP
- Build scalable ETL ELT pipelines using Dataflow Apache Beam BigQuery and Cloud Composer Airflow
- Design and optimize BigQuery data warehouses for large scale analytics and reporting
- Develop batch and real time data pipelines using Dataflow and GCP native services
- Implement workflow orchestration using Apache Airflow Cloud Composer
- Design and manage data models and schemas in Cloud Spanner and BigQuery environments
- Integrate multiple data sources using GCP services such as Pub Sub Cloud Storage Cloud Functions and Dataflow
- Monitor troubleshoot and optimize pipeline performance reliability and scalability
- Collaborate with architects business stakeholders and development teams to deliver cloud data
Technical Requirements:
- 8 to 12 years of experience in Data Engineering Big Data and Cloud Data Platforms
- Strong hands on experience with Google Cloud Platform GCP
- Expertise in BigQuery for data warehousing analytics and performance optimization
- Strong experience with Dataflow and Apache Beam for large scale data processing
- Experience with Apache Airflow and or Cloud Composer for workflow orchestration
- Hands on experience with Cloud Spanner and distributed database concepts
- Strong programming skills in Python and SQL
- Experience building enterprise grade ETL ELT pipelines
- Knowledge of Pub Sub Cloud Storage Cloud Functions and other GCP services
- Strong understanding of data modeling performance tuning and data integration
- Experience with version control systems such as Git
- Knowledge of CI CD DevOps practices and Agile methodologies
Preferred Skills:
Technology->Cloud Platform->GCP Core Services,Technology->Big Data->Big Table->GCP