Spark Scala AWS

Role: Data engineer (Spark Scala AWS)

Primary skills:

Bigdata: 5-6 years of Hands-on experience in Hadoop / Spark (Scala or Python), Hbase, Hive, Sqoop.

Knowledge on Database architectures of RDBMS & No-SQL. Good in writing optimized SQL queries which give good performance.

AWS: Working knowledge on Lambda, EC2, ECS, EMR, Athena, S3.

Working knowledge on Git/bitbucket.

AWS Debugging: Very good at debugging issues in AWS CloudWatch

Hands-on and good coding skills with Scala or Python.

Experience in AWS including EMR, EC2, Terraform, Lambda, S3, Cloud watch, VPC

Experience in setup of Open shift Containerization Platform and Kubernetes cluster across the cloud platforms.

DevSecOps tools such as Ansible, Splunk, Dynatrace, Kubernetes, Confluence, Jenkins

High scalability projects involving on-prem and cloud-based

Experience with scripting languages Perl, Python, PowerShell, Bash

Previous experience testing across multiple platforms (API, web.)

Direct hands-on experience with ad hoc query programs (MySQL required, DB2 a plus), automated testing tools, and reporting software.

Experience in Linux Admin