DataOps Engineer

Job Title: RunOps Support – Data Pipelines

Job Type: Full-Time

Location: Remote

About Us

At micro1 we're building the world's first AI recruitment engine to match the world's most talented people with their dream jobs. As a core team member, you'll be at the forefront of AI innovation, contributing to our company's expansion while collaborating with Silicon Valley's fastest-growing companies. You'll thrive in a supportive, fast-paced, and innovative environment, tackling exciting challenges while unlocking unparalleled career growth and development.

Job Summary:

We are hiring RunOps Support Engineers for our Data Pipelines team to support and maintain critical ETL/ELT workflows. You will be responsible for real-time and batch data operations, job monitoring, pipeline health checks, and handling failures. This role requires deep understanding of Databricks, SQL, Snowflake, and AWS-based data ecosystems.

Key Responsibilities:

• Monitor, schedule, and troubleshoot batch and streaming data pipelines.
• Provide L1/L2 operational support for jobs in Databricks, Snowflake, and AWS-based data frameworks.
• Analyze job failures, logs, and resolve incidents or escalate as needed.
• Optimize SQL queries and ensure data integrity and freshness.
• Document and update SOPs, runbooks, and dashboards for pipeline health.
• Collaborate with data engineers to improve system reliability and performance.
• Lead efforts on root cause analysis and long-term fixes (senior/lead level).

Required Skills & Qualifications:

• Experience with Databricks for managing notebooks and pipelines.
• Strong in SQL and data analysis for debugging data failures.
• Hands-on experience with Snowflake data warehouse operations.
• Familiarity with AWS services used in data engineering workflows (S3, Glue, Lambda, etc.).
• Ability to handle production incidents, alerts, and automate resolutions.
• Strong problem-solving, documentation, and communication skills.