Data Engineer II

Overview

Do you have a relentless passion for data engineering and building platforms that enable decision science at scale Does processing petabytes of data every day excite you Do you enjoy designing complex workflows and pipelines that power measurement, insights, and visualization from real-world user data—ultimately driving experiments and recommendations that impact business metrics If so, we'd love to talk to you!

We are the Windows India Data team, part of the Windows and Web Experiences (WWE) engineering organization. Our mission is to leverage advanced data engineering, analytics, and data science to inform decision-making, drive product performance, and maximize business impact through the power of ML/AI. In short, we thrive on data to solve high-impact business problems for Windows! We're looking for a strong Data Engineer to help us foster and scale a data-driven culture across Windows.

As a Software & Data Engineer, you'll help build and deliver business intelligence for experiences running on 1.5 billion Windows devices. You'll partner closely with Data Scientists and Analysts to understand their challenges and design next-generation platforms and solutions that make decision-making seamless and scalable.

Responsibilities

• Authoring and design of Big Data ETL platforms and pipelines in SCOPE, Scala, SQL, Python, or C#
• Data extraction across a wide variety of data sources
• Data cleaning, preprocessing, and transformation for further analysis by data analysts
• Data Validation framework from source to endpoints ensuring data quality and integrity
• Enable the Data Scientists and Analysts to do more with data across all aspects of the development lifecycle.
• Contribute to a data-driven culture as well as a culture of experimentation across the organization.
• Provide new and improve upon existing data platform offerings with a fundamental understanding of the end-to-end scenarios.
• Enable Data Scientists and other partners to do more with data across all aspects of the development lifecycle by helping democratize data.
  
  

Qualifications

Required Qualifications:

• Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ year(s) experience in business analytics, data science, software development, data modeling, or data engineering
• OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, data modeling, or data engineering
• OR equivalent experience.
• Proven coding and debugging skills in C#, C++, Java, or SQL.
• Ability to work and communicate effectively across disciplines and teams.
• Familiarity with distributed data processing and analysis, such as Map-Reduce or Apache Spark.
  

Preferred Qualifications

• 4+ years of experience in engineering.
• 2+ years of experience in data engineering.
• Understanding and experience with data cloud computing technologies such as – Azure Synapse, Azure Data Factory, SQL, Azure Data Explorer, Power BI, PowerApps, Hadoop, YARN, Apache Spark.
  
  

Additional Details

#W+DJOBS

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.