Microsoft - Data Engineer - Remote || W2 role

Hi Sir,

Please find the requirement below , If you find yourself comfortable with the requirement please reply with your updated resume and I will get back to you

Position               :          Data Engineer

Location              :          Remote

Duration              :         6-12 Months

Interview            :          Phone and Skype

W2 role

Candidates from FAANG, Magnificent Seven, and MANGO will get priority. Followed by candidates that come from technology companies

Job Description:

Must haves:
Azure Data Engineering
Scala
spark

Job Description:
Top 3 Must-Have Hard Skillsets

1. Big Data Platform Experience && Minimum 5 years
   Cosmos (MapReducer), Azure data stack (HDI, ADLS Gen2), Spark/Scala.
   
   2. SQL + High-Level Programming Language && Minimum 5 years
   SQL queries plus experience in C#, Scala, Java, or Python (flexible, not a deal breaker).
   
   3. CICD, Debugging && Troubleshooting — Minimum 5 years
   Strong debugging, monitoring, and engineering lifecycle skills.

Typical Day

Will work with one of the engineers and engineering manager && responsible for feature design, development, validation, CI/CD, bug fixes, troubleshooting && debugging issues
Follow engineering practice and deployment rules,
SAW device is needed

Key Projects
• Security work: fixing code security issues, updating identities/secrets, ensuring secure endpoints.
• Governance: data partitioning, physical access restrictions, compliance related updates.
• Feature innovation && continuous platform enhancements.
• Maintaining && improving pipelines across Cosmos (MapReducer) and Azure data platforms (HDI, ADLS Gen2, Spark).

Typical Task Breakdown && Operating Rhythm
• 15–20% security-related fixes (code vulnerabilities, endpoint issues, secret rotation).
• Governance && compliance work (data partitioning, access control).
• Writing, modifying, && debugging code and services.
• CICD, monitoring, && standard engineering lifecycle practices.
• Mostly heads down execution work, following a task list && completing high priority deliverables quickly.
• Collaborating with FTEs who && will help onboard and accelerate ramp up.
• Using SAW device access for AME domain work (pre prod/prod as allowed).

Ideal Background

Distributed system design && implementation, BIG DATA platforms knowledge, CI/CD processes, debugging && troubleshooting skills

Disqualifiers
• Long ramp up timeline or lack of experience && large scale data platforms.
• No experience && high reliability data engineering environments.
• Inability to work independently && heavy execution demands.
• Lack && any programming language + SQL exposure (manager expects at least a foundational high level language).

Best vs. Average Candidate
• Best: Has 5–7 yrs && large scale data engineering (Cosmos, Azure, Spark).
o Strong SQL + one high level language (C#, Scala, Java, Python).
o Prior Microsoft experience (S360, security expectations, internal processes).
o Very fast ramp up && can immediately execute tasks independently.