Data Engineer

New York, NY, US • Posted 4 days ago • Updated 44 minutes ago
Full Time
On-site
Market
Fitment

Dice Job Match Score™

🫥 Flibbertigibetting...

Job Details

Skills

  • Must-Have Skills and Experience3-5 years in application support
  • data operations
  • or ETL/analytics platform support.Strong SQL and database skills
  • including writing complex queries and troubleshootin

Summary


Location: New York USA

Experience required is: 3 - 5 YearsPrimary (Must Have) Skills:Strong SQL and Database knowledge (Snowflake/Hadoop).Strong Python/Shell script knowledgeGood Communication skills. Secondary (Good to have) Skills:TWS SchedularAgile Development.Requirement:SummaryProvide L2 application/data operations support for analytics and ETL workloads. Focus on SQL-based investigation, monitoring scheduled jobs, basic Python/Shell automation, and clear stakeholder communication.Key ResponsibilitiesMonitor and support daily data pipelines and batch jobs across Snowflake/Hadoop environments.Investigate incidents and service requests using strong SQL; perform data validation, reconciliation, and root-cause triage.Develop and maintain lightweight Python/Shell scripts to automate health checks, log parsing, alerts, and routine recovery steps.Operate job schedules using TWS (IWS): monitor job streams, handle failures, perform safe restarts/reruns, manage dependencies and calendars as per runbooks.Own tickets end-to-end in the ITSM tool (e.g., ServiceNow/Jira): classify, prioritize, communicate status, and drive to closure with vendors and internal teams.Perform environment and application health checks, create/maintain runbooks and knowledge articles, and contribute to problem management and RCA documentation.Collaborate with L3 engineers, data engineers, and product owners; participate in Agile ceremonies and release/smoke validations as needed.Produce daily shift handovers and weekly operational reports.

Must-Have Skills and Experience3-5 years in application support, data operations, or ETL/analytics platform support.Strong SQL and database skills, including writing complex queries and troubleshooting performance on at least one platform; exposure to Snowflake and/or Hadoop (Hive/HDFS) preferred.Strong scripting with Python and Shell on Linux/Unix (file I/O, error handling, log parsing, simple APIs, scheduling fundamentals).Solid understanding of batch processing, data warehousing/ETL concepts, and incident management practices.Good communication skills: clear written updates, user/vendor coordination, and concise handovers.Familiarity with version control (Git) and working in ticketing systems (ServiceNow/Jira).Good-to-Have SkillsTWS/IWS (IBM Workload Scheduler) hands

#LI-ONSITE#LI-AS3
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10106616
  • Position Id: 63160
  • Posted 4 days ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

New York, New York

Yesterday

Full-time

USD 116,000.00 - 152,250.00 per year

New York, New York

Yesterday

Full-time

USD 116,000.00 - 152,250.00 per year

Hybrid in Jersey City, New Jersey

29d ago

Easy Apply

Full-time

65 - 75

Remote or Jersey City, New Jersey

Yesterday

Full-time

USD 142,320.00 - 213,480.00 per year

Search all similar jobs