Urgent Need Lead Data Engineer//New York, NY Onsite Hybrid

Job Title- Lead Data Engineer

Job Location- New York, NY Onsite Hybrid

Long Term Contract

banking domain knowledge is a plus (optional)
Good in python & spark. Exp in databricks.
alteast 5 year in data engineering and building pipelines.
Good knowledge and experience in database modelling and database storage management
Good Coder

• Client is looking for Data Engineers with below job requirements:-
• High-Performance Culture: Be a key player in our high-performing team, surrounded by intellectual minds eager to collaborate and learn from each other.
• Key Contributions: Be a key contributor on one of top-priority initiatives, backed by strong senior management support. The platform is already making waves, and now it & your chance to steer it to new heights.
• Visible Impact: Make your mark by driving the platform forward, contributing to its success and widespread adoption. What We are Looking For:
• Experienced Data Engineer: We need an experienced data engineer with a proven track record of driving product success from an engineering perspective. We are looking for someone who has strong experience in building scalable and reliable data pipelines using Databricks and Spark. You will be working with various data sources and formats, and transforming them into valuable insights for our business
• Cultural Fit: Join our collaborative, respectful, and intellectually curious team.
• We are persistent problem solvers, communicative, results-driven, and positive-bringing accountability and ownership to everything we do. Your Role:
• Holistic Learning: Dive into the intricacies of our platform, mastering its ins and outs.
• Strategic Contributions: Design, develop, and maintain data pipelines using Databricks and Spark, and other cloud technologies as needed
• Hands-On Contribution: Tackle challenging tasks as a hands-on contributor, ensuring a seamless transition between various facets of this dynamic role throughout the workday.
• Optimize data pipelines for performance, scalability, and reliability
• Ensure data quality and integrity throughout the data lifecycle
• Collaborate with data scientists, analysts, and other stakeholders to understand and meet their data needs
• Troubleshoot and resolve data-related issues, and provide root cause analysis and recommendations
• Document data pipeline specifications, requirements, and enhancements, and communicate them effectively to the team and management
• Create new data validation methods and data analysis tools, and share best practices and learnings with the data engineering community
• Implement ETL processes and data warehouse solutions, and ensure compliance with data governance and security policies
• NY-based (min. 2 days in office each week: Tuesday plus one other day) Required Qualifications
• Bachelor's degree in Computer Science, Engineering, or related field, or equivalent work experience
• Strong background in Computer Science fundamentals including: algorithms, data structures, computational complexity, distributed computing
• 5+ years of experience in data engineering, preferably with Databricks and Spark
• Proficient in SQL and Python, and familiar with Java or Scala
• Experience with cloud platforms, preferably Azure
• Experience with data warehouse and data lake concepts and architectures
• Experience with data integration and ETL tools, preferably Azure Data Factory
• Strong analytical and problem-solving skills
• Excellent communication and teamwork skills Nice-to-Have
• Experience with big data technologies, such as Kafka, Hadoop, Hive, etc.
• Experience with data visualization and reporting tools, preferably Tableau

Regards,

Rahul Chauhan

(US IT Recruiter) Noralogic Inc.

109 E 17^th St, Cheyenne WY 82001

+1.| () |;/p>

USA: WY, MD, NJ;/p>

Mexico: Guadalajara, Monterrey

India: Noida UP

**WBE and MBE company**

** ISO 9001:2015**

**WY Top 50 Minority owned growing company**