Hadoop and PySpark Data Engineer

The Big Data PySpark Lead Engineer is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities. Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process im

Role- Data Engineer Location- New York Job Description We are seeking an experienced Data Engineerto join our team and build robust, scalable data pipelines. In this role, you will: Design and implement scalable PySpark data pipelines for batch and streaming workloads Optimize Spark jobs and queries for performance and cost efficiency Build and maintain ETL/ELT processes following data engineering best practices Troubleshoot and resolve complex data pipeline and processing issues Collaborate wi

Role Name: AWS Data & Solution Engineer Location: NYC, NY Employment Type: Full-Time Mode: Hybrid (2-3 days from Office) Job Summary Are you committed to building data solutions, and being a Data Management expert? Are you passionate about data? Would you like to work on solutions with tangible impact to our clients? We are looking for an Sr AWS Data & Solutions Engineer with primary skills on Python & PySpark development who will be able to design and build solutions for one of our Fortu

Role: Data engineer- Databricks Location: Rutherford, NJ Job description: Good decision-making and problem-solving skills Solid understanding of Databricks fundamentals/architecture and have hands on experience in setting up Databricks cluster, working in Databricks modules (Data Engineering, Machine Learning and SQL warehouse). Strong experience in coding custom ETL pipelines using spark and deploy in Databricks. Knowledge of medallion architecture, DLT and unity catalog within Databricks.