Senior Data Engineer

Agile, Apache Parquet, Apache Spark, Cloud, Continuous integration, Data QA, Data engineering, Data storage, Data visualization, DevOps, Financial services, Informatica, Java, Jersey, Jupyter, Kanban, Lean methodology, Linear algebra, Machine learning, Microsoft Power BI, Microsoft Windows Azure, Probability, Product development, PyTorch, Python, R, SAFE, SQL, Scala, Scalability, Scrum, Software, Software development, Statistics, Tableau, Talend, TensorFlow, VIA, Visualization, scikit-learn
Full Time
Depends on Experience

Job Description

Senior Data Engineer

PETADATA is looking for Senior Data Engineer to work with one of our Clients
in New Jersey.

Roles & Responsibilities:

  • 10 +years of experience in Informatica and Talend.
  • 8+years of experience in Cloud-Native Data technologies, preferably in certifications in Azure Synapse.
  • 5+ years of hands-on coding experience in Java, Python, R, and Scala and Machine Learning libraries like Scikit-Learn, Pytorch, and TensorFlow
  • 4+years of experience in Spark & Spark SQL and Databricks.
  • 4+years of experience with the end-to-end DevOps CI/CD pipelines
  • 3+ years of experience in machine learning and analytical techniques to create scalable solutions for business problems.
  • You must have Hands-on expertise in Jupyter Notebooks, wrangling & statistical inferencing data using Pandas, and feature identification.
  • Ability to make architectural decisions that enable scalability of data platforms and create intuitive, testable, maintainable, secure, and efficient code.
  • Should Be able to establish scalable, efficient, automated processes for large dataset analysis, model development, and validation.
  • Expertise in data noise removal, augmentation, and visualization using statistical methods, experience in ensuring data quality via cleaning techniques, and tuning models and hyper parameters.
  • Strong mathematical background including linear algebra, probability theory, and statistics.
  • You must have 6+years of experience in data visualization tools like Tableau and PowerBI and work with data storage formats like Parquet.
  • Financial services industry experience preferred.
  • Experience in the day-to-day practicalities of Agile software Product Development Lifecycles such as Scrum, SAFe, DAD, Lean-Agile, Kanban, etc.


Note:  Remote until Covid -19

If you are interested and meet the above job requirements, please submit your resume.

After carefully reviewing your experience and skills, one of our Hiring team members will
contact you on the next steps.

Dice Id : 90751012
Position Id : 6856367
Originally Posted : 2 months ago
Have a Job? Post it

Similar Positions

Senior Big Data Engineer
  • Atyeti
  • New York, NY, USA
Sr. Programmer Analyst - Big Data
  • Norgate Technology Inc
  • Jersey City, NJ, USA
Data Engineer
  • VDeploy Consulting LLC
  • Jersey City, NJ, USA
Data Engineer
  • Atyeti
  • New York, NY, USA
Data Engineer
  • Atyeti
  • New York, NY, USA
Big Data Engineer- Python
  • CitiusTech
  • New York, NY, USA
Data Engineer
  • Infinity Consulting Solutions
  • New York, NY, USA
Data Engineer with Hadoop & Machine Learning
  • Kodo Digital Systems Inc
  • Clifton, NJ, USA
Sr. Data Engineer
  • STIAOS Technologies Inc
  • New York, NY, USA