Data Engineer

Title: Sr Data Engineer
Location: Parsippany NJ (Hybrid Onsite)(Locals to Tri-State only)
Duration: Full Time role
Interview: Video and F2F
 
Vendor’s Note: What they really want-
 
Candidate with data engineering experience, Python, AWS
experience in the design, development, and implementation of ETL solutions, data modeling, and construction of business intelligence and analytics solutions, including database design, core data architecture, and data transformation and processing systems. the Senior Data Engineer will be tasked with the analysis of business data and requirements, and the transformation of those requirements into data analytics solutions to support the business strategy  

Main responsibilities include:
• Requirements gathering, design, development, and implementation of business intelligence solutions which can be leveraged by end-users. 
• Hands-on development of ETL, internal/external data feeds and reporting solutions.
• Development of surveillance patterns and deep analytics processing solutions against big data stores.
• Design and development of data models, reports and visualization and analytics solutions needed to support dynamic business intelligence capabilities.
• Partner with Quantitative, Risk, and Business stakeholders to build enterprise datasets, including client-facing data products.
• Support of critical production systems, including, when necessary, off-hours support.

Qualifications
• Experience working independently with users to define concepts, information needs and functional requirements, specifications and database models.
• Significant experience in designing and developing data warehouses and ETL pipeline.
• Strong expertise in SQL/Advanced SQL and working with relational database systems (MySQL, PostgreSQL, Snowflake, or similar).
• Strong expertise with one or more programming language(s) (C++, Python).
• Strong expertise in Linux/UNIX and bash shell scripting.
• Significant experience processing large amounts of structured and unstructured data, including integrating data from multiple sources.
• Significant experience with SQL performance tuning.
• Experience with markup languages (JSON, XML, YAML).
• Experience with NoSQL, Time Series (OneTick) databases a strong plus.
• Experience with AI/ML technologies, including LLM-based agents, and workflow automation platforms (e.g., AWS Bedrock, n8n) a plus.
• Experience with market data protocols and structures (e.g., FIX, exchange order book / top-of-book data) a plus.
• Experience mentoring or guiding junior engineers a plus.
• Familiarity with Big Data Frameworks/Hadoop-based technologies (e.g., Spark, HDFS, Kafka, Yarn, etc.) a plus.
• Well versed in industry standard architecture design methodologies, dimensional data modeling and processes.

Education and Experience
• Minimum of a Bachelor’s degree or equivalent in Computer Science or Engineering or other relevant field.
• Master’s degree (e.g., M.S., M.B.A.) or equivalent is preferred but not required.
• 5+ years of experience building ETL and related data processing and transformation technologies to build large-scale data analytics solutions.
• Financial industry experience a plus.