Data Engineer (Python + SQL)

Job Title: Data Engineer (Python + SQL)

Location: New York, NY (3 days onsite minimum)

Duration: Long Term

Job Summary:

Overview

We are looking for a Data Engineer to join our team with the growing requirement of Data & Analytics. The hire will be responsible for collaborating with business users and delivering analytics projects. Also, they will be building and optimizing our data storage and pipeline architecture to provide a strong base for our data platform. Furthermore, they will work on a variety of projects around Analytics, Digital Marketing Integration, Campaign Management, Lead Generation, Data Integration, and Visualization. The ideal candidate is an experienced software developer who enjoys optimizing data and analytics systems and building them from the ground up. They must be self-directed and comfortable supporting the needs of multiple systems and projects. Candidates will be expected to be very hands-on and pick up domain knowledge. We focus on solving the problem and not getting tied down by technological choices - it is extremely important that candidates are open to learning & working with technologies that are new for them. We support what we build the candidate will be responsible for post-production support on a rotation basis.

Responsibilities

• Collaborating with technology and business users to define key business metrics and develop analytical dashboards to provide actionable insights to Clients.
• Build and optimize data pipelines to consume data from various sources, transform & model it, and then distribute it to multiple consumers.
• Work with multiple data sources (including structured and unstructured) to create an optimized data cube for consumption by analytical dashboards and/or downstream systems.
• Identify, design, and implement improvements / automations for optimizing data processing, storage, and availability, while maintaining scalability, etc.
• Build and support analytics tools that utilize the data pipeline to provide actionable insights into data trends and other key business metrics.
• Develop and support analytics & machine learning projects.
• Support migration of the data platform from on-premises to cloud infrastructure.
• Work with various stakeholders including Technology and Client teams to assist with data & analytics related projects and issues.

Qualification

• We are looking for a candidate with 7+ years of experience in Software Development role, who has attained a bachelor's or master's degree in computer science, information technology/systems or another relevant technical field.
• Advanced working knowledge and experience with data modelling, data warehousing concepts, database design principles, query authoring (SQL) and performance optimization.
• A successful history of manipulating, processing, and extracting value from large, disconnected datasets.
• Hands-on programming experience with Python, Java, or C#.
• Working knowledge of a visualization/reporting tool.
• Excellent problem-solving and analytical skills with attention to details.
• Strong project management and organizational skills.
• Experience supporting and working with cross-functional teams in a dynamic environment.
• Excellent communication and collaboration skills.

Skillset and Experience

• Experience with Relational database systems like Sybase, SQL Server, Postgres, etc.
• Experience with object-oriented or function scripting languages: Python (NumPy, Pandas), Java, C++, or Scala, etc.
• Working knowledge of visualization tools like Tableau, QlikView, Power BI etc.
• Experience with Cloud technologies like Snowflake, Microsoft Azure, Databricks, etc. is a plus.
• Experience with data-science tools / workbench like Dataiku, Jupiter, Rapid Miner, etc. is a plus.
• Experience with Big Data tools / technologies: Hadoop, Pig, Hive, Hue, PySpark etc. is a plus.
• Experience with ETL tools like Azure Data Factory, Informatica, etc. is a plus.
• Experience with machine learning / artificial intelligence techniques like regression, classification, clustering, time series, text mining, large language model, etc. is a plus.