Overview
Remote
On Site
Hybrid
$120000 - $121000 yr
Contract - W2
Contract - Independent
Skills
DATA ENGINEER
DATA PRODUCT ENGINEER
BIG DATA ENGINEER
ETL
DATA PIPELINES
SPARK
PYSPARK
DATABRICKS
EMR
AWS
S3
GLUE
LAMBDA
STEP FUNCTIONS
REDSHIFT
DYNAMODB
PYTHON
SQL
ICEBERG
DELTA LAKE
MEDALLION ARCHITECTURE
DATA MODELING
OLTP
OLAP
DATA CATALOG
UNITY CATALOG
ALATION
KNOWLEDGE GRAPH
SEMANTIC ONTOLOGY
RAG
DATA QUALITY
PERFORMANCE TUNING
TROUBLESHOOTING
Job Details
Salary: $120k - $121k /yr.
Responsibilities:
Qualifications:
Desired Skills:
Pay Transparency: The typical base pay for this role across the U.S. is: $120k - $121k /yr. As a non-exempt position, this role will be eligible for overtime, at 1.5 times the base rate, or as required by state or local law. Final offer amounts, within the base pay set forth above, are determined by factors including your relevant skills, education, and experience. Full-time employees are eligible for benefits including medical, dental, and vision benefits, health savings account option for qualified medical plan enrollments, accrual of up to 10 paid days off, 3 days paid bereavement leave, 401(k) plan participation with employer match, life and disability insurance, commuter benefits, dependent care flexible spending account, accident insurance, critical illness insurance, hospital indemnity insurance, travel reimbursement, accommodations for work travel, and discretionary performance or recognition bonus. Sick leave and mobile phone reimbursement as required by state or local law.
Consent to Communication and Use of AI Technology: By submitting your application for this position and providing your email address(es) and/or phone number(s), you consent to receive text (SMS), email, and/or voice communication whether automated (including auto telephone dialing systems or automatic text messaging systems), pre-recorded, AI-assisted, or individually initiated from Aditi Consulting, our agents, representatives, or affiliates at the phone number and/or email address you have provided. These communications may include information about potential opportunities and information. Message and data rates may apply. Message frequency may vary.
You represent and warrant that the email address(es) and/or telephone number(s) you provided to us belong to you and that you are permitted to receive calls, text (SMS) messages, and/or emails at these contacts. You also acknowledge and agree to Aditi Consulting LLC s use of AI technology during the sourcing process, including calls from an AI Voice Recruiter. AI is used solely to gather data and does not replace human-based decision-making in employment decisions. Calls may be recorded.
Consent is not a condition of purchasing any property, goods, or services. You may revoke your consent at any time by replying STOP to messages or by contacting .
For information about our collection, use, and disclosure of applicants personal information as well as applicants' rights over their personal information, please see our .
#AditiConsulting
# 25 - 23203
Responsibilities:
- Data profiling and analysis for source systems, manually maintained data, machine generated data and target data repos
- Develop and maintain data mapping specifications based on the results of data analysis and functional requirements
- Build automated Extract, Transform & Load (ETL) jobs based on data mapping specifications
- Managing and maintaining metadata data structures, data dictionaries and business glossaries
- Build logical and physical data models for both Online Transaction Processing (OLTP) and Online Analytical Processing (OLAP) solutions
- Analyze the impact of downstream systems and products Design and build Data Quality (DQ) rules needed Understanding of time travel, schema evolution, and branching/versioned datasets
- Ability to design multi-tenant, ACID compliant Iceberg table strategies for analytics and ML feature stores Gather requirements from business stakeholders to generate useful data products for consumption to a wide array of audiences and systems
Qualifications:
- Strong Data Engineering Skills: 2+ years of hands-on data engineering experience in distributed data processing (Spark, Databricks, EMR, or similar).
- Proficiency in designing, implementing, and maintaining data pipelines, ETL (Extract, Transform, Load) processes, and data warehouses using AWS services.
- AWS Expertise: 2+ years experience with various AWS services relevant to data engineering, such as AWS S3, AWS Glue, AWS Lambda, AWS Step Functions, AWS EMR, AWS Redshift, AWS DynamoDB Programming
Desired Skills:
- Proficiency in programming languages commonly used in data engineering, such as Python (PySpark) and SQL.
- Data Platforms: Experience with Big Data / Hadoop / Spark / Hive / NoSQL database engines (i.e. Cassandra or HBase)
- Experience building and maintaining RAG (Retrieval Augmented Generation) systems
- Experience implementing Apache Iceberg and Delta Lake tables at scale (snapshot isolation, manifest management, partition evolution)
- Familiarity with catalog integrations (eg Unity, Hive, Glue) and Iceberg metadata layer Data Modeling: Industry standard data modeling tools (e.g., ERWin, ER Studio, etc.)
- Experience with graph databases and creating enterprise semantic ontologies
- Understanding of common graph data language & concepts (SparQL, OWL, RDF)
- Experience with creating and maintaining
- Enterprise Knowledge Graphs (EKG)
- Data Catalogs: Exposure to industry standard data catalogs, automated data discovery and data lineage tools (e.g., Alation, Unity Catalog, etc)
- Experience building versatile data products designed for consumption across diverse analytical workloads including business intelligence dashboards, generative AI applications, machine learning models, and self-service analytics platforms
- Understanding of data lakehouse concepts - medallion architecture, batch vs streaming, and incremental processing
- Troubleshooting and Performance Tuning: Strong problem-solving skills to identify and resolve issues related to data pipelines, performance bottlenecks, and scalability.
- Experience with performance tuning and optimization of data workflows.
Pay Transparency: The typical base pay for this role across the U.S. is: $120k - $121k /yr. As a non-exempt position, this role will be eligible for overtime, at 1.5 times the base rate, or as required by state or local law. Final offer amounts, within the base pay set forth above, are determined by factors including your relevant skills, education, and experience. Full-time employees are eligible for benefits including medical, dental, and vision benefits, health savings account option for qualified medical plan enrollments, accrual of up to 10 paid days off, 3 days paid bereavement leave, 401(k) plan participation with employer match, life and disability insurance, commuter benefits, dependent care flexible spending account, accident insurance, critical illness insurance, hospital indemnity insurance, travel reimbursement, accommodations for work travel, and discretionary performance or recognition bonus. Sick leave and mobile phone reimbursement as required by state or local law.
Consent to Communication and Use of AI Technology: By submitting your application for this position and providing your email address(es) and/or phone number(s), you consent to receive text (SMS), email, and/or voice communication whether automated (including auto telephone dialing systems or automatic text messaging systems), pre-recorded, AI-assisted, or individually initiated from Aditi Consulting, our agents, representatives, or affiliates at the phone number and/or email address you have provided. These communications may include information about potential opportunities and information. Message and data rates may apply. Message frequency may vary.
You represent and warrant that the email address(es) and/or telephone number(s) you provided to us belong to you and that you are permitted to receive calls, text (SMS) messages, and/or emails at these contacts. You also acknowledge and agree to Aditi Consulting LLC s use of AI technology during the sourcing process, including calls from an AI Voice Recruiter. AI is used solely to gather data and does not replace human-based decision-making in employment decisions. Calls may be recorded.
Consent is not a condition of purchasing any property, goods, or services. You may revoke your consent at any time by replying STOP to messages or by contacting .
For information about our collection, use, and disclosure of applicants personal information as well as applicants' rights over their personal information, please see our .
#AditiConsulting
# 25 - 23203
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.