Search Jobs | Dice.com

Job Details

Skills

Big Data
Life Insurance
Data Science
Forecasting
Operational Excellence
IT Management
Microsoft Azure
Auditing
Design Review
Data Processing
Data Engineering
Scala
Apache Spark
Python
SQL
Streaming
Warehouse
Dimensional Modeling
Data Quality
Performance Tuning
Orchestration
Workflow
Step-Functions
Version Control
Testing
Google Cloud Platform
Google Cloud
Continuous Integration
Continuous Delivery
Production Support
Technical Direction
Mentorship
Access Control
Payment Card Industry
Analytics
Reporting
Unity
Apache Atlas
Data Architecture
Encryption
Management
Privacy
Cloud Computing
Databricks
Amazon Web Services
Advertising
Collaboration
Regulatory Compliance
Grafana
Docker
Kubernetes
Security Architecture
Threat Modeling
English
Agile
Scrum
Screening
Artificial Intelligence
Recruiting
Taxes
Insurance
Law
Communication
Gmail
Routing
Management Consulting
Life Sciences
SAP BASIS
Military

Big Data
Life Insurance
Data Science
Forecasting
Operational Excellence
IT Management
Microsoft Azure
Auditing
Design Review
Data Processing
Data Engineering
Scala
Apache Spark
Python
SQL
Streaming
Warehouse
Dimensional Modeling
Data Quality
Performance Tuning
Orchestration
Workflow
Step-Functions
Version Control
Testing
Google Cloud Platform
Google Cloud
Continuous Integration
Continuous Delivery
Production Support
Technical Direction
Mentorship
Access Control
Payment Card Industry
Analytics
Reporting
Unity
Apache Atlas
Data Architecture
Encryption
Management
Privacy
Cloud Computing
Databricks
Amazon Web Services
Advertising
Collaboration
Regulatory Compliance
Grafana
Docker
Kubernetes
Security Architecture
Threat Modeling
English
Agile
Scrum
Screening
Artificial Intelligence
Recruiting
Taxes
Insurance
Law
Communication
Gmail
Routing
Management Consulting
Life Sciences
SAP BASIS
Military

Summary

Description:Hybrid at least 2 days per week in office in Chicago, IL

Our client seeks a Staff Data Engineer to set technical direction for large-scale data processing in a privacy-preserving attribution platform. The role will architect and operate secure pipelines across cloud environments, collaborate with cross-functional teams, implement governance and access controls, and drive architecture for batch and streaming workflows. The engineer will build observability and operational tooling, troubleshoot distributed systems, mentor senior engineers, and evolve attribution, measurement, forecasting, and analytics capabilities with strong security and compliance alignment.

We can facilitate w2 and corp-to-corp consultants. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k with company matching, and life insurance.

Rate: $84.00 to $94.00/hr. w2

Responsibilities:

Set technical direction for large-scale data processing solutions using Scala, Spark, SQL, and modern data platforms across the attribution ecosystem.
Architect and operate trusted pipelines handling advertiser, customer, and measurement datasets within secure cloud environments and approved data-sharing ecosystems.
Collaborate with Product, Data Science, Security, Privacy, and Platform Engineering to deliver privacy-preserving attribution, measurement, forecasting, and analytics solutions.
Define architecture for batch and streaming workflows, including orchestration frameworks and cloud-native services.
Implement data classification, access controls, and privacy-preserving processing techniques to meet security and compliance requirements.
Establish architectural direction for clean-room and trusted data-sharing environments with approved aggregated or privacy-protected outputs.
Build observability, monitoring, and operational tooling to ensure reliability, performance, and compliance.
Troubleshoot complex platform, performance, and pipeline issues across distributed systems.
Drive architecture decisions, engineering best practices, and operational excellence across attribution and adjacent data products.
Mentor and grow senior and lead engineers and provide technical leadership across teams and product areas.
Design and implement pipelines within trusted environments across AWS, Google Cloud Platform, Azure, and on-premises infrastructure.
Implement access controls, data classification policies, lineage tracking, and governance controls for sensitive data.
Define and maintain data handling standards with Security, Privacy, and Compliance stakeholders.
Enforce privacy-preserving principles to ensure only aggregated, anonymized, tokenized, or otherwise approved outputs leave trusted environments.
Build monitoring and alerting to detect anomalous movement, policy violations, and potential leakage.
Apply privacy-preserving computation techniques, including aggregation-before-export, pseudonymization and tokenization, differential privacy concepts, and privacy-aware reporting.
Implement encryption, key management, and secure data handling using cloud-native services.
Document trust boundaries, data contracts, lineage, and permitted data movement between zones.
Support audits, compliance requirements, governance reviews, and secure data-sharing initiatives.
Participate in architecture and design reviews for new data products to incorporate governance, privacy, lineage, and trust-boundary requirements.
Contribute to engineering standards and best practices for secure data processing and privacy-preserving analytics.

Experience Requirements:

10+ years of data engineering with deep Scala and extensive Apache Spark for large-scale processing on AWS and/or Google Cloud Platform.
Strong Python for pipelines, tooling, automation, and infrastructure modules.
Advanced SQL across relational, cloud warehouses, and lakehouse platforms with TB-scale datasets.
Designing, building, and maintaining batch and streaming pipelines.
Strong understanding of warehousing, dimensional modeling, data quality, partitioning, and performance optimization.
Experience with lakehouse architectures such as Databricks, Delta Lake, or equivalent.
Operating distributed data platforms at scale.
Workflow orchestration with Airflow, Databricks Workflows, AWS Step Functions, or equivalent.
Source control and testing practices including unit, integration, and automation.
Cloud-native development on AWS and/or Google Cloud Platform.
Strong engineering practices including CI/CD, code reviews, observability, and production support.
Proven ability to set technical direction across teams and mentor senior engineers.
Trusted environment execution: clean rooms and secure data-sharing platforms, handling PII and regulated data, fine-grained access controls, and policy-based enforcement.
Working knowledge of data classification frameworks including PII, PCI, regulated data, and sensitivity-tier models.
Familiarity with tokenization, pseudonymization, aggregation-before-export, and differential privacy concepts.
Experience with clean-room, measurement, attribution, audience analytics, partner data-sharing, or privacy-preserving reporting.
Lineage and governance tooling such as Unity Catalog, AWS Glue Data Catalog, Apache Atlas, or OpenLineage.
Understanding of trust boundaries, secure sharing patterns, and zero-trust data architecture principles.
Documenting data contracts, flows, lineage, and permitted movement between security zones and domains.
Encryption, key management, and secure handling using cloud-native security services.
Designing observability and alerting controls to detect anomalous movement, policy violations, and potential leakage.
Experience in environments where only aggregated, anonymized, tokenized, or privacy-protected outputs may exit trusted processing environments.
Strong understanding of cloud-native security and governance.
Good to have: Databricks ecosystem, AWS Clean Rooms, advertising measurement and attribution platforms, collaboration with Security and Compliance in regulated settings, ELK, Grafana, OpenTelemetry, Docker, Kubernetes, and security architecture or threat modeling.
Strong written and verbal English communication skills.
Good understanding of Agile and SCRUM within cross-functional teams.

Recruitment Transparency Notice

Eliassen Group values transparency in our recruitment practices. Please be advised that Eliassen Group utilizes artificial intelligence (AI) tools as part of its initial application screening and hiring process. You may receive email and SMS notifications from the Eliassen Virtual Recruiting Team (, ) inviting you to complete a brief voice screening as part of your application process. These tools assist our hiring teams in different ways, including but not limited to, assistance in reviewing application materials to help identify candidates whose qualifications most closely match the requirements of the position. All AI-assisted evaluations and responses are reviewed by human recruiters before any hiring decisions are made. The use of AI in our process is intended to support fairness, efficiency, and consistency, and Eliassen Group takes measures to prevent bias or discrimination in connection with its hiring practices. By proceeding, you acknowledge, agree, and consent to Eliassen Group's use of these tools, including AI tools, as part of the application and hiring process.

Skills, experience, and other compensable factors will be considered when determining pay rate. The pay range provided in this posting reflects a W2 hourly rate; other employment options may be available that may result in pay outside of the provided range.

W2 employees of Eliassen Group who are regularly scheduled to work 30 or more hours per week are eligible for the following benefits: medical (choice of 3 plans), dental, vision, pre-tax accounts, other voluntary benefits including life and disability insurance, 401(k) with match, and sick time if required by law in the worked-in state/locality.
If anyone reaches out to you about an open position connected with Eliassen Group, please ensure that you are working directly with us by confirming the following:

When you work with Eliassen Group, all email communication will come from an Eliassen.com address, never Gmail, Yahoo, etc.

Eliassen Group will never ask you for personal information (home address, bank account, or check routing number) until you have worked with someone clearly associated with Eliassen Group.

If you have any indication of fraudulent activity, please contact .

About Eliassen Group:

Eliassen Group is a strategic consulting firm that helps organizations reach further and achieve more through our technology, business advisory, and life sciences solutions. For nearly 40 years, we have combined exceptional people, deep domain expertise, and intelligent capabilities to expand our clients' capacity and accelerate meaningful outcomes. We are driven by a purpose to positively impact the lives of our employees, clients, consultants, and the communities we serve.

Eliassen is committed to building a diverse and inclusive team from a variety of backgrounds, perspectives, and skills. We are an Equal Opportunity and Affirmative Action Employer and all employment decisions are based on merit, performance, and business needs. Eliassen does not discriminate on the basis of race, color, gender identity or expression, sexual preference or orientation, sex (including pregnancy, childbirth, and related medical conditions), marital status, creed, religion, physical or mental disability, genetic information, military or veteran status, age, ancestry, national origin, citizenship status, prohibited criminal record inquiries of applicants and employees, or any other category protected by federal, state, or local laws.

Don't miss out on our referral program! If we hire a candidate that you refer us to then you can be eligible for a $1,000 referral check!

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: cxelisen
Position Id: a1WUQ000001eaaT2AQ
Posted 4 hours ago

Company Info

About Eliassen Group

Eliassen Group is a leading strategic consulting company that provides business and IT services for our clients as they seek to transform and execute strategies that will drive exceptional outcomes. Leveraging over 30 years of success, we focus on professional services, talent solutions, and life sciences. Eliassen Group offers local community presence and deep networks. We are committed to positively impacting the lives of our employees, clients, consultants, and the communities in which we operate.

Eliassen Group is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.

Senior Software Engineer

Chicago, Illinois

•

Today

Description: Hybrid At least 2 days per week in office in Chicago, IL Our client seeks a Senior Software Engineer for the CDP team to drive design, delivery, technical strategy, and execution for cloud-native data platforms. You will define engineering standards, mentor engineers, and ensure the platform scales securely and reliably. You will work across Java, Python, Spark, TypeScript, JavaScript, Angular, AWS services, event-driven architectures, and SQL/NoSQL databases to deliver performant

Full-time

Filter Results

Job post features

Posted date

Work settings

Employment type

Distance

Employer type

Work authorization

Sr. Big Data Engineer

Skills

Summary

Dice Job Match Score™

Similar Jobs

Sr. Big Data Engineer

Eliassen Group

Job Details

Skills

Summary

Company Info

About Eliassen Group

Dice Job Match Score™

Similar Jobs