Overview
Remote
Contract - W2
Skills
Media
Big Data
IaaS
Life Insurance
Data Quality
Scalability
Distributed Computing
Machine Learning (ML)
Data Processing
Management
Workflow
Apache Spark
PySpark
Scala
Cloud Computing
Amazon Web Services
Google Cloud
Google Cloud Platform
Microsoft Azure
Kubernetes
Orchestration
Computer Cluster Management
Caching
Redis
Memcached
Apache Ignite
Computer Science
Taxes
Insurance
Law
Management Consulting
Finance
Regulatory Compliance
Job Details
Description:
**100% Remote**
Our client, an industry leader in technology and media, has an excellent opportunity for a Data Engineer to work on a 12+month contract opportunity. The Data Engineer will work on designing and building scalable data pipelines and distributed systems to process petabyte-scale datasets that power intelligent products and services. The ideal candidate has deep technical knowledge in big data frameworks, cloud infrastructure, caching systems, and orchestration tools like Ray and Conductor.
We can facilitate w2 and corp-to-corp consultants. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k with company matching, and life insurance.
Rate: $65 - $85 / hr. w2
Responsibilities:
Design, implement, and maintain scalable and reliable data pipelines using Spark, Ray, and other distributed frameworks.
Build orchestration workflows and manage dependencies using Conductor and Kubernetes.
Develop and optimize data caching strategies and solutions to enhance performance and reduce latency across large-scale systems.
Architect and deploy data infrastructure and solutions in cloud environments including AWS, Google Cloud Platform, and Azure.
Ensure robust data quality, governance, and monitoring mechanisms are in place.
Contribute to architectural decisions to improve scalability, maintainability, and performance of data platforms.
Experience Requirements:
Ray: Experience using Ray for parallel and distributed computing, particularly in machine learning and data processing workloads.
Conductor: Proficiency in designing and managing asynchronous workflow orchestration using Netflix Conductor or similar tools.
Apache Spark: Strong experience with batch and stream processing using PySpark or Scala
Cloud Platforms: Deep understanding of cloud-native services across AWS, Google Cloud Platform (Google Cloud Platform), and Azure, including Data services, Compute, Orchestration & Serverless
Kubernetes: Hands-on experience in container orchestration, cluster management, and deploying data workloads on K8s.
Caching Solutions: Demonstrated expertise in building and optimizing caching layers using technologies like Redis, Memcached, Apache Ignite, or similar.
Education Requirements:
Bachelor's degree in Computer Science or equivalent
Skills, experience, and other compensable factors will be considered when determining pay rate. The pay range provided in this posting reflects a W2 hourly rate; other employment options may be available that may result in pay outside of the provided range.
W2 employees of Eliassen Group who are regularly scheduled to work 30 or more hours per week are eligible for the following benefits: medical (choice of 3 plans), dental, vision, pre-tax accounts, other voluntary benefits including life and disability insurance, 401(k) with match, and sick time if required by law in the worked-in state/locality.
Please be advised- If anyone reaches out to you about an open position connected with Eliassen Group, please confirm that they have an Eliassen.com email address and never provide personal or financial information to anyone who is not clearly associated with Eliassen Group. If you have any indication of fraudulent activity, please contact
About Eliassen Group:
Eliassen Group is a leading strategic consulting company for human-powered solutions. For over 30 years, Eliassen has helped thousands of companies reach further and achieve more with their technology solutions, financial, risk & compliance, and advisory solutions, and clinical solutions. With offices from coast to coast and throughout Europe, Eliassen provides a local community presence, balanced with international reach. Eliassen Group strives to positively impact the lives of their employees, clients, consultants, and the communities in which they operate.
Eliassen Group is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.
Don't miss out on our referral program! If we hire a candidate that you refer us to then you can be eligible for a $1,000 referral check!
**100% Remote**
Our client, an industry leader in technology and media, has an excellent opportunity for a Data Engineer to work on a 12+month contract opportunity. The Data Engineer will work on designing and building scalable data pipelines and distributed systems to process petabyte-scale datasets that power intelligent products and services. The ideal candidate has deep technical knowledge in big data frameworks, cloud infrastructure, caching systems, and orchestration tools like Ray and Conductor.
We can facilitate w2 and corp-to-corp consultants. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k with company matching, and life insurance.
Rate: $65 - $85 / hr. w2
Responsibilities:
Design, implement, and maintain scalable and reliable data pipelines using Spark, Ray, and other distributed frameworks.
Build orchestration workflows and manage dependencies using Conductor and Kubernetes.
Develop and optimize data caching strategies and solutions to enhance performance and reduce latency across large-scale systems.
Architect and deploy data infrastructure and solutions in cloud environments including AWS, Google Cloud Platform, and Azure.
Ensure robust data quality, governance, and monitoring mechanisms are in place.
Contribute to architectural decisions to improve scalability, maintainability, and performance of data platforms.
Experience Requirements:
Ray: Experience using Ray for parallel and distributed computing, particularly in machine learning and data processing workloads.
Conductor: Proficiency in designing and managing asynchronous workflow orchestration using Netflix Conductor or similar tools.
Apache Spark: Strong experience with batch and stream processing using PySpark or Scala
Cloud Platforms: Deep understanding of cloud-native services across AWS, Google Cloud Platform (Google Cloud Platform), and Azure, including Data services, Compute, Orchestration & Serverless
Kubernetes: Hands-on experience in container orchestration, cluster management, and deploying data workloads on K8s.
Caching Solutions: Demonstrated expertise in building and optimizing caching layers using technologies like Redis, Memcached, Apache Ignite, or similar.
Education Requirements:
Bachelor's degree in Computer Science or equivalent
Skills, experience, and other compensable factors will be considered when determining pay rate. The pay range provided in this posting reflects a W2 hourly rate; other employment options may be available that may result in pay outside of the provided range.
W2 employees of Eliassen Group who are regularly scheduled to work 30 or more hours per week are eligible for the following benefits: medical (choice of 3 plans), dental, vision, pre-tax accounts, other voluntary benefits including life and disability insurance, 401(k) with match, and sick time if required by law in the worked-in state/locality.
Please be advised- If anyone reaches out to you about an open position connected with Eliassen Group, please confirm that they have an Eliassen.com email address and never provide personal or financial information to anyone who is not clearly associated with Eliassen Group. If you have any indication of fraudulent activity, please contact
About Eliassen Group:
Eliassen Group is a leading strategic consulting company for human-powered solutions. For over 30 years, Eliassen has helped thousands of companies reach further and achieve more with their technology solutions, financial, risk & compliance, and advisory solutions, and clinical solutions. With offices from coast to coast and throughout Europe, Eliassen provides a local community presence, balanced with international reach. Eliassen Group strives to positively impact the lives of their employees, clients, consultants, and the communities in which they operate.
Eliassen Group is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.
Don't miss out on our referral program! If we hire a candidate that you refer us to then you can be eligible for a $1,000 referral check!
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.