System One has an exciting Data Engineering opportunity with a partner based in the Tulsa, OK area, but will sit in the Frisco, TX area. This position will be responsible for working with complex data sets across an organization spanning multiple states. The qualified candidate will possess at least 5 years of in-depth use of AWS, big data products, & open source tools.. This position is a contract to hire, full-time opportunity requiring in-person, on-site work during normal business hours. Successful candidates must be able to provide proof of ability to work in the U.S. without sponsorship. This position is not open to corp-to-corp, subcontractor or independent consulting arrangements.
Description of job duties: Senior AWS Cloud Data Engineer
Design and develop data architecture: Create scalable, reliable, and efficient data lakehouse solutions on AWS, leveraging Apache Iceberg and other AWS services for table formats.?
Build and maintain data pipelines: Design, construct, and automate ETL/ELT processes to ingest data from diverse sources into the AWS ecosystem.
Create and manage data APIs: Design, develop, and maintain secure and scalable RESTful and other APIs to facilitate data access for internal teams and applications, typically leveraging AWS services.
Implement AWS services: Utilize a wide array of AWS tools for data processing, storage, and analytics, such as Amazon S3, Amazon EMR, and AWS Lake Formation, with native Iceberg support.
Manage Iceberg tables: Build and manage Apache Iceberg tables on Amazon S3 to enable data lakehouse features like ACID transactions, time travel, and schema evolution.
Optimize data performance: Implement partitioning strategies, data compaction, and fine-tuning techniques for Iceberg tables to enhance query performance.
Ensure data quality and integrity: Implement data validation and error-handling processes, leveraging Iceberg's transactional capabilities for consistent data.
Ensure security and compliance: Implement robust data security measures, access controls, and compliance with data protection regulations, including using AWS Lake Formation with Iceberg and implementing authorization on APIs via IAM or Cognito.
Collaborate with stakeholders: Work closely with data scientists, analysts, software engineers, and business teams to understand their data needs and deliver effective solutions.
Provide technical support: Offer technical expertise and troubleshooting for data-related issues related to pipelines and API endpoints.
Maintain documentation: Create and maintain technical documentation for data workflows, processes, and API specifications.
Experience required: Qualifications
Education: Bachelor's degree in Computer Science, Information Technology, or a related field.
Experience: Proven experience in data engineering, with significant hands-on experience using AWS cloud services.
Technical skills:
Programming: Proficiency in programming languages like Python, Java, or Scala.
SQL: Strong SQL skills for querying, data modeling, and database design.
AWS Services: Expertise in relevant AWS services such as S3, EMR, Lambda, API Gateway, SageMaker and IAM.
Apache Iceberg: Hands-on experience building and managing Apache Iceberg tables.
Big Data: Experience with big data technologies like Apache Spark and Hadoop.
API Development: Experience creating and deploying RESTful APIs, with knowledge of best practices for performance and security.
ETL/Workflow: Experience with ETL tools and workflow orchestration tools like Apache Airflow.
DevOps: Familiarity with DevOps practices, CI/CD pipelines, and infrastructure as code (Terraform) is often desired.
Soft skills:
Strong problem-solving and analytical skills.
Excellent communication and collaboration skills.
Ability to work independently and as part of an agile team.
Certifications (Preferred): AWS Certified Data Analytics; AWS Certified Data Engineer - Specialty or other relevant AWS certifications.
System One, and its subsidiaries including Joul, ALTA IT Services, and Mountain Ltd., are leaders in delivering outsourced services and workforce solutions across North America. We help clients get work done more efficiently and economically, without compromising quality. System One not only serves as a valued partner for our clients, but we offer eligible employees health and welfare benefits coverage options including medical, dental, vision, spending accounts, life insurance, voluntary plans, as well as participation in a 401(k) plan.
System One is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, age, national origin, disability, family care or medical leave status, genetic information, veteran status, marital status, or any other characteristic protected by applicable federal, state, or local law.
#M-
#LI-
#DI-
Ref: #208-Rowland Tulsa
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
- Dice Id: 10295162
- Position Id: 345010
- Posted 11 hours ago
Never miss an opportunity! Create an alert based on the job you applied for.
