Overview
On Site
BASED ON EXPERIENCE
Contract - Independent
Contract - W2
Skills
SAP BASIS
Decision-making
Amazon Lambda
Analytics
Cloud Computing
Data Architecture
Specification Gathering
Data Engineering
Stored Procedures
Scripting
Reporting
Software Engineering
Collaboration
Data Validation
Data Quality
Data Analysis
Regression Testing
Computer Science
Information Systems
Amazon Web Services
Amazon S3
SQL
Apache Spark
Extract
Transform
Load
Data Integration
Conflict Resolution
Problem Solving
Communication
Data Governance
Performance Tuning
Workflow
Continuous Integration
Continuous Delivery
Business Intelligence
Data Visualization
SANS
Job Details
The following requirement is open with our client.
\Job Title : Data Engineer
Location : Malvern, PA (3 days onsite)
Duration : 12+ Months
In-person interview
Job Description:
We are seeking a skilled Data Engineer to join our team on a contract basis through the end of the year. In this role, you will design and implement scalable data pipelines and cloud-based solutions using AWS technologies to support analytics, reporting, and operational decision-making.
Key Responsibilities
- Design and implement scalable data pipelines using AWS Glue, Apache Spark, AWS Athena, AWS S3, AWS Lambda, and related services. (10%)
- Integrate large-scale datasets from diverse internal and external sources to support business intelligence and analytics. (10%)
- Ensure pipeline security and performance within a cloud-based data architecture. (10%)
- Translate business requirements into technical specifications and data engineering solutions. (10%)
- Develop and maintain SQL queries, stored procedures, and scripts for reporting and data validation. (10%)
- Write clean, reusable, and well-documented code following best practices in software engineering. (10%)
- Collaborate with cross-functional teams including data scientists, analysts, and product owners. (10%)
- Conduct data validation and cleansing to improve data quality and resolve inconsistencies. (10%)
- Provide technical consultation and data analysis to stakeholders. (5%)
- Contribute to enterprise data standards and policies including performance benchmarks and security. (5%)
- Test and deploy software enhancements using formal regression testing methodologies. (5%)
- Participate in special projects and perform additional responsibilities as needed. (5%)
Required Qualifications
- Bachelor's degree in Computer Science, Information Systems, or a related field.
- Proven experience with AWS data services (Glue, Lambda, Athena, S3).
- Strong proficiency in SQL, Apache Spark, and data pipeline development.
- Experience with data integration, validation, and cleansing techniques.
- Ability to work collaboratively in cross-functional teams.
- Excellent problem-solving and communication skills.
Preferred Skills
- Experience with data governance, security policies, and performance optimization.
- Familiarity with automated workflows and CI/CD pipelines.
- Knowledge of business intelligence tools and data visualization platforms.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.