Overview
On Site
$40 - $45
Contract - W2
Contract - Independent
Skills
Big Data
Spark
AWS Glue
SQL
Scala/Python
Snowflake
Job Details
Job Title: Sr. Data Engineer
Location: Boston, Massachusetts
W2
Job Description:
Job Duties:
At least 9+ years of relevant experience in design, development, complete end-end design of enterprise-wide big data solution.
Experience in designing & developing a big data solution using Spark, Scala, AWS Glue, Lambda, SNS/SQS, Cloudwatch is a must.
Strong Application development experience in Scala/Python.
Strong Database SQL experience, preferably Redshift.
Experience in Snowflake is an added advantage.
Experience with ETL/ELT process and frameworks is a must.
Create integration and application technical design documentation.
Conduct peer-reviews of functional design documentation.
Complete development, configuration, test cases and unit testing
Perform code reviews and ensure standards are applied to each solution component.
Resolve complex defects during testing phases and identify root causes.
Support and execute performance testing.
Familiar with Git repo and CI/CD deployment process
Production Support: Assist in troubleshooting production environment and tuning environments.
Ensure best practices are followed from a technical perspective during all phases of the project.
Minimum Skills Required:
Strong background in AWS cloud services like lambda, glue, s3, emr, sns, sqs, cloudwatch, redshift
Expertise in SQL and experience with relational databases like Oracle, MySql, PostgreSQL
Proficient in Python programming for data engineering tasks, automations
Experience with shell scripting in Linux/Unix environments.
Experience with Big Data Hadoop, Spark
Financial Services experience required
Nice to have - knowledge in Machine Learning models, regression, validation
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.