Offshore Senior Data Engineer

RESPONSIBILITIES:
Kforce has a client in Lincoln, RI that is seeking a a highly skilled and experienced Offshore Senior Data Engineer. This role is pivotal in driving our data initiatives and ensuring the seamless integration and processing of large datasets. The ideal candidate will have a strong background in AWS technologies, particularly in Lake Formation, and will be adept at using PySpark for data transformation.

Responsibilities:
* Develop and maintain ETL jobs using Serverless Glue and PySpark to process data from various sources such as JSON and CSV files
* Implement and manage AWS Lake Formation to ensure proper governance, access controls, and data security
* Utilize AWS Lambda, S3, Athena, SNS, and EventBridge to build and maintain scalable data pipelines
* Collaborate with analytics teams to set up and manage a unified AWS account for all analytics activities
* Process and transform large datasets, including web traffic data from Adobe Analytics and telematics data, using Apache Spark with PySpark
* Create and manage data catalogs using Glue crawlers and ensure data is accessible and queryable via Athena
* Develop and maintain dashboards and BI tools on top of Athena to provide actionable insights
* Ensure data quality and integrity through rigorous testing and validation processes

REQUIREMENTS:
* Expertise in AWS Lake Formation and experience in setting up and managing data lakes
* Proficiency in Apache Spark (PySpark) for large-scale data processing and transformation
* Strong experience with AWS Glue, Lambda, S3, Athena, SNS, and EventBridge
* Ability to process and manage large datasets, including over 3 billion rows of data
* Experience with data governance, access controls, and security best practices
* Familiarity with BI tools and creating dashboards for data visualization
* Excellent problem-solving skills and the ability to work in a fast-paced environment
* Strong communication skills and the ability to collaborate effectively with cross-functional teams

Preferred Qualifications:
* Experience with Guidewire Cloud and its integration with AWS analytics services
* Familiarity with Adobe Analytics and processing web traffic data
* Proven track record of managing and optimizing data pipelines in a cloud environment

The pay range is the lowest to highest compensation we reasonably in good faith believe we would pay at posting for this role. We may ultimately pay more or less than this range. Employee pay is based on factors like relevant education, qualifications, certifications, experience, skills, seniority, location, performance, union contract and business needs. This range may be modified in the future.

We offer comprehensive benefits including medical/dental/vision insurance, HSA, FSA, 401(k), and life, disability & ADD insurance to eligible employees. Salaried personnel receive paid time off. Hourly employees are not eligible for paid time off unless required by law. Hourly employees on a Service Contract Act project are eligible for paid sick leave.

Note: Pay is not considered compensation until it is earned, vested and determinable. The amount and availability of any compensation remains in Kforce's sole discretion unless and until paid and may be modified in its discretion consistent with the law.

This job is not eligible for bonuses, incentives or commissions.

Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.

By clicking ?Apply Today? you agree to receive calls, AI-generated calls, text messages or emails from Kforce and its affiliates, and service providers. Note that if you choose to communicate with Kforce via text messaging the frequency may vary, and message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You will always have the right to cease communicating via text by using key words such as STOP.