Job Title: Data Engineer - (AWS)
Location: Remote
Duration: 1+ Months Contract
Job Description:
The Data Engineer is responsible for developing and maintaining data infrastructure components, including data pipelines, databases, data lakes, and data warehouses, to support accurate and timely data access for business intelligence and analytics. This role collects, processes, and transforms raw data into structured, usable formats for reporting and insights. The Data Engineer works with AWS cloud services, SQL, scripts, and big data tools to support large datasets, optimize performance, and automate data workflows to build business intelligence reports.
Primary Duties and Responsibilities:
- Design, develop, and maintain scalable and reliable data pipelines for ingesting, transforming, and storing structured and unstructured data.
- Implement ETL/ELT workflows using AWS services.
- Ensure data integrity, security, and governance through best practices in validation and monitoring.
- Build and maintain data warehouse solutions.
- Manage and optimize AWS Data Lake environments, integrating data from multiple sources for analytics and reporting.
- Implement data modeling best practices to enhance performance and scalability.
- Optimize query performance, indexing, partitioning, and storage costs across warehouse and data lake environments.
- Work with Tableau and other visualization tools to ensure seamless data integration for business reporting and analytics.
- Build data extracts, materialized views, and optimized datasets for efficient reporting.
- Collaborate with business analysts and product teams to ensure data is structured for self-service analytics.
- Stay up to date with emerging data engineering technologies and best practices.
- Assemble large, complex sets of data that meet non-functional and functional business requirements.
- Identify, design, and implement internal process improvements for scalability, data delivery optimization, and automation.
- Build required infrastructure for optimal extraction, transformation, and loading of data from various data sources using AWS and SQL technologies.
- Build analytical tools to utilize the data pipeline, providing actionable insight into key business performance metrics, including operational efficiency and customer acquisition.
- Work with stakeholders, including Executive, Product, Data, and Design teams, to support data infrastructure needs and assist with data-related technical issues.
- Performs other duties as assigned.
Minimum Requirements:
- Bachelor s Degree in Computer Science or related field or equivalent experience.
- At least 5 years of professional experience in data engineering, database administration, or software development with a data focus."
- At least 3 years of experience building and managing large-scale data solutions.
- SQL expertise, including query optimization, indexing, partitioning, and database tuning.
- Working knowledge of data collection and management tools
- Experience with AWS data services, such as Redshift, S3, Glue, Athena, Step Functions, and Lambda
- Hands-on experience with ETL/ELT workflow tools
- Experience working with Tableau (or similar visualization tools) to support data visualization and dashboarding.
- Familiarity with data lake architecture, including AWS Data Lake integration and best practices.
- Understanding of data warehousing principles and dimensional modeling.
- Experience working in Agile environments and familiarity with CI/CD practices in data engineering.
- Effective communication skills with internal and external contacts at all levels, both written and verbal.
- Excellent analytical skills and commitment to continuous improvement of data insights.
- Ability to perform problem analysis and resolution.
- U.S. Citizenship required.
- Ability to pass a federal background check and obtain a suitability determination.
- Ability to maintain confidentiality with regard to information stored in operational databases.
- Ability to work with computers and the necessary software typically used by the department.
Working Conditions: Encountered on a regular basis as part of the work this job performs.
- Typical office environment.
- Some work in computer-testing lab with cold temperatures, and high noise levels from hardware alarms.
- Ability to reach with hands and arms and to use hands to finger, handle or feel to move computers and testing equipment.
- Ability to climb or balance, stoop, kneel, crawl or crouch, to move computers and testing equipment.
Vimal Charan
Phone: | Mob:
Email:
Never miss an opportunity! Create an alert based on the job you applied for.
