Overview
Accepts corp to corp applications
Contract - W2
Skills
Data Pipeline
Data Infrastructure
Data Governance
Job Details
Key Responsibilities:
- Design, develop, and maintain scalable and robust data pipelines.
- Integrate data from multiple sources, including APIs, cloud platforms, databases, and third-party systems.
- Build and manage data infrastructure and architecture that supports analytics and reporting needs.
- Ensure data quality, consistency, reliability, and governance across systems.
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.
- Implement data security best practices to ensure compliance with privacy and regulatory standards (GDPR, HIPAA, etc.).
- Monitor pipeline performance and troubleshoot issues.
- Automate repetitive tasks to improve efficiency and reduce manual workloads.
Required Skills and Qualifications:
- Bachelor?s or Master?s degree in Computer Science, Information Systems, Engineering, or related field.
- Experience in data engineering or a related role.
- Proficiency in SQL and at least one programming language (e.g., Python, Scala, Java).
- Experience with data pipeline tools such as Apache Airflow, Luigi, or similar.
- Strong understanding of ETL/ELT processes and tools (e.g., Talend, Informatica, Fivetran, dbt).
- Hands-on experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.
- Experience working with big data technologies like Spark, Hadoop, or Kafka.
- Familiarity with data warehousing solutions (e.g., Snowflake, Redshift, BigQuery).
- Strong problem-solving and communication skills.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.