Overview
Full Time
Skills
Privacy
Analytics
Storage
Data Quality
Knowledge Sharing
Computer Science
Software Development
FOCUS
Big Data
Java
Scala
Python
SQL
Apache Hadoop
HDFS
MapReduce
Apache Hive
Apache Spark
Data Processing
Cloud Computing
Data Modeling
Data Warehouse
Extract
Transform
Load
Visualization
Unix
Linux
Conflict Resolution
Problem Solving
Analytical Skill
Communication
Collaboration
Data Governance
Agile
Streaming
Apache Kafka
Amazon Kinesis
NoSQL
Database
Apache Cassandra
MongoDB
Machine Learning (ML)
TensorFlow
PyTorch
Amazon Web Services
Google Cloud
Google Cloud Platform
Open Source
Data Analysis
Job Details
TransUnion's Job Applicant Privacy Notice
What We'll Bring:
The Role:
We are seeking a talented and experienced Senior Data Engineer/Big Data Developer to join our growing team. In this role, you will be responsible for designing, developing, and maintaining our Big Data infrastructure and pipelines. You will work with large datasets to build scalable solutions for data processing, analytics, and machine learning initiatives. You will collaborate with data scientists, analysts, and other engineers to deliver high-quality, reliable, and performant data solutions that drive business decisions.
Responsibilities:
Design, develop, and maintain robust and scalable Big Data pipelines using technologies like Hadoop, Spark, and Scala.
Develop and maintain data ingestion, processing, and storage solutions on cloud platforms such as AWS and Google Cloud Platform.
Write high-quality, well-documented, and testable code in Java, Scala, Python, and SQL.
Optimize data processing performance and ensure data quality.
Collaborate with data scientists and analysts to understand their requirements and build data solutions that meet their needs.
Work with large datasets and perform data analysis to identify trends and patterns.
Implement data governance and security best practices.
Contribute to the evolution of our Big Data architecture and technology stack.
Troubleshoot and resolve issues in the data pipelines and infrastructure.
Stay up-to-date with the latest Big Data technologies and trends.
Participate in code reviews and contribute to the team's knowledge sharing.
Work in a fast-paced, agile environment.
What You'll Bring:
Qualifications:
Impact You'll Make:
Bonus Points:
This is a hybrid position and involves regular performance of job responsibilities virtually as well as in-person at an assigned TU office location for a minimum of two days a week.
TransUnion Job Title
Developer, Data Analysis and Consulting
What We'll Bring:
The Role:
We are seeking a talented and experienced Senior Data Engineer/Big Data Developer to join our growing team. In this role, you will be responsible for designing, developing, and maintaining our Big Data infrastructure and pipelines. You will work with large datasets to build scalable solutions for data processing, analytics, and machine learning initiatives. You will collaborate with data scientists, analysts, and other engineers to deliver high-quality, reliable, and performant data solutions that drive business decisions.
Responsibilities:
Design, develop, and maintain robust and scalable Big Data pipelines using technologies like Hadoop, Spark, and Scala.
Develop and maintain data ingestion, processing, and storage solutions on cloud platforms such as AWS and Google Cloud Platform.
Write high-quality, well-documented, and testable code in Java, Scala, Python, and SQL.
Optimize data processing performance and ensure data quality.
Collaborate with data scientists and analysts to understand their requirements and build data solutions that meet their needs.
Work with large datasets and perform data analysis to identify trends and patterns.
Implement data governance and security best practices.
Contribute to the evolution of our Big Data architecture and technology stack.
Troubleshoot and resolve issues in the data pipelines and infrastructure.
Stay up-to-date with the latest Big Data technologies and trends.
Participate in code reviews and contribute to the team's knowledge sharing.
Work in a fast-paced, agile environment.
What You'll Bring:
Qualifications:
- Bachelor's degree in Computer Science, Engineering, or a related field.
- 4+ years of experience in software development with a focus on Big Data technologies.
- Strong proficiency in Java, Scala, Python, and SQL.
- Experience with Hadoop ecosystem components such as HDFS, MapReduce, YARN, and Hive.
- Extensive experience with Apache Spark for large-scale data processing.
- Experience building and deploying data pipelines on cloud platforms (AWS and/or Google Cloud Platform).
- Solid understanding of data modeling, data warehousing, and ETL concepts.
- Experience with data analytics and visualization tools is a plus.
- Strong understanding of distributed systems principles and architecture.
- Proficiency in Unix/Linux environments.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration skills.
- Experience with data governance and security best practices.
- Experience with Agile development methodologies.
Impact You'll Make:
Bonus Points:
- Experience with data streaming technologies like Kafka or Kinesis.
- Experience with NoSQL databases like Cassandra or MongoDB.
- Experience with machine learning frameworks like TensorFlow or PyTorch.
- AWS or Google Cloud Platform certifications.
- Contributions to open-source projects.
This is a hybrid position and involves regular performance of job responsibilities virtually as well as in-person at an assigned TU office location for a minimum of two days a week.
TransUnion Job Title
Developer, Data Analysis and Consulting
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.