Position: Data Engineer III
Location: Chicago, Illinois
Duration: Contract
Job ID: 181244
Job Overview: The Data Engineer III will support a major enterprise data initiative focused on building and scaling a modern cloud-based data lake and analytics ecosystem. This role will work within a product analytics and data engineering environment to design, build, and optimize large-scale data pipelines and infrastructure on AWS, leveraging DevOps practices, Terraform, and CI/CD pipelines. The position is hybrid onsite in downtown Chicago, with an expectation of being in the office 3-4 days per week, and will involve close collaboration with cross-functional teams to make data accessible, reliable, and actionable for both operational and analytical use cases.
Responsibilities: - Design, build, and support large-scale data pipelines in a distributed, scalable environment to enable analytics and operational reporting.
- Enable, configure, and optimize production AWS environments for data infrastructure, frameworks, and services.
- Develop and maintain reusable Terraform modules to automate infrastructure deployments and environment provisioning.
- Leverage Databricks and data lake technologies to support batch and streaming data applications.
- Partner with development teams, product analytics, and business stakeholders to deliver cutting-edge technical solutions that enable new business capabilities.
- Participate in and lead the design and development of innovative batch and streaming data applications using AWS technologies and modern data engineering patterns.
- Provide technical direction, best practices, and guidance to team members, helping resolve complex technical issues and queries.
- Implement and maintain CI/CD pipelines to support continuous integration and delivery of data engineering solutions.
- Apply DevOps principles to improve reliability, observability, and automation across the data platform.
- Utilize Python, Bash scripting, PySpark, and related tools to build robust data transformations and workflows.
- Work with orchestration tools such as Airflow and AWS Glue, and serverless components like AWS Lambda, to manage and schedule data workflows.
- Troubleshoot complex data and infrastructure issues, performing root cause analysis on internal and external data and processes.
- Collaborate with cross-functional teams, vendors, and external partners on data-related projects and integrations.
- Manage multiple concurrent deliverables, balancing short-term tasks and long-term initiatives in a fast-paced environment.
- Contribute to agile development processes by working closely with project managers, product owners, and development leads.
- Ensure data quality, validation, and testing are embedded into all data engineering deliverables.
- Communicate complex technical and quantitative concepts in a clear, concise, and actionable manner to both technical and non-technical audiences.
- Support the broader data strategy to accelerate time to market, transform business processes, and enable data-driven decision making.
- Participate in both video and in-person interview and collaboration sessions as required by the hybrid work model.
Qualifications: - Bachelor's degree in a quantitative field such as Statistics, Software Engineering, Business Analytics, Information Systems, Aviation Management, or a related discipline.
- 5+ years of experience in a data engineering or ETL development role, working with large and complex datasets.
- Strong experience with DevOps practices, including automation, monitoring, and CI/CD pipelines.
- Hands-on experience with AWS cloud services such as Redshift, S3, Athena, Lambda, and related components.
- Proficiency in Terraform for infrastructure as code, including creating and maintaining Terraform modules.
- Experience with Databricks and modern data lake architectures for both batch and streaming workloads.
- Strong programming skills in Python, with additional experience in Bash scripting and PySpark.
- Experience with workflow orchestration tools such as Airflow and AWS Glue.
- Solid SQL skills and experience with relational and analytical databases (e.g., BigQuery, SQL Server, Oracle) and tools such as SSMS and SQL Developer.
- Demonstrated ability to perform root cause analysis on data and processes to answer business questions and identify improvement opportunities.
- Strong analytical skills working with structured, semi-structured, and unstructured datasets.
- Passion for solving problems through data and analytics and for building data products, including robust data models.
- Proven initiative and ownership of data-focused projects, including validation, testing, and user-focused delivery.
- Ability to solve problems under pressure and in constrained scenarios, making sound judgments and trade-offs.
- Fluency in English, both written and spoken, with outstanding written communication and presentation skills.
- Proficiency with Microsoft Excel and PowerPoint for analysis and presentation of findings.
- Ability to coordinate and guide cross-functional projects involving multiple teams, vendors, and external partners.
- Strong organizational skills with the ability to manage multiple priorities in a dynamic, fast-paced environment.
- Experience with agile methodologies and continuous integration/continuous delivery practices.
- Nice to have: experience with blue-green deployments, Kubernetes, and Ansible playbooks.
- Nice to have: AWS certification relevant to data engineering or cloud architecture.
- Preferred: Master's degree in a related field.
- Preferred: Experience with tools such as Quantum Metrics and Akamai.
- Preferred: Additional programming experience with languages such as R.
- Preferred: Data engineering experience in the transportation or airline industry.
- Strong interpersonal skills; a "people person" who can lead, influence, and collaborate effectively.
About PTR Global: PTR Global is a leading provider of information technology and workforce solutions. PTR Global has become one of the largest providers in its industry, with over 5000 professionals providing services across the U.S. and Canada. For more information visit ;br>
At PTR Global, we understand the importance of your privacy and security. We NEVER ASK job applicants to:
- Pay any fee to be considered for, submitted to, or selected for any opportunity.
- Purchase any product, service, or gift cards from us or for us as part of an application, interview, or selection process.
- Provide sensitive financial information such as credit card numbers or banking information. Successfully placed or hired candidates would only be asked for banking details after accepting an offer from us during our official onboarding processes as part of payroll setup.
Pay Range: $XXX - $XXX
The specific compensation for this position will be determined by several factors, including the scope, complexity, and location of the role, as well as the cost of labor in the market; the skills, education, training, credentials, and experience of the candidate; and other conditions of employment. Our full-time consultants have access to benefits, including medical, dental, vision, and 401K contributions, as well as PTO, sick leave, and other benefits mandated by applicable state or localities where you reside or work.
If you receive a suspicious message, email, or phone call claiming to be from PTR Global do not respond or click on any links. Instead, contact us directly at +1 . To report any concerns, please email us at
#LI-KG1
.png?format=webp)
.png%3Fformat%3Dwebp&w=384&q=75)
