Role: Python Data Engineer
Location: Dallas, TX (Hybrid) | Contract
What you’ll do:
• Be a part of a new energetic team of engineers delivering fresh Products.
• Work primarily as a Data Engineer with enterprise solutions, open-source technologies and applications.
• Work in a fast-paced environment along with passionate, technology rock stars.
• Follow coding standards, build appropriate unit tests, integration tests and deployment scripts.
• Ensure full automation and continuous integration.
• Continuously problem-solve to create secure and simple solutions.
• Create a robust backend for massive scalability and high performance.
• Bring to life elegant and modern data solutions.
• Provision Gartner Tools clusters and components on the cloud.
• Ensure full automation and continuous integration.
What you’ll need:
• Bachelor's or Master's degree in Computer Science or related engineering field w/experience in software development.
• 4-7 years of experience developing customer facing products or web applications.
• Expertise in Apache Spark, Databricks, EMR and similar frameworks with Python programming as primary skill.
• Expert skills in creating data engineering pipelines.
• Expert skills in monitoring and provisioning clusters on AWS.
• Expert skills in AWS services like S3, Lambda, EMR serverless, Step Functions.
• Exposure to GitOps, DevOps and CI/CD pipelines.
• Built solutions for high performance and cost optimization.
• Exposure to relational & NoSQL databases (PostgreSQL / Elastic Search / MongoDB or similar)
• Exposure to writing machine learning algorithms is a big plus.
• Experience with Terraform or IaC is a plus.
• Excellent communication and interpersonal skills.