Senior Data Engineer 17 (10)

Who are we?

We’re  and , services of  We help connect professionals with the careers they want and companies with the talent they need—which we do by providing online access to relevant and meaningful jobs, candidates and insights within the communities we serve. And we’re looking for talent like you to join us in our mission to Connect Futures Now.

Why join us?

We're a team of passionate achievers partnering for the success of our customers and colleagues.
We're transforming the markets we serve by celebrating flexibility, ingenuity and inclusivity in all we do.
We're engaged in challenging, meaningful work to enhance the livelihood of those using our services.
We're coalescing in open, collaborative and dynamic environment where everyone's voice matters.
And so as you grow your career with us, we all thrive.

Why this role?

As Senior Data Engineer - ClearanceJobs you'll focus on design and implementation of the ClearanceJobs.com online web property as well as serving the needs of our product and sales organization with their data analysis and reporting needs. You will work collaboratively with the product, sales, engineering, analytics, and business product owners utilizing cloud-based tools and our cloud infrastructure in AWS. You will work alongside architecture and engineering teams in an agile-based setting to standardize and promote best practices in the areas of data engineering, data warehousing, analytics and reporting.

In this role, you'll be responsible for:

• The full lifecycle of data within the ClearanceJobs data ecosystem
• Architecture, building, and supporting the operation of our AWS-based and on-premises enterprise data infrastructure
• Designing robust, reusable and scalable data solutions and data pipelines to automate the ingestion, processing and delivery of structured and unstructured, batch and real-time streaming data
• Evaluating, selecting and implementing new data related tools, frameworks and applications required to expand our platform capabilities
• Understanding and implementing best practices in management of enterprise data, including master data, reference data, metadata, and data quality metrics
• Training and mentoring junior data engineering resources in best practices, agile development, and Big Data/Cloud ETL
• Taking requirements from business teams and turning those into technology requirements
• Designing, testing, deploying and maintaining reports in the development and production environments
• Participating in an on-call rotation, following established incident management, change management, and root cause analysis processes

Knowledge, Skills, Abilities

• Proficiency in shell scripting and MySQL
• Strong background in SQL-based databases and designing and architecting data warehouses. Experience with an MPP technology such as Amazon Redshift preferred
• Outstanding interpersonal communication and written skills, with the ability to work in a team environment
• Proficiency in building and maintaining data integrations with exception handling, self-healing, event triggering, and notifications
• Coordinate with Software Engineers, Data Scientists, Consultants, Project Managers, Quality Assurance Analysts, etc. to develop data-based products (Tableau)
• Familiarity with Agile Scrum software development practices and working in a Scrum data engineering team
• Naturally curious, inquisitive, and willing to learn new skills

Education, Experience

• BS in Computer Science/Computer Engineering, or related discipline, or equivalent work experience
• 5+ years of experience with data warehousing architecture and implementation, including hands on experience developing ETL (Stitch, DBT)
• Hands-on experience with source control and versioning strategies using Bitbucket
  Preferred experience:
• Experience with AWS components and services, particularly: Redshift, S3, CloudFormation, or AppFlow
• Hightouch.io experience beneficial
• Experience with developing end-to-end data pipelines in large cloud-compute infrastructure solutions such AWS, Azure, or Google
• Hands-on experience with applying test-driven development and DataOps practices to data engineering including automated deployment of database changes using a continuous integration pipeline
• Relevant technology or platform certification (AWS Certified, Microsoft Certified)
• Knowledge of CI/CD and DevOps
• Knowledge of Database concepts such as SQL, relational, and non-relational
• Experience with source control (BitBucket, Git) and Object Repositories (Artifactory/Nexus)