Job#: 3030606 Job Description: Remote Data Automation Engineer
Location: Remote with quarterly travel to Washington, D.C.
Employment Type: Contract
Role Overview
We are seeking a customer experience-focused Data Automation Engineer to join a team of subject matter experts and developers. This role involves designing and implementing innovative data automation solutions for an Azure cloud-based data lake, SQL, and NoSQL platform. The successful candidate will translate business requirements into data engineering and AI-based solutions to support an enterprise-scale Microsoft Azure data analytics and reporting platform. This position requires a mission-focused and delivery-oriented individual who applies critical thinking to create innovative functions and solve technical issues.
Key Responsibilities
- Utilize Microsoft Azure services including Azure Data Factory, Synapse Pipelines, Apache Spark Notebooks, Python, and SQL to develop high-performing data pipelines.
- Continuously improve and optimize the automation toolset for reliability, scalability, and adaptability.
- Research and implement AI/ML and GenAI tools to develop intelligent applications, scripts, and ETL pipelines that automate data processes.
- Work with implementation specialists, engineering teams, and customers to understand data-driven needs and build effective solutions.
- Identify, create, and prepare data required for advanced analytics, visualization, reporting, and AI/ML.
- Implement data migration, data integrity, data quality, metadata management, and data security functions to optimize data pipelines.
- Monitor and troubleshoot data-related issues to maintain high availability and performance.
- Assist in ETL performance testing for data pipelines by executing test runs and validating data load performance.
- Support performance analysis by comparing new pipeline performance with legacy system metrics.
- Collaborate with DevOps and infrastructure teams to understand how system resources impact pipeline performance.
- Actively support the Agile DevOps process, including Program Increment planning.
Required Qualifications
- A BS degree in Computer Science or a related field with 2+ years of experience in a relevant field required
- 2+ years of experience with scripting languages such as SQL, T-SQL, MDX/DAX, Python, and PySpark.
- Experience designing and building ETL/data engineering solutions using cloud services like Azure Data Lake Services, Azure Synapse Analytics, and Azure Data Factory.
- Experience with Microsoft database and business intelligence tools, including SQL Server, SSIS, SSRS, SSAS, and Power BI.
- Experience with data automation using Azure/AWS CLI tools with Bash or PowerShell scripting.
- Familiarity with Azure DevOps Repos or GitHub for pipeline versioning and release management.
Preferred Qualifications
- Experience or certifications in Generative AI development or Generative AI for Data Analytics.
- Microsoft certification in Azure fundamentals, data engineering, Power BI, or AI; or AWS certified data engineer.
- Integration knowledge using enterprise/open-source ETL toolsets, REST API, or Docker.
- Experience with performance fine-tuning, data profiling, and query analytics.
- Knowledge of security compliance standards related to data encryption and cloud networks.
- Candidates with an existing Public Trust, particularly a DOJ Public Trust, are preferred.
PLEASE NOTE: Candidates must be able to obtain and/or maintain a Public Trust clearance as a condition and continuation of employment.
Compensation & Benefits
The anticipated pay range for this position is between $40.00 and $45.00 per hour. Please note that a contractor's eligibility for benefits is determined by the specific employer of record, and may be available for purchase. For more information, please speak with your recruiter.
This employer is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. This employer will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law.
Apex uses a virtual recruiter as part of the application process. Click for more details.
If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact our Benefits Department at or .
Apex Systems is a world-class IT services company that serves thousands of clients across the globe. When you join Apex, you become part of a team that values innovation, collaboration, and continuous learning. We offer quality career resources, training, certifications, development opportunities, and a comprehensive benefits package. Our commitment to excellence is reflected in many awards, including ClearlyRated's Best of Staffing in Talent Satisfaction in the United States and Great Place to Work in the United Kingdom and Mexico. Apex uses a virtual recruiter as part of the application process. Click for more details.
Apex Benefits Overview: Apex offers a range of supplemental benefits, including medical, dental, vision, life, disability, and other insurance plans that offer an optional layer of financial protection. We offer an ESPP (employee stock purchase program) and a 401K program which allows you to contribute typically within 30 days of starting, with a company match after 12 months of tenure. Apex also offers a HSA (Health Savings Account on the HDHP plan), a SupportLinc Employee Assistance Program (EAP) with up to 8 free counseling sessions, a corporate discount savings program and other discounts. In terms of professional development, Apex hosts an on-demand training program, provides access to certification prep and a library of technical and leadership courses/books/seminars once you have 6+ months of tenure, and certification discounts and other perks to associations that include CompTIA and IIBA. Apex has a dedicated customer service team for our Consultants that can address questions around benefits and other resources, as well as a certified Career Coach. You can access a full list of our benefits, programs, support teams and resources within our 'Welcome Packet' as well, which an Apex team member can provide.