Job#: 3043401 Job Description: Data Engineer
Location: Greenwood Village, Colorado (Remote)
Role Overview
This role is for a Data Engineer to design, build, and maintain the ETL pipelines and data infrastructure that feed a data lake, anomaly detection models, and AI agents. The position focuses on constructing robust, scalable data pipelines using Spark/Scala, ensuring data quality and availability across a growing portfolio of network data sources. The goal is to enable downstream consumers such as data scientists, agents, and dashboards to access reliable, well-structured data.
Key Responsibilities
- Design, develop, and maintain scalable ETL pipelines using Apache Spark (Scala) to ingest, transform, and load network data into the data lake.
- Onboard new data sources (network telemetry, syslogs, SNMP traps, device configuration data, ticketing systems) by building ingestion pipelines.
- Implement monitoring and alerting solutions to ensure data pipeline reliability and performance.
- Develop and manage deployment pipelines for continuous integration and delivery of data engineering solutions.
- Manage and optimize data storage solutions, including distributed file systems, relational databases, and external sources accessed via API.
- Implement data quality checks, validation rules, and automated testing to ensure pipeline reliability and data integrity.
- Optimize pipeline performance for large-scale data processing across batch and mini-batch processing patterns.
- Manage and evolve data schemas, partitioning strategies, and storage formats.
- Support data backfills and recovery when upstream issues or schema changes require reprocessing.
- Collaborate with data scientists and agent developers to deliver datasets that support anomaly detection models and AI agent workflows.
Required Qualifications
- Expert-level experience in building and maintaining ETL pipelines for Big Data.
- Programming experience with Python and/or Scala.
- Experience with large-scale data processing with Spark.
- Experience with AWS services: S3, Glue, Athena, and EMR, including working with EMR as the operating system.
- Strong understanding of relational databases and SQL.
- Knowledge of data architecture, data warehousing, partitioning strategies, and columnar storage formats (e.g., Parquet).
- Experience with workflow orchestration tools, with a preference for Airflow.
- Proficiency with Linux-based operating systems and shell scripting.
- Experience with Git-based version control and collaborative development workflows.
Preferred Qualifications
- Experience with streaming or mini-batch data processing (Spark Streaming, structured streaming, or similar).
- Experience with Apache Kafka or similar messaging/streaming platforms.
- Experience with NoSQL databases.
- Experience in the telecommunications industry or other large-scale network operations environments.
- Familiarity with network data sources: telemetry, syslogs, SNMP traps, device configuration data.
- Experience with data integration via REST APIs and cloud SDKs (e.g., boto3).
- Experience writing automated tests for data pipelines.
- Knowledge of text analysis or log parsing techniques.
Everforth Apex is a world-class IT services company that serves thousands of clients across the globe. When you join Everforth Apex, you become part of a team that values innovation, collaboration, and continuous learning. We offer quality career resources, training, certifications, development opportunities, and a comprehensive benefits package. Our commitment to excellence is reflected in many awards, including ClearlyRateds Best of Staffing in Talent Satisfaction in the United States and Great Place to Work in the United Kingdom and Mexico.
Everforth Apex uses a virtual recruiter as part of the application process. Click for more details. By applying for this job, you agree to receive calls, AI-generated calls, text messages, or emails from Everforth Apex and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy at
Everforth Apex Benefits Overview: Everforth Apex offers a range of supplemental benefits, including medical, dental, vision, life, disability, and other insurance plans that offer an optional layer of financial protection. We offer an ESPP (employee stock purchase program) and a 401K program which allows you to contribute typically within 30 days of starting, with a company match after 12 months of tenure. Everforth Apex also offers a HSA (Health Savings Account on the HDHP plan), a SupportLinc Employee Assistance Program (EAP) with up to 8 free counseling sessions, a corporate discount savings program and other discounts. In terms of professional development, Everforth Apex hosts an on-demand training program, provides access to certification prep and a library of technical and leadership courses/books/seminars once you have 6+ months of tenure, and certification discounts and other perks to associations that include CompTIA and IIBA. Everforth Apex has a dedicated customer service team for our Consultants that can address questions around benefits and other resources, as well as a certified Career Coach. You can access a full list of our benefits, programs, support teams and resources within our 'Welcome Packet' as well, which an Everforth Apex team member can provide.
Everforth Apex Systems is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Everforth Apex will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law.
If you require an accommodation under the Americans with Disabilities Act to participate in an interview with a virtual recruiter or to use our website for a search or application, please contact our Benefits Department at or . Please note that this contact information is strictly to be used for medical ADA accommodations and that no other inquiries will be answered.
UnitedHealthcare creates and publishes the Transparency in Coverage Machine-Readable Files on behalf of Everforth Apex Systems.
Never miss an opportunity! Create an alert based on the job you applied for.
