AI Data Engineer

Job Title: AI Data Engineer

Location: Atlanta, GA

Duration: 6 Months + Extension

Bill Rate: $83/hour

Job Type: W-2 Contract

Client: To Be Discussed Later

Work Authorization: H-1B, OPT-EAD, GC-EAD, -EAD

Job Summary: 

• Develop, maintain, and optimize Python pipelines for data ingestion, OCR processing, text extraction, cleaning, normalization, and deduplication.
• Run and monitor large-scale batch processing jobs, investigate failures, and implement reliable retry and recovery mechanisms.
• Build automated quality checks to identify missing or corrupted files, incomplete OCR outputs, duplicate content, formatting issues, and metadata inconsistencies.
• Prepare training-ready datasets through filtering, text segmentation, tokenization, and conversion into agreed data formats.
• Manage bulk uploads, downloads, and synchronization between local processing environments and cloud storage; verify transfer completeness and data integrity.
• Organize raw data, intermediate outputs, and released datasets with consistent naming, metadata, versioning, and source traceability.
• Optimize processing throughput, memory usage, storage consumption, and cloud costs using appropriate batch, parallel, or distributed processing approaches.
• Track dataset statistics, processing coverage, quality metrics, and exceptions; produce clear operational reports.
• Collaborate with applied scientists and model-training teams to translate data requirements into reproducible processing workflows.
• Maintain tested, documented, version-controlled code and follow established data access, security, and governance requirements.
  
  Equal Opportunity Employer: We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.