Role Name: AI Data Analyst (Agentic AI)
Work site: Charlotte, US (Onsite)
Employment Type: Contract
Job Description
AI Data Analyst
Experience: 8+ years
About the Role
We are seeking an experienced AI Data Analyst to analyze data, generate insights, and support the development and evaluation of AI/ML and generative AI solutions. This role bridges traditional data analysis with emerging AI capabilities — helping teams make data-driven decisions and assess the performance and impact of AI systems.
Key Responsibilities
Analyze structured and unstructured data to identify trends, patterns, and actionable insights
Support evaluation of AI/ML and generative AI model outputs (accuracy, quality, bias, relevance)
Design and build dashboards and reports to track AI system performance and business KPIs
Partner with data scientists and AI engineers to define metrics for model evaluation and monitoring
Write and optimize SQL queries to extract and transform data from various sources
Perform exploratory data analysis (EDA) to support model development and feature identification
Assist in labeling, curating, and validating datasets used for training and fine-tuning AI models
Translate business requirements into analytical frameworks and present findings to stakeholders
Identify data quality issues and work with engineering teams to resolve them
Stay current on AI/ML trends relevant to data analysis and reporting
Required Qualifications
5+ years of experience in data analysis, business intelligence, or related analytics roles
Strong proficiency in SQL and data querying/transformation
Experience with Python (pandas, NumPy) or R for data analysis
Experience with BI/visualization tools (Tableau, Power BI, Looker, or similar)
Understanding of AI/ML concepts and exposure to evaluating model outputs or working alongside ML teams
Strong statistical analysis skills
Excellent communication skills — able to translate data insights for both technical and non-technical stakeholders
Experience working with large datasets in cloud data warehouses (BigQuery, Snowflake, Redshift)
Preferred Qualifications
Experience evaluating generative AI/LLM outputs (prompt quality, hallucination detection, response scoring)
Familiarity with Google Cloud Platform data tools (BigQuery, Looker, Vertex AI)
Experience with A/B testing and experimentation frameworks
Background in data governance or data quality frameworks
Exposure to Python-based ML libraries (scikit-learn) a plus
Good to have
Google Cloud Platform, Vertex AI, Data Modeling, ETL/ELT, Data Quality, Data Visualization, Prompt Engineering, RAG, Cloud Storage, Dataflow
Never miss an opportunity! Create an alert based on the job you applied for.
