Overview
Skills
Job Details
A client of Innova Solutions is immediately hiring for a Big Data Engineer
Position Type: Big Data Engineer
Duration: 12+ Months
Location: Temple Terrace, FL / Irving, Dallas TX / Alpharetta, GA (Hybrid 3 Days in a Week Onsite)
As a(n) Big Data Engineer you will:
Job Description:
As a part of our AI & D team, the Data Engineer will be responsible for leading development and validation activities of Big Data products and applications which run on the large Hadoop and Teradata clusters. The qualified engineer will bring technical leadership for developing and testing ETL process, migrating different applications to cloud, developing data validation tools used for performing quality assessments and measurements on different data sets that feed Big Data products. Should have VZ Data & System knowledge of Wireless & Wireline.
The candidate will be involved in,
Lead in design, development and testing of data ingestion pipelines, perform end to end validation of ETL process for various datasets that are being ingested into the big data platform.
Perform data migration and conversion validation activities on different applications and platforms.
Provide the technical leadership on data profiling/analysis, discovery, analysis, suitability and coverage of data, and identify the various data types, formats, and data quality issues which exist within a given data source.
Contribute to development of transformation logic, interfaces and reports as needed to meet project requirements.
Participate in discussion for technical architecture, data modeling and ETL standards, collaborate with Product Managers, Architects and Senior Developers to establish the physical application framework (e.g. libraries, modules, execution environments)
Lead in design and develop validation framework and integrated automated test suites to validate end to end data pipeline flow, data transformation rules, and data integrity.
Develop tools to measure the data quality and visualize the anomaly pattern in source and processed data.
Assist Manager in project planning, validation strategy development
Provide support in User acceptance testing and production validation activities.
Provide technical recommendations for identifying data validation tools, recommend new technologies to improve the validation process.
Evaluate existing methodologies and processes and recommend improvements.
Work with the stakeholders, Product Management, Data and Design, Architecture teams and executives to call out issues, guide and contribute to the resolution s discussions.
Required Skills:
10+ years of Software development and testing experience.
Experience with developing and testing ETL, real-time data-processing and Analytics Application Systems.
Strong knowledge in Spark SQL, Scala code development in big data Hadoop environment and/or BI/DW development experiences.
Experience with development and automated framework in a CI/CD environment.
Experience with cloud environments - Google Cloud Platform is a plus.
A solid understanding of common software development practices and tools.
Strong analytical skills with a methodical approach to problem solving applied to the Big Data domain
Good organizational skills and strong written and verbal communication skills.
Desired Skills:
Working experience on Google Cloud platform is a big plus
Development experience for tools and utilities for monitoring and alert set etc.
Familiarity with project Management and bug tracking tools, i.e., JIRA or a similar tool.
EDUCATION/CERTIFICATIONS:
Please indicate whether education and/or certifications are required or desired.
Bachelor's Degree in computer science, or engineering
The ideal candidate will have: Big Data, Hadoop, Spark, Scala, Google Cloud Platform
Qualified candidates should APPLY NOW for immediate consideration! Please hit APPLY to provide the required information, and we will be back in touch as soon as possible.
We are currently interviewing to fill this and other similar positions. If this role is not a fit for you, we do offer a referral bonus program for referrals that we successfully place with our clients, subject to program guidelines. ASK ME HOW.
Thank you!
YOUR NAME: Pushkar Chaurasiya
PHONE:
EMAIL:
PAY RANGE AND BENEFITS:
Pay Range*: <$80 - $85 per hour>
*Pay range offered to a successful candidate will be based on several factors, including the candidate's education, work experience, work location, specific job duties, certifications, etc.
Benefits: Innova Solutions offers benefits( based on eligibility) that include the following: Medical & pharmacy coverage, Dental/vision insurance, 401(k), Health saving account (HSA) and Flexible spending account (FSA), Life Insurance, Pet Insurance, Short term and Long term Disability, Accident & Critical illness coverage, Pre-paid legal & ID theft protection, Sick time, and other types of paid leaves (as required by law), Employee Assistance Program (EAP).
ABOUT INNOVA SOLUTIONS: Founded in 1998 and headquartered in Atlanta, Georgia, Innova Solutions employs approximately 50,000 professionals worldwide and reports an annual revenue approaching $3 Billion. Through our global delivery centers across North America, Asia, and Europe, we deliver strategic technology and business transformation solutions to our clients, enabling them to operate as leaders within their fields.
Recent Recognitions:
- Named One of America s Best Employers for New Grads by Forbes (2024
- Named One of the Best Companies to Work for by U.S. News & World Report (Private Companies List, 2024-2025)
- One of the Largest IT Staffing Firms in the US Ranked #3 by Staffing Industry Analysts (SIA, 2024)
- One of the Largest Staffing Firms in the US Ranked #13 by Staffing Industry Analysts (SIA, 2024; includes Innova Solutions, Volt, & HireGenics)
- Named One of the Top Ten Private Companies in Atlanta by the Atlanta Business Chronicle (2023)
- One of the Largest Certified Minority Business Enterprises (MBEs) in the United States (NMSDC, 2024)
- AWS Advanced Tier Services Partner with 100+ certifications
Website:
Innova Solutions offers a referral bonus for qualified Ambassadors who refer eligible referrals. Submit referrals at and earn $250-$1,000 per referral.
Innova Solutions is an Equal Opportunity Employer and prohibits any kind of unlawful discrimination and harassment. Innova Solutions is committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment on the basis of race, color, religion or belief, national origin, citizenship, social or ethnic origin, sex, age, physical or mental disability, veteran status, marital status, domestic partner status, sexual orientation, or any other status protected by the statutes, rules, and regulations in the locations where it operates. If you are an individual with a disability and need a reasonable accommodation to assist with your job search or application for employment, please contact us at or . Please indicate the specifics of the assistance needed. Innova Solutions encourages all interested and qualified candidates to apply for employment opportunities. Innova Solutions (HireGenics/Volt) does not discriminate against applicants based on citizenship status, immigration status, or national origin, in accordance with 8 U.S.C. 1324b.
The company will consider for employment qualified applicants with arrest and conviction records in a manner that complies with the San Francisco Fair Chance Ordinance, the Los Angeles Fair Chance Initiative for Hiring Ordinance, and other applicable laws.