Sr Data Engineer

NTT DATA's Client is seeking a Sr Data Engineer located at Carlsbad, CA or Pittsburg to work with Data Science and Data Architecture team to build Databricks-based Data Pipeline and bring data onto our enterprise-level data platform for Data Science, Analytics and Digital Marketing needs. The data platform is primarily based on Oracle Exadata database, AWS Redshift and Databricks-based Delta technologies toward Lakehouse transition to enable Data Science, Data Analytics, Customer Analytics and Data Services for critical Application and Business enablement

What Will You Do?

Design, develop, test, deploy, support, enhance data integration solutions seamlessly to connect and integrate client enterprise systems in our Data Science and Enterprise Data Platform.
Innovate for data integration in Apache Spark-based Platform to ensure the technology solutions leverage cutting edge integration capabilities.
Facilitate requirements gathering and process mapping workshops, review business/functional requirement documents, author technical design documents, testing plans and scripts.
Assist with implementing standard operating procedures, facilitate review sessions with functional owners and end-user representatives, and leverage technical knowledge and expertise to drive improvements.
Defining, designing and documenting reference architecture and leading the implementation of BI and analytical solutions.
Follow agile development methodologies to deliver solutions and product features by following DevOps practices.
How Will You Get Here?

4-year degree with a major in computer science engineering (or equivalent) from an accredited university (preferred) will substitute for a minimum of 8-10 years professional IT experience
Experience, Knowledge, Skills, Abilities

Experience in Databricks, Data/Delta Lake, Oracle, or AWS Redshift type relational databases.
Extensive experience in Databricks/Spark-based Data Engineering Pipeline development
8+ years working experience in Python-based data integration and pipeline development.
Data lake and Delta Lake experience with AWS Glue and Athena.
5+ years of Experience with AWS Cloud on data integration with Apache Spark, Glue, Kafka, Elastic Search, Lambda, S3, Redshift, RDS, MongoDB/DynamoDB ecosystems.
Strong real-life experience in python development especially in pySpark in AWS Cloud environment
Design, develop test, deploy, maintain, and improve data integration pipeline.
Experience in Python and common python libraries.
Lead engineering team to drive the project initiatives and flexible to work on onsite and offshore model with India & China teams.
Strong analytical experience with database in writing complex queries, query optimization, debugging, user defined functions, views, indexes etc.
Strong experience with source control systems such as Git and Jenkins build and continuous integration tools.
Highly self-driven, execution-focused, with a willingness to do "what it takes to deliver results as you will be expected to rapidly cover a considerable amount of demands on data integration
Understanding of development methodology and actual experience writing functional and technical design specifications.
Excellent verbal and written communication skills, in person, by telephone, and with large teams.
Strong prior technical, development background in either data Services or Engineering
Demonstrated experience resolving complex data integration problems.
Must be able to work cross-functionally. Above all else, must be equal parts data-driven and results-driven.
Scrum and Agile experience and need to participate and run scrum team as tech lead.
Require to have background of the informatica or any other ETL took experience

#LI-IST

About NTT DATA:

NTT DATA is a $30 billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long term success. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies. Our services include business and technology consulting, data and artificial intelligence, industry solutions, as well as the development, implementation and management of applications, infrastructure and connectivity. We are one of the leading providers of digital and AI infrastructure in the world. NTT DATA is a part of NTT Group, which invests over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the digital future. Visit us at

NTT DATA endeavors to make accessible to any and all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact us at . This contact information is for accommodation requests only and cannot be used to inquire about the status of applications. NTT DATA is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status. For our EEO Policy Statement, please click . If you'd like more information on your EEO rights under the law, please click . For Pay Transparency information, please click .

Where required by law, NTT DATA provides a reasonable range of compensation for specific roles. The starting hourly range for this role is (HOURLY RATE 55 TO 62 MAX). Actual compensation will depend on several factors, including the candidate's relevant experience, technical skills, and other qualifications.

This position is eligible for company benefits that will depend on the nature of the role offered. Company benefits may include medical, dental, and vision insurance, flexible spending or health savings account, life, and AD&D insurance, short-and long-term disability coverage, paid time off, employee assistance, participation in a 401k program with company match, and additional voluntary or legally required benefits .