Senior Data Engineer

About Us:

LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 700+ clients, LTIMindtree brings extensive domain and technology expertise to help drive superior competitive differentiation, customer experiences, and business outcomes in a converging world. Powered by nearly 90,000 talented and entrepreneurial professionals across more than 30 countries, LTIMindtree a Larsen & Toubro Group company combines the industry-acclaimed strengths of erstwhile Larsen and Toubro Infotech and Mindtree in solving the most complex business challenges and delivering transformation at scale. For more information, please visit. www.;/p>

Job Title: Data engineer

Location: Pittsburgh, PA (4 days onsite/week)

Duration: FTE

Job Description

Senior Developer 8 years exp who has advanced hands-on skill in distributed data processing using pyspark Scala.

Worked with data processing ETL transformation logic Strong SQL

Prior experience in financial domain and entity identity resolution is preferred

Design and develop scalable data pipelines using Apache Spark and PySpark ensuring high performance and efficiency

Optimize Spark jobs and clusters for performance tuning resource utilization and cost efficiency

Implement and manage data storage solutions on Hadoop Distributed File System HDFS and cloud storage services like Amazon S3

Utilize Scala or Java to write and optimize core data processing logic complex transformations and highly performant backend services

Ensure strict data quality governance and validation checks are integrated into all data pipelines to maintain accuracy and reliability of the data ecosystem

Deploy manage and scale data applications and services using various AWS compute resources including Amazon EC2 instances AWS EMR clusters and containerized environments via Amazon ECS

Design and develop robust high-performance RESTful APIs and microservices using ScalaJava to facilitate real-time data access and transactional services

Skills

Mandatory Skills : ETL Concepts, Python, Scala and Strong SQL

Benefits/perks listed below may vary depending on the nature of your employment with LTIMindtree ( LTIM ):

Benefits and Perks:

• Comprehensive Medical Plan Covering Medical, Dental, Vision
• Short Term and Long-Term Disability Coverage
• 401(k) Plan with Company match
• Life Insurance
• Vacation Time, Sick Leave, Paid Holidays
• Paid Paternity and Maternity Leave

The range displayed on each job posting reflects the minimum and maximum salary target for the position across all US locations. Within the range, individual pay is determined by work location and job level and additional factors including job-related skills, experience, and relevant education or training. Depending on the position offered, other forms of compensation may be provided as part of overall compensation like an annual performance-based bonus, sales incentive pay and other forms of bonus or variable compensation.

Disclaimer: The compensation and benefits information provided herein is accurate as of the date of this posting.

LTM is an equal opportunity employer that is committed to diversity in the workplace. Our employment decisions are made without regard to race, color, creed, religion, sex (including pregnancy, childbirth or related medical conditions), gender identity or expression, national origin, ancestry, age, family-care status, veteran status, marital status, civil union status, domestic partnership status, military service, handicap or disability or history of handicap or disability, genetic information, atypical hereditary cellular or blood trait, union affiliation, affectional or sexual orientation or preference, or any other characteristic protected by applicable federal, state, or local law, except where such considerations are bona fide occupational qualifications permitted by law.