Python, PySpark, Scala Developer

company banner
Full Time

Job Description

Are you an experienced, passionate pioneer in technology - a solutions builder, a roll-up-your-sleeves technologist who wants a daily collaborative environment, think-tank feels and share new ideas with your colleagues - without the extensive demands of travel? If so, consider an opportunity with our US Delivery Center - we are breaking the mold of a typical Delivery Center.

Our US Delivery Centers have been growing since 2014 with significant, continued growth on the horizon. Interested? Read more about our opportunity below ...


Function as an integrator between business needs and technology solutions, helping to create technology solutions to meet clients' requirements. Be responsible for developing and

testing solutions that aligns with clients' systems strategy, requirements, and design as well as supporting system implementation. Manage data pipeline process starting from acquisition to ingestion, storage, and provisioning of data to point-of-impact by modernizing and enabling new capabilities. Facilitate Data Integration on traditional and Hadoop environments by assessing client's enterprise IT environments. Guide clients to the future IT environment state to support meeting their long-term business goals. Enhance business drivers through enterprise-scale applications that enable visualization, consumption and monetization of both structured and unstructured data.

The Team

From our centers, we work with Deloitte consultants to design, develop and build solutions to help clients reimagine, reshape and rewire the competitive fabric of entire industries. Our centers house a multitude of specialists, ranging from systems designers, architects and integrators, to creative digital experts, to cyber risk and human capital professionals. All work together on diverse projects from advanced preconfigured solutions and methodologies, to brand-building and campaign management.

We are a unique blend of skills and experiences, yet we underline the value of each individual, providing customized career paths, fostering innovation and knowledge development with a focus on quality. The US Delivery Center supports a collaborative team culture where we work and live close to home with limited travel.



• Bachelor of Science in Computer Science, Engineering, or MIS, or equivalent experience

• 6+ years of Hadoop (Cloudera distribution) experience

• 6+ years of experience in Spark with Scala or Python programming

• 6+ years of experience with Hive Tuning, Bucketing, Partitioning, UDF and UDAF

• 6+ years of NOSQL Data Base such as HBase, MongoDB or Cassandra experience

• 6+ years of experience and knowledge working in Kafka, Spark streaming, Sqoop, Oozie, Airflow, Control-M, Presto, No SQL, SQL

• 6+ years knowledge of working in financial/insurance domain experience

• 6+ years of strong technical skills including understanding of software development principles

• 6+ years of hands-on programming experience

• Must live a commutable distance to one of the following cities:

Atlanta, GA; Austin, TX; Boston, MA; Charlotte, NC; Chicago, IL; Cincinnati, OH; Cleveland, OH; Dallas, TX; Detroit, MI; Gilbert, AZ; Houston, TX; Indianapolis, IN; Kansas City, MO; Lake Mary, FL; Los Angeles, CA; Mechanicsburg, PA; Miami, FL; McLean, VA; Minneapolis, MN; Nashville, TN; Orange County, CA; Philadelphia, PA; Phoenix, AZ; Pittsburgh, PA; Rosslyn, VA; Sacramento, CA; St. Louis, MO; San Diego, CA; Seattle, WA; Tallahassee, FL; Tampa, FL; or be willing to relocate to one of the following USDC locations: Gilbert, AZ; Lake Mary, FL; Mechanicsburg, PA.

• Ability to travel up to 15%


• 6+ years of experience working with Big Data eco-system including tools such as Map Reduce, Sqoop, HBase, Hive and Impala

• Expert level usage with Jenkins and GitHub

• Proficiency in one or more modern programming languages like Python or Scala

• Experience on data lakes and datahub implementation

• Knowledge on AWS or Azure platforms

• Knowledgeable in techniques for designing Hadoop-based file layout optimized to meet business needs

• Able to translate business requirements into logical and physical file structure design

• Ability to build and test solution in agile delivery manner

• Ability to articulate reasons behind the design choices being made

• Any bigdata certification is a plus

Company Information

Deloitte provides industry-leading audit, consulting, tax and advisory services to many of the world’s most admired brands, including nearly 90% of the Fortune 500® and more than 7,000 private companies. Our people come together for the greater good and work across the industry sectors that drive and shape today’s marketplace—delivering measurable and lasting results that help reinforce public trust in our capital markets, inspire clients to see challenges as opportunities to transform and thrive, and help lead the way toward a stronger economy and a healthier society. Deloitte is proud to be part of the largest global professional services network serving our clients in the markets that are most important to them. Now celebrating 175 years of service, our network of member firms spans more than 150 countries and territories. Learn how Deloitte’s more than 330,000 people worldwide connect for impact on our website.

Dice Id : 10106525
Position Id : 71773
Originally Posted : 4 months ago

Similar Positions at Deloitte

PySpark Data Engineer
  • Costa Mesa, CA
  • 23 hours ago
PySpark Data Engineer
  • New York, NY
  • 23 hours ago