Big Data Engineer - Atlanta

  • Xconic,
  • Atlanta, GA
  • 1 month ago
Advanced analytics, Agile, Analytics, Apache Framework, Apache Hive, Apache Hadoop, Apache Spark, Artificial intelligence, Big data, Cloud, Data analysis, Data science, Data warehouse, Distributed computing, IT infrastructure, Machine learning, Python, Scala, Scripting, Scrum, Snow flake schema, Unix, Unstructured data, scikit-learn
Full Time
Depends on Experience
Work from home not available Travel not required

Job Description

This is a contract to hire OR direct hire for right candidate. Client will transfer H1b for the right candidate. Role can be in Atlanta, GA or Chicago, IL or St Petersburg, FL (Tampa). Need candidates located in either of three locations.

Onsite interview after initial phone screening. Relocation assistance not available.

Background and reference check as part of the hiring process.

Sr. Big Data Developer

Our Team

The mission of the Analytics Architecture team is to enable analytics at scale. We do this by making sure the Analytics and Data Science teams have the necessary Cloud Infrastructure, Tools and Data to execute their research and development of machine learning/AI models. We then work to implement these models into the larger technology infrastructure. The team is the link between Analytics business mission, strategy, and processes of the organization to its IT strategy


  • Develop Analytics Solutions in Big Data technologies (Hadoop, Azure Cloud, Hive, Databricks, Spark (Scala/Python), and other open source technologies) resulting in stable and high-quality code within deadlines, following established process.
  • Design, develop and deploy production-ready code at scale
  • Design, develop and maintain data collection pipelines from diverse sources, large scale structured and unstructured data
  • Design, develop and maintain pipelines for machine learning model training and development
  • Experience in scaling spark applications, optimizations and performance tuning
  • Proven proficiency with data analysis and ability to troubleshoot data issues
  • Maintain in-depth knowledge of data ecosystem and trends; be a subject matter expert and thought leader.
  • Participate in peer review code sessions to ensure quality of code.
  • Actively participate in SCRUM ceremonies ensuring the velocity of the team continues to improve and work becomes more streamlined.
  • Actively participate in performance tuning to maximize resources.
  • Track and resolve data issues showing creative problem-solving skills.
  • Knowledgeable in Cloud Data Warehouse solutions like Snowflake and Synapse is a plus
  • Clearly communicate with management on proposed solutions/challenges.
  • Document solutions following company standards and clearly communicate designs.
  • Support production environment and previously deployed solutions.
  • Recommends new tools to improve current stack and solve data needs efficiently.
  • Develop/unit test and deploy data solutions (high complexity).
  • Present solutions to product owners/managers.
  • Participate in talent acquisitions tasks such as resume review/interviews.


  • 5+ years of experience with some of the Big Data technologies (Hadoop, Azure Cloud, Hive, Databricks, Spark (Scala/Python)
  • 3-5+ years of experience in ML/Datascience libraries like Scikit-learn, Pandas, Numpy, Tensorflow, Keras
  • 5-9+ years of experience with Linux/Unix Systems, scripting.
  • Experience of software engineering in Python/Scala
  • Experience and expertise in using Spark either on-premise or Cloud
  • Expert knowledge of distributed computing, RDD and optimization techniques
  • Experience with advanced analytics and modern machine learning techniques
  • Experience in work automation.
  • Working knowledge of Agile software engineering processes.
  • Able to develop/unit test and deploy complex data & analytic solutions.
  • Able to mentor fellow co-workers to expand overall team skills.
  • Positive attitude towards challenges.
  • Advanced communication skills to present solutions clearly to the team and users.
  • Process mapping experience
  • Community developer presence (github, apache, open source projects, etc)

Posted By

Santa Clara, CA, 95054

Dice Id : 10444937
Position Id : 6433179
Originally Posted : 1 month ago
Have a Job? Post it

Similar Positions

Big Data Engineer - US Telecommute
  • UnitedHealth Group
  • Atlanta, GA
Big Data Engineer
  • Eliassen Group
  • Atlanta, GA
BigData Engineer
  • DataKare Solutions LLC
  • Atlanta, GA
Big Data Architect I
  • BuzzClan LLC
  • Atlanta, GA
Big Data Engineer
  • Qcentum Technologies
  • Alpharetta, GA
Big Data Architect I
  • Pyramid Consulting, Inc.
  • Atlanta, GA
Big Data Engineer
  • Activesoft, Inc.
  • Atlanta, GA
Big Data Architect
  • Saturn Infotech Inc
  • Atlanta, GA
Big Data Engineer
  • Open Systems, Inc.
  • Atlanta, GA
Big Data Administrator
  • Arthur Lawrence
  • Alpharetta, GA
Big Data Architect
  • HCL Global Systems
  • Alpharetta, GA
Big Data Developer
  • Atlanta, GA
Big Data Engineer / Hadoop developer
  • VLink Inc
  • Alpharetta, GA