Overview
Hybrid
Depends on Experience
Contract - W2
Skills
Cloud Computing
Cloudera
Jenkins
Apache Kafka
Apache Hive
Big Data
Apache Spark
Apache Hadoop
Apache HBase
Ansible
Python
Job Details
Position : Sr Data Engineer
Work Location: Charlotte NC
NOTE: Need to be local to Charlotte NC /Ready to relocate from day one onsite for charlotte NC Location
Our challenge :
We are seeking a talented Senior Data Engineer to join our Charlotte, NC hub in a hybrid work model. This role is pivotal in designing, building, and maintaining scalable data pipelines and architectures to support advanced analytics, data science, and business intelligence efforts. The ideal candidate will have a strong foundation in data engineering best practices, cloud technologies, and a passion for leveraging data to solve complex business problems.
Requirements:
- 8+ years of experience working with Big Data technologies such Hadoop, Hive, Spark, HBase, Impala, Pig, Kafka, NiFi etc
- Hands-on development experience using functional programming constructs utilizing languages like Python and Scala.
- Familiarity with the pythonic eco-system (Pandas, Jupyter notepad etc)
- Extensive experience designing and implementing complex solutions for distributed systems
- Working knowledge of Cloudera or Hortonworks technology stacks
- Expertise in performance profiling, ability to identify performance improvements and memory optimizations
- Strong coding, debugging, and analytical skills
- Strong problem-solving and communication skills; enjoys a collaborative environment
- Flexible, self-starter & independent, fast-learner; willing and able to quickly learn newtechnologies and skills; desire to understand not only what to do but also why
- Experience CI/CD automation using tools such as Jenkins/Ansible
- Familiarity with Capital Markets and Regulatory Reporting business domain
- Experience implementing SDM automation using tools such as Git/Jenkins/Ansible
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.