Big Data Engineer

python, etl, sql, snowflake, Hadoop, AWS
Contract W2, 12 Months
Depends on Experience
Work from home not available Travel not required

Job Description

ServerLogic has partnered with a local company to identify a Sr Data Engineer for a long-term project.

Responsibilities

  • Design and build product features in collaboration with business and IT
  • Design reusable components, frameworks, libraries like User Defined Functions
  • Build continuous integration and test-driven development environment
  • Performance/scalability tuning, algorithms and computational complexity
  • Develop architecture and design patterns to process and store high volume data sets
  • Participate in an Agile / Scrum methodology to deliver high - quality software releases every 2 weeks through Sprints
  • Troubleshoot production support issues post - deployment and come up with solutions as required

Experience

  • Good understanding and application of modern data processing technology, such as Snowflake, SQL, Spark, Hadoop ecosystem technologies, and others
  • A Bachelor's degree in Business, Information Technology or related field
  • 2+ years experience in a professional organization collaborating across multiple functions
  • Familiarity with Agile project delivery methods
  • Experience with AWS components and services (E.G. EMR, S3, and Lambda)
  • Experience with Jenkins, Bitbucket/GitHub and scheduling tools like Airflow
  • Strong programming, Python, shell scripting and SQL
  • Good understanding of file formats including JSON, Parquet, Avro, and others
  • Experience with data warehouses/RDBMS like Oracle, Teradata, Snowflake
  • Experience with data warehousing, dimensional modeling and ETL development
  • Demonstrable ability to quickly learn new tools and technologies
  • Machine learning frameworks & statistical analysis with Python, R or similar
  • Exceptional interpersonal and communication skills (written and verbal)
  • Passion for data with demonstrated ability to use data to tell a story and influence decision making

Posted By

Hema Ayyagari

9900 SE Greenburg Road Suite 110 Tigard, OR, 97223

Dice Id : 10433716
Position Id : 5479
Originally Posted : 3 months ago
Have a Job? Post it