Data Engineer - Houston, TX - Contract-to-hire/Permanent

Full Time, Contract Corp-To-Corp, Contract Independent, Contract W2, C2H Corp-To-Corp, C2H Independent, C2H W2
Depends On Experience
Work from home not available Travel not required

Job Description

Position: Data Engineer
Location: Houston, TX
Duration: Contract-to-hire/Permanent
ESSENTIAL FUNCTIONS/DUTIES AND RESPONSIBILITIES:
  • ETL: Design, develop, and implement ETL jobs and processes required to ingest and transform data in the cloud environment. The ideal candidate would have very good exposure to Hive, Spark NoSQL data stores, and familiarity with test-driven development
  • Streaming data & events: Design and create data ingestion pipelines to consume external data
  • Exploration and feature engineering: Data exploration, data visualization, and feature engineering
  • Data assets: Participate in data collection, collation, structuring, and cleaning. Maintain data quality through statistical control
  • Tool development: Develop tools that support access, integration, modeling and visualizing of data using SQL (stored procedures and ETL scripting), Python deployment, including packaging (pip) and web frameworks (Flask/Django), familiarity with Orchestration tools like Informatica, Pentaho, Airflow is an added plus
  • API development, including lookup/live, compute designs, concurrency testing, and optimizing autoscaling configurations Implement cloud-native solution architecture, including optimal database selection, data caching strategies, and optimal instance configuration
  • Provide development estimates and prepare technical documentation.
  • Participate in daily scrum meetings to share status updates and raise issues/risks.
  • Automate and document test cases as part of the development process

Regards







Abhijit Mazumdar | Simplion cloud. made simple
Direct: 408-868-2323
Email: abhijit@simplion.com

Posted By

Abhijit Mazumdar

Dice Id : 10120175
Position Id : 2019-3872
Originally Posted : 1 month ago
Have a Job? Post it