Data Engineer - Charlotte, NC - Need Locals Only
Full Time
No Travel Required
Hybrid
Depends on Experience
CogniSoft Technologies
Fitment
Dice Job Match Score™
🔢 Crunching numbers...
Job Details
Skills
- Data Engineer
- Python
- Spark
- Amazon S3
- API
Summary
Key responsibilities for the Data Engineer:
- Optimize data pipelines that read from Kinesis and Write into Oracle improve exception handling for schema/data type mismatches and implement alerting for data quality issues.
- Build services to read/write data to NetApp object store using the S3 API.
- Create analytical datasets in Parquet or Iceberg format.
- Develop housekeeping scripts for cleanup, archiving, and compression of logs, Object store files, etc.
Core skill requirements:
- Strong Python/Java and data engineering expertise.
- Experience building and deploying data pipelines using frameworks like Spark, Flink and understanding of distributed data systems.
- Hands-on experience with real-time streaming architectures, REST APIs, and database connectors.
- Proficient with and Relational Databases (e.g. Oracle).
- Experience working with Amazon S3 APIs for data storage and integration.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
- Dice Id: 10527831
- Position Id: 9123867
- Posted 58 minutes ago
Company Info
CogniSoft Technologies focuses on providing niche Business Intelligence & Data Analytic solutions to businesses across various industries. We are Tableau Alliance Partners. We are also an SAP certified Company.
We are a team of experienced, dedicated, hardworking, and innovative professionals who have had proven their expertise in different business verticals such as Banking and Financial Industry, Healthcare, Supply chain, Insurance, Software Development, IT consulting, Business consulting etc.
Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.