Texas State Library and Archives Commision
Texas State Library and Archives Commision

ETL Developer

New York, NY, US • Posted 6 hours ago • Updated 6 hours ago
Full Time
On-site
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Project Scoping
  • System Integration
  • Data Analysis
  • Knowledge Sharing
  • Scripting
  • Data Processing
  • Reporting
  • Systems Analysis/design
  • Development Testing
  • High Availability
  • Scalability
  • Data Quality
  • Application Development
  • Quality Assurance
  • Software Testing
  • Presentations
  • Mentorship
  • Technical Support
  • Management
  • Technical Writing
  • Workflow
  • User Guides
  • Documentation
  • Emerging Technologies
  • Oracle Linux
  • Computer Science
  • Software Engineering
  • Information Systems
  • Geographic Information System
  • FOCUS
  • Transact-SQL
  • PL/SQL
  • Microsoft SSRS
  • Microsoft SSAS
  • Microsoft SSIS
  • Dimensional Modeling
  • Cubes
  • Data Warehouse
  • Data Integration
  • Database Design
  • Data Modeling
  • Python
  • C#
  • API
  • Flask
  • Django
  • ArcGIS
  • QGIS
  • Cloud Computing
  • Amazon Web Services
  • Google Cloud
  • Google Cloud Platform
  • Talend
  • Apache NiFi
  • Informatica
  • SQL
  • Stored Procedures
  • Migration
  • Change Management
  • Data Management
  • PostgreSQL
  • Geospatial Analysis
  • Database
  • Collaboration
  • Software Architecture
  • Design Patterns
  • Continuous Integration and Development
  • Continuous Integration
  • Application Lifecycle Management
  • Microsoft Azure
  • DevOps
  • Version Control
  • Git
  • GitHub
  • Release Management
  • Problem Solving
  • Conflict Resolution
  • Communication
  • Extract
  • Transform
  • Load
  • Microsoft SQL Server
  • Oracle

Summary

Project Scope
  1. Extract geographic and non-geographic data from Oracle and SQL Server databases, ensuring the integrity and quality of the data.
  2. Transform raw data into structured formats suitable for analysis, reporting, and system integration. Design and implement data pipelines for efficient handling of large datasets.
  3. Automate ETL integrations using SQL Server Integration Services (SSIS).
  4. Perform data analysis to drive key business objectives.
  5. Document ETL processes, data models, and API specifications for transparency and knowledge sharing. Develop, test, and maintain ETL workflows and scripts to automate data processing.
  6. Monitor ETL processes to ensure reliability, scalability, and performance.
  7. Perform data modeling and database design for application development and product implementation initiatives under the guidance of Database Administrator and Architect.
  8. Create reporting solutions using SQL Server Reporting Services (SSRS) by analyzing user needs and information availability.
  9. Troubleshoot and resolve data-related issues promptly.
  10. Create APIs to enable data access and integration with various applications and systems.
  11. Ensure APIs are secure, performant, and adhere to industry standards.
  12. Collaborate with developers and analysts to design API endpoints that meet business requirements.
  13. Work with GIS analysts, developers, and stakeholders to understand data requirements.
  14. Participate in requirements definition, analysis and design.
  15. Work closely with business analysts, subject matter experts and development teams in design, development, testing, implementation, and support of application projects.
  16. Facilitate creation, migration and maintenance of database objects across development/ QA/ production environments.
  17. Follow best practices in data modeling including use of standard naming conventions, processes and templates to ensure consistency of data models.
  18. Monitor and optimize database performance and capacity utilization to provide high availability and redundancy.
  19. Take ownership of database performance, scalability and security.
  20. Define and implement data testing strategies with business stakeholders, application development teams and QA groups.
  21. Participate in the software testing process, including identification and resolution of defects.
  22. Contribute to and support roll-out strategies.
  23. Participate in and contribute to formal/informal technical reviews and presentations.
  24. Accurately estimate time required to complete development tasks.
  25. Demonstrate the ability to cooperate with a variety of people and achieve results
  26. Mentor and guide development team members on database-related tasks.
  27. Provide technical support and knowledge transition to team members and end users as needed. Communicate effectively with team members, stakeholders, and project managers to gather requirements, provide updates, and manage expectations.
  28. Create and maintain technical documentation, including system designs, workflows, and user guides.
  29. Ensure solutions comply with industry best practices, standards, and security protocols.
  30. Prepare documentation and conduct knowledge transition to support adoption across the organization and other city agencies.
  31. Stay current with industry trends and emerging technologies to propose innovative solutions and improve development processes.


REQUIRED QUALIFICATIONS, SKILLS, AND EXPERIENCE:
  • Bachelor's degree in Computer Science, Software Engineering, Information Systems, Geographic Information Systems (GIS), or a related field. Master's degree is a plus.
  • Minimum of 4 years as ETL Developer, Data Engineer, or similar role, with a focus on geographic data.
  • Proficiency in T-SQL and PL/SQL with experience working with Microsoft SQL Server, Oracle, and PostgreSQL databases.
  • Familiarity with SSRS, SSAS, SSIS and data warehousing concepts like ETL, Dimensions, Facts, Cubes. Demonstrated knowledge of designing, developing and integrating databases, data warehouses and multidimensional databases in MS-SQL Server.
  • Knowledge of data integration patterns, database design, and data modeling principles.
  • Strong programming skills in Python, C#, or other relevant languages for ETL and API development. Experience with API frameworks (e.g., Flask, FastAPI, or Django REST Framework).
  • Experience with geographic data formats (e.g., shapefiles, GeoJSON) and geospatial tools (e.g., ArcGIS, QGIS).
  • Experience with cloud platforms (e.g., AWS, Azure, Google Cloud Platform) and related data services.
  • Familiarity with ETL tools like Talend, Apache Nifi, or Informatica.
  • Ability to write and optimize complex SQL queries, stored procedures, triggers, and functions. Experience in code migration, database change management and data management through the various stages of the development life cycle.
  • Familiarity with application lifecycle management (ALM) tools such as Azure DevOps and GitHub. Experience with version control and release management practices.
  • Excellent problem-solving, collaboration, and communication skills.
  • Experience with MS-SQL Server, PostgreSQL, Oracle, and/or other geospatial databases.
  • Ability to collaborate effectively within a team environment.
  • Strong knowledge of software architecture principles, design patterns, and best practices. Familiarity with DevOps practices and tools for continuous integration and delivery.
  • Familiarity with application lifecycle management (ALM) tools such as Azure DevOps and GitHub extensions.
  • Experience with version control using Git and GitHub and release management practices.
  • Excellent problem-solving skills and ability to work effectively in a collaborative team environment.
  • Strong communication skills, both written and verbal.
  • ETL certifications on Microsoft SQL Server or Oracle will be a plus. Demonstrated experience working with technical and non-technical staff.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 80183517
  • Position Id: 537c6cfc9efbea68e866136babd2bb5c
  • Posted 6 hours ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Senior Informatica ETL Developer

Jersey City, New Jersey

•

Today

Easy Apply

Contract

Depends on Experience

Informatica Developer

Jersey City, New Jersey

•

Today

Easy Apply

Full-time

$65 - $68 per hour

Data Engineer III - (Pyspark/databricks/Mongo/Sql/Python)

Hoboken, New Jersey

•

4d ago

Full-time

Data Engineer III - (Pyspark/databricks/Mongo/Sql/Python)

Jersey City, New Jersey

•

Today

Full-time

USD 118,750.00 - 160,000.00 per year

Search all similar jobs
More jobs at Texas State Library and Archives Commision in New York, NY