· Partner with architects, engineers, data analysts, and business and technology stakeholders to develop and deploy enterprise-grade data platforms.
· Analyze business needs and design technical solutions that support data-driven outcomes.
· Develop, test, and enhance software and data solutions to improve platform and application efficiency.
· Investigate technical issues, identify potential causes, and recommend solutions.
· Coordinate with data operations teams to deploy changes to production.
· Support Test, QA, and Production environments.
· Perform other related duties as assigned.
Required qualifications to be successful in this role:
What you'll bring
· Bachelor’s degree in Computer Science, Computer Engineering, or a related field. Equivalent relevant professional experience may be considered in lieu of a degree.
· At least 5 years of experience in ETL development, including IBM DataStage, SQL, UNIX/Linux scripting, and distributed big data systems.
· Experience with data warehousing, operational data stores, data technologies, and ETL solutions.
· At least 3 years of experience with Python and orchestration tools and processes.
· Experience building ETL pipelines using Python and pandas.
· Extensive experience with data migration, analysis, transformation, conversion, interfaces, high-volume data loading, database modeling, and SQL performance tuning.
· Experience using database tools to develop DDL scripts, stored procedures, and functions to create and modify database objects.
· Hands-on experience with Git version control and software release processes.
· Exposure to RDDs and the Spark framework using Python or Scala.
· Strong communication skills and experience collaborating with onshore and offshore teams of 8 to 10 people.
Preferred Qualifications
· At least 4 years of experience with Teradata (Vantage), SQL Server, Greenplum, Hive, and delimited text files.