Data Engineer (w prior DBA)

Software Guidance & Assistance, Inc., (SGA), is searching for a Data Engineer (with some prior DBA experience) for a direct placement assignment with one of our premier Financial Services clients in mid-town, NYC. Hybrid: 2-3 days in office/week.

Responsibilities:

• Team seeks a Data Engineer with deep understanding of large-scale data handling and processing best practices in a cloud native environment, building scalable systems.
• Will work closely with data/software engineers, architects, business users, and other stakeholders to design and implement data solutions, including databases, data warehouses, and data models that meet organizational needs, define data standards, and implement a data governance process.
• Requires database administration activities to manage, maintain, and optimize our databases.
• Ensuring database availability, performance, security, and integrity across production and development environments.
• Expected to work collaboratively with others in IT to realize the full life cycle of system development projects, from requirements gathering to application design, data modeling, coding, testing, delivery, support, and enhancements.
• Help Data Management team to drive the successful execution of annual OKR commitments, ensuring alignment with business objectives and optimizing data processes for measurable impact.
• Work closely with external data management partners to onboard firm's use cases.
• Help organize firm's data assets for up-and-coming technologies such as GenAI.
• Define data governance policies and oversee implementation, including any external data management platforms, to ensure data quality, accuracy, and consistency.
• Develop and implement data ingestion, transformation, and synchronization processes between in-house systems and external platforms.
• Work with data scientists, engineers, business users, and other stakeholders to understand their data needs and ensure solutions align with business goals.
• Monitor and optimize database performance (queries, indexes, storage).
• Create and maintain database documentation and standard operating procedures.
• Perform regular security audits and manage user access controls.
• Build Data Administration automation tools/methods.
• Maintain detailed documentation for data architecture, flows, and system configurations.
• Raise the bar on our development capabilities, standards, and processes.
• Synthesize requirements gathered from various teams within/outside of IT and suggest creative solutions; where appropriate, guiding the firm to "do it the right way"
• Following a scrum methodology, organize with end users, business analysts, and other architects and developers.
• Recommend positive steps toward standardizing development processes, including technology selection, deployment steps, code reviews, and IT tools.
• Partner with platform engineering, QA, and operations teams to promote standardization, consistency, and improved security posture.
• Our applications are primarily developed using Python/Django and libraries such as Pandas, NumPy, PL/SQL. In addition, we utilize SQL Server, MySQL, Elastic Search, Redis, Kafka, Tableau, and various third-party APIs and data sources.
• The successful candidate will be expected to hit the ground running, working on hands-on projects, and simultaneously contributing to firm's data strategy standards and best practices. During the first six months, the Data Engineer will have learned enough about firm's business, processes, and applications that they should have accomplished the following:
  • Owned some key projects and data-intensive systems that are being built to establish firm's data standards and best practices
  • Made hands-on contributions to the progress of the project portfolio
  • Forged solid relationships with key partners, and developed a vocabulary that demonstrates a strong understanding of our products and services

Required Skills :

• 3+ years of "modern " Data Engineer experience with deep understanding of large-scale data handling and processing (e.g., pipelining, Data Warehouse solutions, Data lakes, AI/ML)
• At least 3+ years of hands-on experience in one or more of the following areas: data strategy, data architecture, (modern) data platform architecture, data modeling, business Intelligence, Big Data, reporting & data warehousing, AI, and Machine Learning.
• Experience with relational (e.g., SQL Server, MySQL, Oracle) and non-relational databases (e.g., NoSQL, MongoDB)
• Strong understanding of AWS Cloud Services related to Data Engineering
• Good understanding of the different data architecture patterns: data warehouse, data marts, data modeling, ontologies, etc.
• Ability to write high-performing SQL queries, procs, tables, and views.
• Familiar with general ETL design and development
• Good intuition for end-user requirements gathering; iterative and collaborative approach to design.
• Practical understanding of design patterns and experience in system design
• Strong client relationship management skills and excellent written/verbal communication skills to interact at all levels.
• Bachelor of science in computer science or other related discipline (although strong experience with a less directly related degree will be considered)

Preferred Skills

• Experience working for financial services firms, such as asset managers, hedge funds, and/or broker/dealers.
• A minimum of 2 years of hands-on experience in developing/maintaining large-scale Python-based applications. Design and development experience with data and analytics-intensive applications using Pandas and NumPy libraries.
• Data governance tools and frameworks
• Ability to lead a development team.

#LI-SY1

SGA is a technology and resource solutions provider driven to stand out. We are a women-owned business. Our mission: to solve big IT problems with a more personal, boutique approach. Each year, we match consultants like you to more than 1,000 engagements. When we say let's work better together, we mean it. You'll join a diverse team built on these core values: customer service, employee development, and quality and integrity in everything we do. Be yourself, love what you do and find your passion at work. Please find us at .

SGA is an Equal Opportunity Employer and does not discriminate on the basis of Race, Color, Sex, Sexual Orientation, Gender Identity, Religion, National Origin, Disability, Veteran Status, Age, Marital Status, Pregnancy, Genetic Information, or Other Legally Protected Status. We are committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, and our services, programs, and activities. Please visit our company to request an accommodation or assistance regarding our policy