Cloud Data Engineer

Cloud Data Engineer

DESCRIPTION:

• Designing and implementing robust data pipelines.
• Maintaining high data quality and security in cloud environments, automating tasks with dbt, Python, Snow SQL and Bash scripting, and continuously researching new technologies to enhance scalability.
• Mentoring junior engineers and collaborating with cross-functional teams to ensure efficient data processing and analysis, while monitoring and troubleshooting for consistent high performance.
• This role focuses on the development and implementation of data engineering solutions that enhance data products and warehousing capabilities and maintain legacy and new system
• Design and implement data pipelines to move and transform data from various sources into cloud-based data warehouses.
• Develop and maintain ETL processes using tools such as dbt, Fivetran, Matillion, Snow Streams and tasks, SSIS, SSAS, SSRS, PL SQL and Snowflake Dataflow on AWS.
• Good understanding of OLTP and OLAP Cubes, dimensional model
• Optimize data storage and retrieval by designing and implementing data partitioning, indexing, and compression strategies.
• Build and maintain data processing infrastructure on cloud platforms such as AWS
• Good understanding of source control through Github and scheduling pipelines/tasks through Control M.
• Collaborate with business and analysts to ensure data quality, accuracy, and availability for analysis and reporting.
• Led Complex System Design, Integration and Development.
• Monitor and troubleshoot data pipelines and infrastructure to ensure high availability and performance.
• Implement security and access controls to protect sensitive data in cloud-based environments.
• Automate data processing tasks using scripting languages such as Python or Bash
• Research and evaluate new technologies and tools to improve data processing efficiency and scalability.
• Mentor and train junior data engineers and provide technical guidance to cross-functional teams.
• Perform other job-related functions as assigned.
• Work with cross development teams, Data Scientists, Database/ system administrators and Project Management Office as part of Data Engineering team and assist in research, development & implementation of special projects, as needed
• Support existing legacy and new data warehouses.
• Preferably has good understanding of Revenue Management so that candidate can relate things back functionally.
• Rsponsibility includes development of a cloud based data products/solutions with AWS, Fivetran, Matillion, Snowflake, dbt, SQL Server, github and control-M
• Cloud Data Engineers are tasked with designing, building, and maintaining scalable data infrastructure on cloud platforms.
• Develop and optimize data pipelines, ensuring efficient movement and transformation of data from diverse sources into cloud-based warehouses.
• Analyzing and troubleshooting any issues reported

EXPERIENCE:

• Minimum of 7 years' experience developing, validating, and implementing data warehouses, data systems or cloud-based data solutions.
• Experience in data engineering with a focus on data warehousing and data products.
• Experience with multiple data modeling approaches, SQL, and scripting programming languages like Python and PowerShell.
• Experience with Agile methods & tools like JIRA.
• Experience leading and coaching a team members.

• Proven experience in data warehousing technologies, data products, legacy system management, strong communication, and stakeholder engagement abilities. Strong listening, presentation, and interpersonal skills.
• Excellent analytical, problem-solving, verbal, and written communication skills.
• Able to prioritize and execute tasks in a high-pressure, fast-paced environment.
• Ability to drive results independently.
• Innovation, Process Improvement, Creativity, and Clean-Sheet Reinvention.
• Proven success with collaboration between cross functional teams.
• Demonstrated understanding of agile methodologies, QA practices and user experience, with strong digital & technical skills.
• Experienced with collaboration tools (Jira, Confluence, Lucid Chart;).
• Strong understanding of databases such as Microsoft SQL Server, Oracle, MySQL, Snowflake.
• Experience with traditional on-prem virtual and physical infrastructure, as well as cloud-based environments, preferably AWS.
• Excellent understanding of Windows, and Linux based infrastructure. Working knowledge of various tools, open-source technologies, and cloud services.

Technology is our focus and quality is our commitment. As a national expert in delivering flexible technology and talent solutions, we strategically align industry and technical expertise with our clients business objectives and cultural needs. Our solutions are tailored to each client and include a wide variety of professional services, project, and talent solutions. By always striving for excellence and focusing on the human aspect of our business, we work seamlessly with our talent and clients to match the right solutions to the right opportunities. Learn more about us at inspyrsolutions.com.

INSPYR Solutions provides Equal Employment Opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, or genetics. In addition to federal law requirements, INSPYR Solutions complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities.