Senior Software Development Engineer, AWS Glue

  • Amazon,
  • New York City, NY
  • 3 hours ago
company banner
Full Time

Job Description


Job summary
The Company:
Amazon Web Services (AWS) is the pioneer and recognized leader in Cloud Computing. Our web services provide a platform for IT infrastructure in-the-cloud that is used by hundreds of thousands of developers and businesses around the world. These customers range from start-ups to leading web companies to Global 500 companies.

The Group:
AWS Analytics team provides rapidly growing, industry acclaimed cloud services in areas of big data platforms to data analytics to operational databases. The group is at the forefront of innovation in these areas producing world-class cloud services such as Glue, Lake Formation, Redshift, EMR, Elastic Search, and many more.

The Team:
AWS Glue is a serverless data integration service that makes it easy to discover, prepare, and combine data for analytics, machine learning, and application development. Our mission is to redefine how data analytics is done in Cloud and make it easy and fast for customers to query their data. AWS Glue provides all of the capabilities needed for serverless data integration so that you can start analyzing your data and putting it to use in minutes instead of months.

We are building the next generation serverless analytics platform, a data workflow system to enable customers to stitch data operations visually (and programmatically), and performant dataplane. We are scaling the backend infrastructure to enable super-low latencies workloads at a cloud scale. The teams owns both the product & backend and it's a unique experience.

Top reasons to join our team:
  • Be catalyst to deliver a truly disruptive product(s) that are growing rapidly
  • You get to define, build, own, and run a service in high growth environment
  • Solve unique and first-order problems in areas of Big Data, Serverless computing, Spark, Distributed Systems and Machine Learning
  • Learn how to build & operate distributed systems at massive scale
  • Be part of big data revolution in cloud
  • Influence and build products that will leverage scale of resources to run serverless big data workloads

About you:
  • Passionate in building large scale distributed systems, serverless compute, and big data systems
  • Thrive in culture of ownership, delivery and bias for action
  • Fast pace environment energizes you to be at your best
  • Innovate and invent in agile and collaborative environment
  • Curious and eager to learn to expect more of you and others

  • Translate functional and technical requirements into detailed architecture, design and extensible code
  • Technically lead a team of smart engineers on complex projects
  • Be an advocate of industry best-practices to produce reliable, fault-torrent and dependable code
  • Code and test complex system modules; develop and leverage frameworks to be effective and efficient
  • Participate in architecture, design and code reviews to maintain our high development standards
  • Own system architecture, scalability, reliability, and performance
  • Collaborate and influence other teams to deliver and operate large scale, distributed services in the cloud
  • Mentor other engineers, defining our challenging technical culture, and helping to build a fast-growing team

Inclusive Team Culture
Here at AWS, we embrace our differences. We are committed to furthering our culture of inclusion. We have ten employee-led affinity groups, reaching 40,000 employees in over 190 chapters globally. We have innovative benefit offerings, and host annual and ongoing learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences. Amazon's culture of inclusion is reinforced within our 14 Leadership Principles, which remind team members to seek diverse perspectives, learn and be curious, and earn trust.

Work/Life Balance
Our team puts a high value on work-life balance. It isn't about how many hours you spend at home or at work; it's about the flow you establish that brings energy to both parts of your life. We believe striking the right balance between your personal and professional life is critical to life-long happiness and fulfillment. We offer flexibility in working hours and encourage you to find your own balance between your work and personal lives.

Mentorship & Career Growth
Our team is dedicated to supporting new members. We have a broad mix of experience levels and tenures, and we're building an environment that celebrates knowledge sharing and mentorship. Our senior members enjoy one-on-one mentoring and thorough, but kind, code reviews. We care about your career growth and strive to assign projects based on what will help each team member develop into a better-rounded engineer and enable them to take on more complex tasks in the future.

Engineering Blogs and Videos from Team

1. Partitioning for S3 Data Lakes:
2. Data transformations and pipelines:
3. Glue custom connectors - develop connectors or discover them from AWS Marketplace:
4. Glue Studio:

Glue team is innovating rapidly and that translates into the massive business growth, headcount growth and a thought leadership in serverless analytics space. You will be operating at the frontier of data analytics, servereless compute, and data-processing technologies. We have built a serverless compute backend (like Fargate/Lambda) for massively parallel data processing, an optimized Apache Spark dataplane/runtime, and a programmable data workflow system (like Apache Airflow). Now, we are building the next generation serverless analytics platform (new service/initiatives), and scaling the backend infrastructure for rapid expansion.

We are hiring strong SDE2/SDE3s to join our mission to be the top serverless data integration service, and democratize data at cloud scale. We need experienced builders and owners to drive it to the next level of scale. There are a bunch of new initiatives (services) in the pipeline and you will help us take them from inception to scaling.

Finally, you will get to define, build, own, and run a high growth serverless data analytics service, which will enrich you professionally to tech on big challenges.

Please contact if interested.


  • 2+ years of experience contributing to the architecture and design (architecture, design patterns, reliability and scaling) of new and current systems
  • 3+ years of programming experience with at least one modern language such as Java, C++, or C# including object-oriented design
  • 4+ years of professional software development experience
  • 2+ years of experience as a mentor, tech lead OR leading an engineering team

  • 5+ years experience writing large scale systems in Java and/or Python. C/C++ is a plus.
  • Bachelors in Computer Science or Engineering, or equivalent experience


• Strong knowledge of data structures and algorithms
• Experienced writing multi-threaded programs requiring concurrency and synchronization primitives
• Write very high quality code that is robust and easy to maintain
• Experienced debugging, diagnosing, and trouble-shooting complex, production software
• Strong understanding of system performance and scaling
• Ability to drive tasks to completion and take ownership of projects
• Ability to work in a fast paced and agile development environment
• Possess excellent communication, sharp analytical abilities, and proven design skills
• Experience delivering and operating large scale, highly available distributed systems is a plus
• Experience with database systems internals, query optimization, and storage systems is a plus
• Experience with large-scale data analytics and data warehousing is a plus
• Masters or PhD in Computer Science

Amazon is an Equal Opportunity-Affirmative Action Employer - Minority / Female / Disability / Veteran / Gender Identity / Sexual Orientation

Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit

Company Information

Amazon is guided by four principles: customer obsession rather than competitor focus, passion for invention, commitment to operational excellence, and long-term thinking. We are driven by the excitement of building technologies, inventing products, and providing services that change lives. We embrace new ways of doing things, make decisions quickly, and are not afraid to fail. We have the scope and capabilities of a large company, and the spirit and heart of a small one. Together, Amazonians research and develop new technologies from Amazon Web Services to Alexa on behalf of our customers: shoppers, sellers, content creators, and developers around the world. Our mission is to be Earth's most customer-centric company. Our actions, goals, projects, programs, and inventions begin and end with the customer top of mind. You'll also hear us say that at Amazon, it's always "Day 1." What do we mean? That our approach remains the same as it was on Amazon's very first day - to make smart, fast decisions, stay nimble, invent, and focus on delighting our customers.

Dice Id : amazon15
Position Id : 1911978
Originally Posted : 3 months ago

Similar Positions at Amazon

Sr. Manager Software Dev, AWS Glue
  • New York, NY
  • 23 hours ago
Software Development Engineer
  • New York City, NY
  • 23 hours ago
Software Development Engineer
  • New York, NY
  • 23 hours ago
Software Development Engineer
  • New York, NY
  • 23 hours ago
Software Development Engineer, ECS
  • Jersey City, NJ
  • 23 hours ago
Software Development Engineer, CTPS
  • Newark, NJ
  • 23 hours ago