Does AWS Serverless care about IT Operations?

Their service naming says "no" but their breadth and quality of choice says "yes"

Ryan Coleman

The memes around serverless are endless, generally involving how there are no servers, no operations teams, and how unicorns will use their magical horns to solve your application stability problems.

As I said a few weeks ago with Jeremy Daly, serverless isn’t orthogonal to IT Operations. I believe quite the opposite, that serverless is the wave beyond VM configuration management in empowering operations-minded people to reclaim their focus, creativity, and business relevance.

Does the world’s largest serverless provider understand and embrace that concept?

Go Build

It was pretty fun to watch AWS Serverless VP, David Richardson's, talk Increasing innovation with serverless applications, even if from a neon-stage (that's no Amerstadam sugar beet factory).

David recapped the many serverless announcements over the last few weeks while providing context on how they impact customers, through the lens of three use cases for serverless adoption.

Screen Shot 2020-12-16 at 10.57.08 AM.png

It’s quite nice to see the IT automation focus for serverless!

Event-driven IT Automation

Lambda’s event-driven architecture and on-demand computing footprint lends itself to IT automation workflows that are reactionary or investigative in nature, like running compliance checks on EC2 instances as they spin up, or diagnosing an outage through data aggregation and analysis.

I saw this happening ad-hoc, usually through bundles of scripts, but even die-hard IT Operations companies like Puppet are responding to the growth of event-driven IT automation with managed services like Relay.

So what?

IT Operations is in large part anticipating and reacting to events, which makes event-driven architectures like serverless a great fit for troubleshooting and governance workflows.

What’s new?

The unfortunately named DevOps Guru stole several keynote spotlights and gives me pause on AWS’s seriousness towards Ops. But don’t worry, ML-powered cloud operations won’t eliminate your ops team.

Having worked with Puppet and Splunk on something similar, the value here lies in reducing monotonous work to recognize patterns and run repetitive scripts to troubleshoot problems. Unlike the offering from Puppet, DevOps Guru does not appear to trigger any automation to remediate the identified issues. But, it might help you spend more time fixing problems instead of finding them.

Screen Shot 2020-12-16 at 11.02.44 AM.png

The second major use-case for serverless adoption, in Richardson’s view, is data processing. From media streaming to log analytics to data lakes, AWS managed services excel at ingesting anything you have like an expensive game of hungry hungry hippos.

So what?

AWS has made a bunch of small improvements to make Lambda a better fit for these use cases, reducing overall server burden and limiting compute to when it’s needed.

Screen Shot 2020-12-16 at 11.03.01 AM.png

If core compute is the third use-case, it is last but not least. This is the meat of the sandwich and it’s where all of the announcements live.

Screen Shot 2020-12-16 at 10.39.14 AM.png

Stackery got a nice mention as a service you can use to manage your whole serverless lifecycle, including the delivery of AWS Lambda extensions. While initially focused on monitoring providers, provides a way for teams to assert requirements on Lambda functions without requiring development teams to include these requirements into their development process.

What’s the point?

Instead of getting involved in every single Lambda function, Operations team can assert observability needs in an Extension and rest assured that every function will include them.

Screen Shot 2020-12-16 at 10.40.53 AM.png

Stackery was also first to support AWS Lambda container image (build) support which sounds super confusing but is actually very helpful for IT Operations and release engineering teams who have invested in robust container delivery workflows but not yet Lambda.

This is not some magic that means you can invoke any container in response to a Lambda event (though ECS works for that!). Developers still need to account for Lambda’s event handlers and expect the assumptions of Lambda’s runtime environment.

But, the tools you use to manage, validate, build, and ship container images can be entirely reused in the software delivery lifecycle for Lambda functions shipped as container images. Stackery will go even further with you, ensuring that AWS ECR is maintained as changes to functions pass through its turn-key CI/CD pipeline.

What’s the point?

Release engineering practices built around container images can be reused to validate, build, and deliver Lambda functions which previously required a bespoke toolchain.

Screen Shot 2020-12-16 at 11.11.39 AM.png

David went on to talk about how serverless compute is used to decouple legacy systems in an incremental fashion, which can come from changing the source of data feeding into an application, emitting events on the backside of a legacy application, or refactoring an API one route at a time.

What’s the point?

You do not have to jump into serverless head first, with incremental approaches to modernizing your application from every conceivable angle.

Screen Shot 2020-12-16 at 10.44.28 AM.png
Screen Shot 2020-12-16 at 10.50.42 AM.png
Screen Shot 2020-12-16 at 10.46.58 AM.png
Screen Shot 2020-12-16 at 10.47.45 AM.png

Up next, Richardson shared some of the improvements AWS made to help operators increase performance, while ensuring security, at reduced costs.

Lambda is billed at 1ms intervals now, code-signing support is baked-in (including SAM support), EFS volumes can finally be mounted in Lambda, and functions can now have 10GB of memory for those of you running Chrome in Lambda. And for some reason the impressive Aurora Serverless v2 wasn’t even mentioned (or maybe I missed it).

There’s a lot in there to unpack in January, and you can get Stackery will make all of this more accessible with our bidirectional infrastructure-as-code designer that generates best-practices by default.

Screen Shot 2020-12-16 at 11.17.03 AM.png

I wrote operations in this post about as many times as AWS uses the word innovation in their presentations, but I’m walking away from re:Invent with the impression that AWS is serious about both.

serverless and devops

Related posts

Hands Off Serverless Deployments
EngineeringHands Off Serverless Deployments

How AWS deploys in waves and what to think about when planning your deployments

Andy Jassy's 2020 re:Invent Keynote, for DevOps
ReinventAndy Jassy's 2020 re:Invent Keynote, for DevOps

Reinventing compute without quantum

pre:Invent Roundup
Reinventpre:Invent Roundup

All the AWS announcements that were eclipsed by an outage

What does Serverless mean for the future of DevOps
EngineeringWhat does Serverless mean for the future of DevOps

What to look for at re:Invent for serverless and DevOps professionals

© 2022 Stackery. All rights reserved.