Weblogic Authors: Yeshim Deniz, Elizabeth White, Michael Meiner, Michael Bushong, Avi Rosenthal


Five best practices for designing applications that can withstand AWS outages

Design for failure, nothing will fail

One of the key characteristic of Amazon Web Services (AWS) platform is its high availability.  Standard availability figure is five 9’s, that is five and half minutes in a year. However, AWS outages occurred in the past clearly indicates that outages can happen and only those apps or services that are designed for failure can withstand outages with less impact to business continuity.  This emphasizes “design for failure” as one of the key design attribute to be considered while architecting for AWS platform.

AWS public cloud infrastructure is built in such a way that the control of application availability is in the hands of the designers or developers, so if designed and implemented well, it is possible to make applications running on AWS withstand infrastructure outages. This article looks at few best practices that are key to “design for failure” on AWS platform:

1. Failover gracefully using Elastic IPs

Elastic IP Addresses are public IP addresses that can be routed to any EC2 instance within a  region.  During an outage, an elastic IP address can be detached from a failed instance and then mapped to a replacement instance programmatically within a very short time frame.  This helps in failing over to another instance quickly.

2. Utilize multiple Availability Zones:

In AWS infrastructure, Availability Zones (AZ) are considered as independent logical datacentres.  Application architecture can be deployed to multiple availability zones to ensure high availability.   Type of AZ configuration determines the level of Recovery Point Objective (RPO) & Recovery Time Objective (RTO) for disaster recovery (DR) and business continuity (BC).   Databases can also be replicated across multiple availability zones by utilizing Amazon RDS Multi-AZ deployment functionality.  AWS allows different DR strategies like Pilot Light, Warm Standby, Multi-site etc., choice of the strategy to be made based on the cost considerations.  If one availability zone fails, another can be made active to keep the applications active, however application downtime during AZ switching should be minimized by configuring read only mode using read replicas and disabling the less important functionalities.

3. Maintain an Amazon Machine Image

Amazon Machine Images (AMI) help to launch instances in a new availability zone whenever there is an outage of one availability zone detected by a healthcheck.   AMIs can be created from regular backups of EBS volumes and saved configuration templates are used for launching future instances. This ensures that we can restore and clone environments very easily in a different Availability Zone.  Databases are maintained as multiple database slaves across Availability Zones with hot replication.

4. Utilize Amazon CloudWatch

Amazon CloudWatch is a monitoring service for AWS resources and the applications on AWS.  CloudWatch can collect and track metrics, monitor log files, set alarms, and automatically trigger actions to changes in AWS resources. CloudWatch alerts are utilized to get more visibility and take appropriate actions in case of hardware failure or performance degradation.   Auto scaling groups should be configured to maintain a fixed fleet size so that unhealthy Amazon EC2 instances can be replaced by new ones, whenever there is an outage.

5. Design components with Loose coupling

One of the most important rules of cloud application design is to make system components loosely coupled.   Such systems are easily scalable and highly reliable. For decoupling components and enabling asynchronous communication, AWS provided services like SQS, SNS or SWF can be utilized.  It is always a good practice to expose components as a service interface and make them responsible for its own scalability in all appropriate dimensions while interacting with other components asynchronously.


More Stories By Abdul Jaleel Kavungal Kunnumpurath

Abdul Jaleel is an accomplished Solution Architect with over 16+ years of experience in both consulting and delivery roles encompassing architecture solution design, product development, and complete life cycle deliveries. He has experience in architecting end-to-end solutions that are aligned with business objectives and the enterprise IT strategy for requirements across the whole stack – data, software, integration, and infrastructure.

IoT & Smart Cities Stories
To Really Work for Enterprises, MultiCloud Adoption Requires Far Better and Inclusive Cloud Monitoring and Cost Management … But How? Overwhelmingly, even as enterprises have adopted cloud computing and are expanding to multi-cloud computing, IT leaders remain concerned about how to monitor, manage and control costs across hybrid and multi-cloud deployments. It’s clear that traditional IT monitoring and management approaches, designed after all for on-premises data centers, are falling short in ...
We are seeing a major migration of enterprises applications to the cloud. As cloud and business use of real time applications accelerate, legacy networks are no longer able to architecturally support cloud adoption and deliver the performance and security required by highly distributed enterprises. These outdated solutions have become more costly and complicated to implement, install, manage, and maintain.SD-WAN offers unlimited capabilities for accessing the benefits of the cloud and Internet. ...
The deluge of IoT sensor data collected from connected devices and the powerful AI required to make that data actionable are giving rise to a hybrid ecosystem in which cloud, on-prem and edge processes become interweaved. Attendees will learn how emerging composable infrastructure solutions deliver the adaptive architecture needed to manage this new data reality. Machine learning algorithms can better anticipate data storms and automate resources to support surges, including fully scalable GPU-c...
The Founder of NostaLab and a member of the Google Health Advisory Board, John is a unique combination of strategic thinker, marketer and entrepreneur. His career was built on the "science of advertising" combining strategy, creativity and marketing for industry-leading results. Combined with his ability to communicate complicated scientific concepts in a way that consumers and scientists alike can appreciate, John is a sought-after speaker for conferences on the forefront of healthcare science,...
Machine learning has taken residence at our cities' cores and now we can finally have "smart cities." Cities are a collection of buildings made to provide the structure and safety necessary for people to function, create and survive. Buildings are a pool of ever-changing performance data from large automated systems such as heating and cooling to the people that live and work within them. Through machine learning, buildings can optimize performance, reduce costs, and improve occupant comfort by ...
René Bostic is the Technical VP of the IBM Cloud Unit in North America. Enjoying her career with IBM during the modern millennial technological era, she is an expert in cloud computing, DevOps and emerging cloud technologies such as Blockchain. Her strengths and core competencies include a proven record of accomplishments in consensus building at all levels to assess, plan, and implement enterprise and cloud computing solutions. René is a member of the Society of Women Engineers (SWE) and a m...
Poor data quality and analytics drive down business value. In fact, Gartner estimated that the average financial impact of poor data quality on organizations is $9.7 million per year. But bad data is much more than a cost center. By eroding trust in information, analytics and the business decisions based on these, it is a serious impediment to digital transformation.
DXWorldEXPO LLC announced today that Ed Featherston has been named the "Tech Chair" of "FinTechEXPO - New York Blockchain Event" of CloudEXPO's 10-Year Anniversary Event which will take place on November 12-13, 2018 in New York City. CloudEXPO | DXWorldEXPO New York will present keynotes, general sessions, and more than 20 blockchain sessions by leading FinTech experts.
Apps and devices shouldn't stop working when there's limited or no network connectivity. Learn how to bring data stored in a cloud database to the edge of the network (and back again) whenever an Internet connection is available. In his session at 17th Cloud Expo, Ben Perlmutter, a Sales Engineer with IBM Cloudant, demonstrated techniques for replicating cloud databases with devices in order to build offline-first mobile or Internet of Things (IoT) apps that can provide a better, faster user e...
Bill Schmarzo, Tech Chair of "Big Data | Analytics" of upcoming CloudEXPO | DXWorldEXPO New York (November 12-13, 2018, New York City) today announced the outline and schedule of the track. "The track has been designed in experience/degree order," said Schmarzo. "So, that folks who attend the entire track can leave the conference with some of the skills necessary to get their work done when they get back to their offices. It actually ties back to some work that I'm doing at the University of ...