Category “Devops”

Published
November 21, 2017
Author
Dave Bakshani and Willie Wheeler (@williewheeler)
Category
Comments
Time To Read
Estimated reading time: 2 minutes

re:Invent 2017 – Use EC2 Systems Manager to Perform Automated Resiliency Testing in Your CI/CD Pipeline

By Dave Bakshani and Willie Wheeler (@williewheeler) in Cloud, Devops on November 21, 2017 | Responses (0)

DEV338: Use Amazon EC2 Systems Manager to Perform Automated Resiliency Testing in Your CI/CD Pipeline This is one of the topics that was selected by Amazon to be presented at AWS re:Invent this year. At re:Invent, we will talk about what is Resilience Engineering, and why it is important to build resilience into your applications. Also covered will be some strategies for improving resiliency, and what a resilience experiment looks like. As we explored this subject, we realized that while it is important to randomly test the resilience of our…

Read More
Published
May 19, 2017
Author
Category
Comments
Time To Read
Estimated reading time: 6 minutes

Cloud and Finance – Lessons learned

This is a joint post with Abiade Adedoyin. Here at Expedia, we’re undergoing a strategic migration to the cloud. Like most others, we too first struggled to understand and manage our cloud spend. Over the past eight months, we learned some lessons and adopted certain practices to manage our cloud spend more predictably and efficiently than before. Here are the results of our practices: We increased the proportion of reserved instances (RIs) from under 40% to about 65% to 70%. See the “Compute Usage Hours” chart below. Our overall savings…

Read More
Published
December 6, 2016
Author
Kuldeep Chowhan (@this_is_kuldeep)
Category
Comments
Time To Read
Estimated reading time: 4 minutes

The Inside Scoop on Primer, Expedia’s Internal Cloud Deployment Tool

By Kuldeep Chowhan (@this_is_kuldeep) in Cloud, Devops on December 6, 2016 |

In early 2013, Expedia decided it was time to more heartily explore cloud solutions. At the time, the company’s web services structure was a monolith. The team was nearing the end of a major platform overhaul, changing the way the entire core of Expedia operated. The cloud was becoming too interesting a tool to ignore. But how does a company move a proverbial rock uphill? A small group of us came together to look at moving a microservice to the cloud. We focused on an application within the shopping path — starting…

Read More
Published
November 3, 2016
Author
Andre Caron
Category
Comments
Time To Read
Estimated reading time: 5 minutes

AWS Lessons Learned for Data Processing Pipelines

By Andre Caron in Cloud, Devops, Lessons Learned on November 3, 2016 | Responses (2)

Last year my team and I embarked on a mission to migrate Expedia’s Media Services image processing pipeline to AWS. The media services are used to ingest images from hoteliers and image providers, optimize them, and distribute them to be used by our sites. The new queue based cloud pipeline was put in place to replace an aging batch system. Moving to a cloud infrastructure has brought many advantages; we can easily scale when the load is heavier, have faster deployments, and mostly no more worrying about ordering more disk…

Read More
Published
July 28, 2016
Author
Willie Wheeler
Category
Comments
Time To Read
Estimated reading time: 10 minutes

Applying data science to monitoring

By Willie Wheeler in Big Data, Data Science, Devops on July 28, 2016 |

Lately, in collaboration with Karan Shah, I’ve been focusing most of my efforts on operational monitoring. We need to know when bad things are happening, are about to happen, or have been happening for a long time. Monitoring is a good example of a problem that’s easier to state than it is to solve. In practice a lot goes wrong: Sometimes we fail to monitor things that we care about. Sometimes we monitor things we care about, but we route the alerts to the wrong audience. Sometimes we monitor things…

Read More
Published
July 11, 2016
Author
Matt Callanan and Alexandra Spillane
Category
Comments
Time To Read
Estimated reading time: 1 minute

IEEE Software Publishes Wotif’s DevOps Journey

By Matt Callanan and Alexandra Spillane in Devops on July 11, 2016 |

Alexandra Spillane and I recently wrote up Wotif’s DevOps journey for IEEE Software Magazine’s special “Software Engineering for DevOps” May/June 2016 edition. The article, entitled “Devops: Making it Easy To Do The Right Thing”, outlines how standardizing Wotif’s deployment mechanism and building a platform centered around the DevOps ideals of collaboration and fast feedback broke us out of a downward spiral of ever worsening release problems. Here’s a snippet: In 2013 and 2014, Wotif overhauled its software release processes, reducing the average release time from weeks to hours. A DevOps and…

Read More
Published
September 25, 2015
Author
Patrick Bradley, Philippe Deschenes and Rolland Mewanou
Category
Comments
Time To Read
Estimated reading time: 8 minutes

Solving problems with very large java heaps

By Patrick Bradley, Philippe Deschenes and Rolland Mewanou in Big Data, Devops, Lessons Learned on September 25, 2015 |

Users depend on our sites to be up and running at all times. We have many critical services that are required to be up and running in order to deliver that uptime, and thus those critical services need to be able to respond to changes in user behavior and load. This is a story about one of our hotel content services that feeds large amount of hotel content to systems throughout Expedia, how it temporarily ran into problems, and how we fixed it. This content service is responsible for serving…

Read More
Published
August 10, 2015
Author
Category
Comments
Time To Read
Estimated reading time: 8 minutes

Devops Data Integration with Seiso

By Willie Wheeler (@williewheeler) in Devops on August 10, 2015 |

At Expedia, our automation efforts involve a lot of tools and data integration. This is a challenge because individual teams have considerable flexibility to adopt the tools and practices that help them achieve fast results. In cases where we think a common capability will lead to the better and faster result, the goal is to do this in a way that maintains flexibility. One key area in this regard is data integration. We want a shared and integrated view of our development and delivery world, even in the face of…

Read More