iQIYI & Open vStorage
Open vStorage has allowed iQIYI to turn our OpenStack Swift object store into a scalable, high-performance SAN for production Virtual Machines. ~ Ke Yu, Technical Director, iQIYI Cloud Infrastructure Team
The way how and when people watch video has changed drastically around the world in recent years. More and more people are moving away from the traditional linear TV-model to online video streaming platforms. This is also a trend happening in China. As the largest online video platform in China, iQIYI has more than 600 million viewers and it broadcast a total of 39.2 billion hours of TV shows and movies in 2015.It should not come as a surprise that the IT platform that stores, transforms and serves these videos is massive. To power their cloud, iQIYI has hundreds of nodes running on OpenStack. When storing and serving large video files, the underlying storage technology becomes an important component to ensure availability and boost customer satisfaction. This leads to a challenge for storage capacity: the storage should run on commercial X86 servers and support OpenStack / KVM. Migration between physical machines should be possible and performance is a must. Additional requirements are unlimited snapshots, fast cloning, seamless storage expansion and simple operation and maintenance.
While VMs in iQIYI run on top of local disks for high-performance workloads and GlusterFS for workloads with large storage requirements, operation efforts are becoming increasingly important due to a growing cluster. In order to optimize operation costs and offer customers with consistent user experience, a new solution is required.
In their search for the best storage technology available, the iQIYI team came across Open vStorage, a scale-out, reliable, high-performance and software-based storage platform. As iQIYI is already managing a multi-petabyte Swift cluster, Open vStorage seized their attention as it allows to turn Swift, the default Object Storage Solution in OpenStack, into fast block storage for Virtual Machines. For iQIYI, the benefits of using Open vStorage are clear:
Based on its strong capability of software development and customization, iQIYI has set up a large cluster of compute servers with multiple SSDs as cache disks and one petabytes Swift storage as backend. VMs on cluster are used to run Web server, docker applications. Besides running offline workload, VMs are also providing scalable online service, such as video transcoding, web service and massive data processing. In summary, the Open vStorage solution has helped iQiyi achieve its goals for high-quality user experience and high operation efficiency.