Scalable Distributed Image Transcoding Using Python-WorkQueue

Abstract

Transcoding large amounts of digital media from one format to another is a common data intensive workflow. The purpose of this study was to present a scalable image transcoding system based on Python-WorkQueue that significantly reduces the amount of time required to convert images from one format to another by mapping transcoding tasks across a distributed pool of remote workers.