Please use this identifier to cite or link to this item: http://scholarbank.nus.edu.sg/handle/10635/134951
Title: A TRAINING FRAMEWORK AND ARCHITECTURAL DESIGN OF DISTRIBUTED DEEP LEARNING
Authors: WANG WEI
Keywords: Deep Learning, Distributed Training, Multi-modal Retrieval
Issue Date: 10-Aug-2016
Source: WANG WEI (2016-08-10). A TRAINING FRAMEWORK AND ARCHITECTURAL DESIGN OF DISTRIBUTED DEEP LEARNING. ScholarBank@NUS Repository.
Abstract: Deep learning has recently gained a lot of attention on account of its incredible success in many complex data-driven applications, such as image classification. However, deep learning is quite user-hostile and is thus difficult to apply. For example, it is tricky and slow to train a large model which may consume a lot of memory. This thesis introduces our investigations and approaches towards these challenges. First, we have conducted a comprehensive analysis of optimization techniques for deep learning systems, including stand-alone and distributed training. Second, we have designed and developed a distributed deep learning system, named SINGA, which tackles the usability problem and realizes optimization techniques for distributed training. SINGA provides a flexible system architecture for running different distributed training frameworks. Last, we have proposed deep learning based methods for effective multi-modal retrieval on top of SINGA, which outperform state-of-the-art approaches.
URI: http://scholarbank.nus.edu.sg/handle/10635/134951
Appears in Collections:Ph.D Theses (Open)

Show full item record
Files in This Item:
File Description SizeFormatAccess SettingsVersion 
WangW.pdf7.23 MBAdobe PDF

OPEN

NoneView/Download

Page view(s)

69
checked on Jan 14, 2018

Download(s)

169
checked on Jan 14, 2018

Google ScholarTM

Check


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.