Trent University Graduate Thesis Collection

Item Description
Identifier
tula:etd
Type
Collection
Language
eng
Extent
1 item
Rights
Copyright for all items in the Trent University Graduate Thesis Collection is held by the author, with all rights reserved, unless otherwise noted.
Displaying 1 - 1 of 1

Results per page

Displaying 1 - 1 of 1

SPAF-network with Saturating Pretraining Neurons

22852-Thumbnail Image.png
Year: 2016, 2016
Member of: Trent University Graduate Thesis Collection
Name(s): Creator (cre): Burhani, Hasham, Thesis advisor (ths): Wenying, Feng, Degree committee member (dgc): Hurley, Richard, Degree committee member (dgc): Abdella, Kenzu, Degree granting institution (dgg): Trent University
Abstract: <p>In this work, various aspects of neural networks, pre-trained with denoising autoencoders (DAE) are explored. To saturate neurons more quickly for feature learning in DAE, an activation function that offers higher gradients is introduced. Moreover, the introduction of sparsity functions applied to the hidden layer representations is studied. More importantly, a technique that swaps the… more
Full Text: SPAF-network with Saturating Pretraining Neurons A Thesis Submitted to the Committee of Graduate Studies in Partial Fulfillment of the Requirements for the Degree of Master of Science in the Faculty of Arts and Science TRENT UNIVERSITY Peterborough, …