SciTePress - Publication Details
loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Paper Unlock

Authors: Matthia Sabatelli 1 ; Mike Kestemont 2 and Pierre Geurts 1

Affiliations: 1 Montefiore Institute, University of Liège, Grande Traverse 10, Liège, Belgium ; 2 Centre for Digital Humanities and Literary Criticism, University of Antwerp, Prinsstraat 13, Antwerp, Belgium

Keyword(s): Lottery Ticket Hypothesis, Transfer Learning, Pruning.

Abstract: We study the generalization properties of pruned models that are the winners of the lottery ticket hypothesis on photorealistic datasets. We analyse their potential under conditions in which training data is scarce and comes from a not-photorealistic domain. More specifically, we investigate whether pruned models that are found on the popular CIFAR-10/100 and Fashion-MNIST datasets, generalize to seven different datasets coming from the fields of digital pathology and digital heritage. Our results show that there are significant benefits in training sparse architectures over larger parametrized models, since in all of our experiments pruned networks significantly outperform their larger unpruned counterparts. These results suggest that winning initializations do contain inductive biases that are generic to neural networks, although, as reported by our experiments on the biomedical datasets, their generalization properties can be more limiting than what has so far been observed in the literature. (More)

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 8.209.245.224

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Sabatelli, M. ; Kestemont, M. and Geurts, P. (2021). On the Transferability of Winning Tickets in Non-natural Image Datasets. In Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 5: VISAPP; ISBN 978-989-758-488-6; ISSN 2184-4321, SciTePress, pages 59-69. DOI: 10.5220/0010196300590069

@conference{visapp21,
author={Matthia Sabatelli and Mike Kestemont and Pierre Geurts},
title={On the Transferability of Winning Tickets in Non-natural Image Datasets},
booktitle={Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 5: VISAPP},
year={2021},
pages={59-69},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010196300590069},
isbn={978-989-758-488-6},
issn={2184-4321},
}

TY - CONF

JO - Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 5: VISAPP
TI - On the Transferability of Winning Tickets in Non-natural Image Datasets
SN - 978-989-758-488-6
IS - 2184-4321
AU - Sabatelli, M.
AU - Kestemont, M.
AU - Geurts, P.
PY - 2021
SP - 59
EP - 69
DO - 10.5220/0010196300590069
PB - SciTePress