Auto-CNNp: a component-based framework for automating CNN parallelism - ERODS Accéder directement au contenu
Communication Dans Un Congrès Année : 2019

Auto-CNNp: a component-based framework for automating CNN parallelism

Soulaimane Guedria
  • Fonction : Auteur
  • PersonId : 1074578
Noel de Palma
Felix Renard
  • Fonction : Auteur

Résumé

Effectively training of Convolutional Neural Networks (CNNs) is a computationally intensive and time-consuming task. Therefore, scaling up the training of CNNs has become a key approach to decrease the training duration and train CNN models in a reasonable time. Nevertheless, introducing parallelism to CNNs is a laborious task in practice. It is a manual, repetitive and error-prone process. In this paper, we present Auto-CNNp, a novel framework that aims to address this challenge by automating CNNs training parallelization task. To achieve this goal, the Auto-CNNp introduces a key component which is called CNN-Parallelism-Generator. The latter component aims to streamline routine tasks throughout (1) capturing cumbersome CNNs parallelization tasks within a backbone structure while (2) keeping the framework flexible enough and extensible for user-specific personalization. Our proposed reference implementation provides a high level of abstraction over MPI-based CNNs parallelization process, despite the CNN-based imaging task and its related architecture and training dataset. We introduce the design and the core building blocks of Auto-CNNp. We further conduct an extensive assessment of our proposal that not only shows its effectiveness in accelerating the process of scaling up CNNs training, but also its generalization for a wider variety of use cases.
Fichier principal
Vignette du fichier
Auto_CNNp_IEEE_Extended.pdf (699.87 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02894478 , version 1 (09-07-2020)

Identifiants

Citer

Soulaimane Guedria, Noel de Palma, Felix Renard, Nicolas Vuillerme. Auto-CNNp: a component-based framework for automating CNN parallelism. 2019 IEEE International Conference on Big Data (Big Data), Dec 2019, Los Angeles, United States. pp.3330-3339, ⟨10.1109/BigData47090.2019.9006175⟩. ⟨hal-02894478⟩
78 Consultations
164 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More