N. Sharma and L. Aggarwal, Automated medical image segmentation techniques, Journal of Medical Physics, vol.35, issue.1, pp.3-14, 2010.

H. Greenspan, B. Van-ginneken, and R. M. Summers, Guest editorial deep learning in medical imaging: Overview and future promise of an exciting new technique, IEEE Transactions on Medical Imaging, vol.35, pp.1153-1159, 2016.

A. Graves, A. Mohamed, and G. E. Hinton, Speech recognition with deep recurrent neural networks, CoRR, 2013.

J. Donahue, L. A. Hendricks, S. Guadarrama, M. Rohrbach, S. Venugopalan et al., Long-term recurrent convolutional networks for visual recognition and description, CoRR, 2014.

I. Loshchilov and F. Hutter, Cma-es for hyperparameter optimization of deep neural networks, 2016.

J. Bergstra and Y. Bengio, Random search for hyper-parameter optimization, J. Mach. Learn. Res, vol.13, pp.281-305, 2012.

F. N. Iandola, M. W. Moskewicz, K. Ashraf, and K. Keutzer, Firecaffe: near-linear acceleration of deep neural network training on compute clusters, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp.2592-2600, 2016.

A. Sergeev and M. D. Balso, Horovod: fast and easy distributed deep learning in tensorflow, CoRR, 2018.

J. Shi and J. Malik, Normalized cuts and image segmentation, IEEE Trans. Pattern Anal. Mach. Intell, vol.22, pp.888-905, 2000.

Y. Wu, M. Schuster, Z. Chen, Q. V. Le, M. Norouzi et al., Google's neural machine translation system: Bridging the gap between human and machine translation, 2016.

Q. V. Le, M. Ranzato, R. Monga, M. Devin, K. Chen et al., Building high-level features using large scale unsupervised learning, Proceedings of the 29th International Coference on International Conference on Machine Learning, ICML'12, pp.507-514, 2012.

J. Dean, G. S. Corrado, R. Monga, K. Chen, M. Devin et al., Large scale distributed deep networks, Proceedings of the 25th International Conference on Neural Information Processing Systems, vol.1, pp.1223-1231, 2012.

T. Ben-nun and T. Hoefler, Demystifying parallel and distributed deep learning: An in-depth concurrency analysis, CoRR, 2018.

J. Jiang, B. Cui, C. Zhang, and L. Yu, Heterogeneity-aware distributed parameter servers, Proceedings of the 2017 ACM International Conference on Management of Data, SIGMOD '17, pp.463-478, 2017.

P. Goyal, P. Dollár, R. B. Girshick, P. Noordhuis, L. Wesolowski et al., Accurate, large minibatch SGD: training imagenet in 1 hour, CoRR, 2017.

A. Krizhevsky, I. Sutskever, and G. E. Hinton, Imagenet classification with deep convolutional neural networks, Advances in Neural Information Processing Systems, vol.25, pp.1097-1105, 2012.

S. L. Smith, P. Kindermans, and Q. V. Le, Don't decay the learning rate, increase the batch size, CoRR, 2017.

Y. Lecun, L. Bottou, Y. Bengio, and P. Haffner, Gradient-based learning applied to document recognition, Intelligent Signal Processing, pp.306-351, 2001.

D. P. Kingma and J. Ba, Adam: A method for stochastic optimization, CoRR, 2014.

A. Coates, B. Huval, T. Wang, D. Wu, B. Catanzaro et al., Deep learning with cots hpc systems, International conference on machine learning, pp.1337-1345, 2013.

J. Jiang, B. Cui, C. Zhang, and L. Yu, Heterogeneity-aware distributed parameter servers, Proceedings of the 2017 ACM International Conference on Management of Data, pp.463-478, 2017.

M. Li, D. G. Andersen, J. W. Park, A. J. Smola, A. Ahmed et al., Scaling distributed machine learning with the parameter server, Proceedings of the 11th USENIX Conference on Operating Systems Design and Implementation, OSDI'14, pp.583-598, 2014.

T. Chilimbi, Y. Suzue, J. Apacible, and K. Kalyanaraman, Project adam: Building an efficient and scalable deep learning training system, 11th {USENIX} Symposium on Operating Systems Design and Implementation, pp.571-582, 2014.

N. Strom, Scalable distributed dnn training using commodity gpu cloud computing, INTERSPEECH, 2015.

G. T. Heineman and W. T. Councill, Putting the pieces together, addison-westley, p.5, 2001.

P. Fingar, Component-based frameworks for e-commerce, Communications of the ACM, vol.43, issue.10, pp.61-61, 2000.

C. More, L. Colaco, and R. Sardinha, Application of component-based software engineering in building a surveillance robot, Proceedings of the 3rd International Conference on Frontiers of Intelligent Computing: Theory and Applications (FICTA), pp.651-658, 2014.

A. Brown, S. Johnston, and K. Kelly, Using service-oriented architecture and component-based development to build web service applications, Rational Software Corporation, vol.6, pp.1-16, 2002.

R. Bramley, K. Chiu, S. Diwan, D. Gannon, M. Govindaraju et al., A component based services architecture for building distributed applications, Proceedings the Ninth International Symposium on High-Performance Distributed Computing, pp.51-59, 2000.

X. Ke, K. Sierszecki, and C. Angelov, Comdes-ii: A component-based framework for generative development of distributed real-time control systems, 13th IEEE International Conference on Embedded and Real-Time Computing Systems and Applications (RTCSA 2007), pp.199-208, 2007.

J. F. Ferreira, J. L. Sobral, and A. J. Proença, Jaskel: A java skeleton-based framework for structured cluster and grid computing, Sixth IEEE International Symposium on Cluster Computing and the Grid (CCGRID'06), vol.1, p.4, 2006.

A. Harlap, D. Narayanan, A. Phanishayee, V. Seshadri, N. Devanur et al., Pipedream: Fast and efficient pipeline parallel dnn training, 2018.

W. Zhang, S. Gupta, X. Lian, and J. Liu, Staleness-aware async-sgd for distributed deep learning, Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, IJCAI'16, pp.2350-2356, 2016.

P. Patarasuk and X. Yuan, Bandwidth optimal all-reduce algorithms for clusters of workstations, Journal of Parallel and Distributed Computing, vol.69, issue.2, pp.117-124, 2009.

M. Li, D. G. Andersen, A. J. Smola, and K. Yu, Communication efficient distributed machine learning with the parameter server, Advances in Neural Information Processing Systems, pp.19-27, 2014.

D. Balouek, A. Amarie, G. Charrier, F. Desprez, E. Jeannot et al., Adding virtualization capabilities to the Grid'5000 testbed, Cloud Computing and Services Science, vol.367, pp.3-20, 2013.
URL : https://hal.archives-ouvertes.fr/hal-00946971

G. M. Shipman, T. S. Woodall, R. L. Graham, A. B. Maccabe, and P. G. Bridges, Infiniband scalability in open mpi, Proceedings 20th IEEE International Parallel & Distributed Processing Symposium, p.10, 2006.

E. Gabriel, G. E. Fagg, G. Bosilca, T. Angskun, J. J. Dongarra et al., Open mpi: Goals, concept, and design of a next generation mpi implementation, European Parallel Virtual Machine/Message Passing Interface Users' Group Meeting, pp.97-104, 2004.

O. Ronneberger, P. Fischer, and T. Brox, U-net: Convolutional networks for biomedical image segmentation, CoRR, 2015.

J. Long, E. Shelhamer, and T. Darrell, Fully convolutional networks for semantic segmentation, The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015.

L. Zhao and K. Jia, Multiscale cnns for brain tumor segmentation and diagnosis, Comp. Math. Methods in Medicine, vol.2016, issue.7, pp.1-8356294, 2016.

B. Menze, A. Jakab, S. Bauer, J. Kalpathy-cramer, K. Farahani et al., The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS), IEEE Transactions on Medical Imaging, vol.34, pp.1993-2024, 2014.
URL : https://hal.archives-ouvertes.fr/hal-00935640

A. Isin, C. Direkoglu, and M. Sah, Review of mri-based brain tumor image segmentation using deep learning methods, Procedia Comput. Sci, vol.102, pp.317-324, 2016.

C. Tobon-gomez and . Geers, Benchmark for algorithms segmenting the left atrium from 3d ct and mri datasets, IEEE transactions on medical imaging, vol.34, issue.7, pp.1460-1473, 2015.
URL : https://hal.archives-ouvertes.fr/hal-01260607