M. Abadi, A. Agarwal, P. Barham, E. Brevdo, Z. Chen et al., TensorFlow: Large-scale machine learning on heterogeneous systems, 2015.

A. Kemsley, E. Wilson, and R. , Mid-infrared spectroscopy and authenticity problems in selected meats: a feasibility study, Food Chemistry, vol.59, issue.2, pp.195-201, 1997.

W. Aswolinskiy, R. F. Reinhart, and J. Steil, Time series classification in reservoir-and model-space: A comparison, Artificial Neural Networks in Pattern Recognition, pp.197-208, 2016.

W. Aswolinskiy, R. F. Reinhart, and J. Steil, Time series classification in reservoir-and model-space, Neural Processing Letters, vol.48, pp.789-809, 2017.

A. Bagnall and G. Janacek, A run length transformation for discriminating between auto regressive time series, Journal of Classification, vol.31, issue.2, pp.154-178, 2014.

H. Ismail-fawaz,

A. Bagnall, J. Lines, J. Hills, and A. Bostrom, Time-series classification with COTE: The collective of transformation-based ensembles, International Conference on Data Engineering, pp.1548-1549, 2016.

A. Bagnall, J. Lines, A. Bostrom, J. Large, and E. Keogh, The great time series classification bake off: a review and experimental evaluation of recent algorithmic advances, Data Mining and Knowledge Discovery, vol.31, issue.3, pp.606-660, 2017.

D. Bahdanau, K. Cho, and Y. Bengio, Neural Machine Translation by Jointly Learning to Align and Translate, International Conference on Learning Representations Baird HS (1992) Document Image Defect Models, pp.546-556, 2015.

D. Banerjee, K. Islam, G. Mei, L. Xiao, G. Zhang et al., A deep transfer learning approach for improved post-traumatic stress disorder diagnosis, IEEE International Conference on Data Mining, pp.11-20, 2017.

M. G. Baydogan, Multivariate time series classification datasets, 2015.

M. G. Baydogan, G. Runger, and E. Tuv, A bag-of-features framework to classify time series, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.35, issue.11, pp.2796-2802, 2013.

G. Bellman-r-(-;-corani and F. Mangili, Should we really use post-hoc tests based on mean-ranks?, Machine Learning Research, vol.17, issue.1, pp.152-161, 2010.

Y. Bengio, L. Yao, A. G. Vincent, and P. , Generalized denoising auto-encoders as generative models, International Conference on Neural Information Processing Systems, pp.899-907, 2013.

F. M. Bianchi, S. Scardapane, S. Løkse, and R. Jenssen, Reservoir computing approaches for representation and classification of multivariate time series, 2018.

C. Bishop, Springer Bostrom A, Bagnall A (2015) Binary shapelet transform for multiclass time series classification, Big Data Analytics and Knowledge Discovery, pp.257-269, 2006.

Z. Che, Y. Cheng, S. Zhai, Z. Sun, and Y. Liu, Boosting deep learning risk prediction with generative adversarial networks for electronic health records, IEEE International Conference on Data Mining, pp.787-792, 2017.

Z. Che, X. He, K. Xu, and Y. Liu, DECADE: A deep metric learning model for multivariate time series, KDD Workshop on Mining and Learning from Time Series, 2017.

H. Chen, F. Tang, P. Tino, and X. Yao, Model-based kernel for efficient time series analysis, ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp.392-400, 2013.

H. Chen, F. Tang, P. Tiño, A. Cohn, and X. Yao, Model metric co-learning for time series classification, International Joint Conference on Artificial Intelligence, pp.3387-3394, 2015.

Y. Chen, E. Keogh, B. Hu, N. Begum, A. Bagnall et al., The UCR time series classification archive, vol.28, 2015.

C. Fea, , 2015.

N. Chouikhi, B. Ammar, and A. M. Alimi, Genesis of basic and multi-layer echo state network recurrent autoencoders for efficient data representations, 2018.

C. Borges-gamboa and J. , Deep learning for time-series analysis, 2017.

Z. Cui, W. Chen, and Y. Chen, Multi-scale convolutional neural networks for time series classification, 2016.

H. A. Dau, D. F. Silva, F. Petitjean, G. Forestier, A. Bagnall et al., Judicious setting of dynamic time warping's window width allows more accurate classification of time series, IEEE International Conference on Big Data, pp.917-922, 2017.

H. A. Dau, A. Bagnall, K. Kamgar, C. Yeh, Y. Zhu et al., The UCR Time Series Archive. ArXiv, 2018.

, Deep learning for time series classification: a review 39

J. Dem?ar, Statistical comparisons of classifiers over multiple data sets, Machine Learning Research, vol.7, pp.1-30, 2006.

H. Deng, G. Runger, E. Tuv, and M. Vladimir, A time series forest for classification and feature extraction, Information Sciences, vol.239, pp.142-153, 2013.

P. Esling and C. Agon, Time-series data mining, ACM Computing Surveys, vol.45, issue.1, p.34, 2012.
URL : https://hal.archives-ouvertes.fr/hal-01577883

O. Faust, Y. Hagiwara, T. J. Hong, O. S. Lih, and U. R. Acharya, Deep learning for healthcare applications based on physiological signals: A review, Computer Methods and Programs in Biomedicine, vol.161, pp.1-13, 2018.

G. Forestier, F. Petitjean, H. A. Dau, G. I. Webb, and E. Keogh, Generating synthetic time series to augment sparse datasets, IEEE International Conference on Data Mining, pp.865-870, 2017.

M. Friedman, A comparison of alternative tests of significance for the problem of m rankings, The Annals of Mathematical Statistics, vol.11, issue.1, pp.86-92, 1940.

C. Gallicchio and A. Micheli, Deep echo state network (DeepESN): A brief survey, 2017.

S. Garcia and F. Herrera, An extension on "statistical comparisons of classifiers over multiple data sets" for all pairwise comparisons, Machine learning research, vol.9, pp.2677-2694, 2008.

Y. Geng and X. Luo, Cost-sensitive convolution based neural networks for imbalanced time-series classification, 2018.

X. Glorot and Y. Bengio, Understanding the difficulty of training deep feedforward neural networks, International Conference on Artificial Intelligence and Statistics, vol.9, pp.249-256, 2010.

Y. Goldberg, A primer on neural network models for natural language processing, Artificial Intelligence Research, vol.57, issue.1, pp.345-420, 2016.

Z. Gong, H. Chen, B. Yuan, and X. Yao, Multiobjective learning in the model space for time series classification, IEEE Transactions on Cybernetics, vol.99, pp.1-15, 2018.

J. Grabocka, N. Schilling, M. Wistuba, and L. Schmidt-thieme, Learning time-series shapelets, ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp.392-401, 2014.

N. Hatami, Y. Gavet, J. Debayle, X. Zhang, S. Ren et al., Delving deep into rectifiers: Surpassing human-level performance on imagenet classification, IEEE International Conference on Computer Vision, pp.1026-1034, 2015.

K. He, X. Zhang, S. Ren, and J. Sun, Deep residual learning for image recognition, IEEE Conference on Computer Vision and Pattern Recognition, pp.770-778, 2016.

J. Hills, J. Lines, E. Baranauskas, J. Mapp, and A. Bagnall, Classification of time series by shapelet transformation, Data Mining and Knowledge Discovery, vol.28, issue.4, pp.851-881, 2014.

G. Hinton, L. Deng, D. Yu, G. E. Dahl, A. R. Mohamed et al., Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups, IEEE Signal Processing Magazine, vol.29, issue.6, pp.82-97, 2012.

A. E. Hoerl and R. W. Kennard, Ridge regression: Applications to nonorthogonal problems, Technometrics, vol.12, issue.1, pp.69-82, 1970.

S. Holm, A simple sequentially rejective multiple test procedure, Scandinavian Journal of Statistics, vol.6, issue.2, pp.65-70, 1979.

F. Höppner, Improving time series similarity measures by integrating preprocessing steps, Data Mining and Knowledge Discovery, vol.31, pp.851-878, 2016.

Q. Hu, R. Zhang, and Y. Zhou, Transfer learning for short-term wind speed prediction with deep neural networks, Renewable Energy, vol.85, pp.83-95, 2016.

, Real-time human activity recognition from accelerometer data using convolutional neural networks, Applied Soft Computing, vol.62, pp.915-922, 2018.

H. Ismail-fawaz,

S. Ioffe and C. Szegedy, Batch normalization: Accelerating deep network training by reducing internal covariate shift, International Conference on Machine Learning, vol.37, pp.448-456, 2015.

I. Fawaz, H. Forestier, G. Weber, J. Idoumghar, L. Muller et al., Data augmentation using synthetic data for time series classification with deep residual networks, International Workshop on Advanced Analytics and Learning on Temporal Data, pp.214-221, 2018.

I. Fawaz, H. Forestier, G. Weber, J. Idoumghar, L. Muller et al., Transfer learning for time series classification, IEEE International Conference on Big Data, pp.1367-1376, 2018.

H. Jaeger and H. Haas, Harnessing nonlinearity: Predicting chaotic systems and saving energy in wireless communication, Science, vol.304, issue.5667, pp.78-80, 2004.

R. J. Kate, Using dynamic time warping distances as features for improved time series classification, Data Mining and Knowledge Discovery, vol.30, issue.2, pp.283-312, 2016.

E. Keogh and A. Mueen, Curse of dimensionality. Encyclopedia of Machine Learning and Data Mining, pp.314-315, 2017.

Y. Kim, Convolutional neural networks for sentence classification, Empirical Methods in Natural Language Processing, 2014.

D. P. Kingma and J. Ba, Adam: A method for stochastic optimization, International Conference on Learning Representations, 2015.

A. Kotsifakos and P. Papapetrou, Model-based time series classification, Advances in Intelligent Data Analysis, pp.179-191, 2014.

I. Krasin, T. Duerig, N. Alldrin, V. Ferrari, S. Abu-el-haija et al., OpenImages: A public dataset for large-scale multi-label and multi-class image classification, 2017.

A. Krizhevsky, I. Sutskever, and G. E. Hinton, ImageNet classification with deep convolutional neural networks, Advances in Neural Information Processing Systems, vol.25, pp.1097-1105, 2012.

J. B. Kruskal and M. Wish, Multidimensional scaling. number 07-011 in sage university paper series on quantitative applications in the social sciences, 1978.

M. Längkvist, L. Karlsson, and A. Loutfi, A review of unsupervised feature learning and deep learning for time-series modeling, Pattern Recognition Letters, vol.42, pp.11-24, 2014.

J. Large, J. Lines, and A. Bagnall, The Heterogeneous Ensembles of Standard Classification Algorithms (HESCA): the Whole is Greater than the Sum of its Parts, 2017.

Q. Le and T. Mikolov, Distributed representations of sentences and documents, International Conference on Machine Learning, vol.32, pp.1188-1196, 2014.

L. Guennec, A. Malinowski, S. Tavenard, R. Lecun, Y. Bottou et al., Data augmentation for time series classification using convolutional neural networks, ECML/PKDD Workshop on Advanced Analytics and Learning on Temporal Data, vol.86, pp.2278-2324, 1998.
URL : https://hal.archives-ouvertes.fr/halshs-01357973

Y. Lecun, L. Bottou, G. B. Orr, and K. R. Müller, Efficient backprop, Neural Networks: Tricks of the Trade, pp.9-50, 1998.

Y. Lecun, Y. Bengio, and G. Hinton, Deep learning, Nature, vol.521, pp.436-444, 2015.

S. Lin and G. C. Runger, GCRNN: Group-constrained convolutional recurrent neural network, IEEE Transactions on Neural Networks and Learning Systems, vol.99, pp.1-10, 2018.

, Deep learning for time series classification: a review 41

J. Lines and A. Bagnall, Time series classification with ensembles of elastic distance measures, Data Mining and Knowledge Discovery, vol.29, issue.3, pp.565-592, 2015.

J. Lines, S. Taylor, and A. Bagnall, HIVE-COTE: The hierarchical vote collective of transformationbased ensembles for time series classification, IEEE International Conference on Data Mining, pp.1041-1046, 2016.

J. Lines, S. Taylor, and A. Bagnall, Time series classification with HIVE-COTE: The hierarchical vote collective of transformation-based ensembles, ACM Transactions on Knowledge Discovery from Data, vol.12, issue.5, p.35, 2018.

C. Liu, W. Hsaio, and Y. Tu, Time series classification with multivariate convolutional neural network, IEEE Transactions on Industrial Electronics, vol.66, pp.1-1, 2018.

J. Lu, S. Young, A. I. Holleman, and J. , A 1 tops/w analog deep machine-learning engine with floating-gate storage in 0.13 µm cmos, IEEE Journal of Solid-State Circuits, vol.50, issue.1, pp.270-281, 2015.

B. Lucas, A. Shifaz, C. Pelletier, L. O'neill, N. Zaidi et al., Proximity Forest: An effective and scalable distance-based classifier for time series, Data Mining and Knowledge Discovery, vol.28, pp.851-881, 2018.

Q. Ma, L. Shen, W. Chen, J. Wang, J. Wei et al., Functional echo state network for time series classification, Information Sciences, vol.373, pp.1-20, 2016.

P. Malhotra, . Tv-v, L. Vig, P. Agarwal, and G. Shroff, TimeNet: Pre-trained deep recurrent neural network for time series classification, European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning, pp.607-612, 2018.

C. Martinez, G. Perrin, E. Ramasso, M. Rombaut, N. Mehdiyev et al., Time series classification using deep learning for process planning: A case from the process industry, European Signal Processing Conference, vol.114, pp.242-249, 2017.

T. Mikolov, K. Chen, G. Corrado, and J. Dean, Efficient Estimation of Word Representations in Vector Space, International Conference on Learning Representations -Workshop, 2013.

T. Mikolov, I. Sutskever, K. Chen, G. Corrado, and J. Dean, Distributed representations of words and phrases and their compositionality, Neural Information Processing Systems, pp.3111-3119, 2013.

R. Mittelman, Time-series modeling with undecimated fully convolutional neural networks, 2015.

R. Neamtu, R. Ahsan, E. A. Rundensteiner, G. Sarkozy, E. Keogh et al., Generalized dynamic time warping: Unleashing the warping power hidden in point-wise distances, IEEE International Conference on Data Engineering, pp.947-958, 2017.

T. L. Nwe, T. H. Dat, and B. Ma, Convolutional neural network with multi-task learning scheme for acoustic scene classification, Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, pp.1347-1350, 2017.

H. F. Nweke, Y. W. Teh, A. Ma, and U. R. Alo, Deep learning algorithms for human activity recognition using mobile and wearable sensor networks: State of the art and research challenges, Expert Systems with Applications, vol.105, pp.233-261, 2018.

F. J. Ordónez and D. Roggen, Deep convolutional and LSTM recurrent neural networks for multimodal wearable activity recognition, Sensors, vol.16, p.115, 2016.

S. J. Pan and Q. Yang, A survey on transfer learning, IEEE Transactions on Knowledge and Data Engineering, vol.22, issue.10, pp.1345-1359, 2010.

N. Papernot and P. Mcdaniel, Deep k-nearest neighbors: Towards confident, interpretable and robust deep learning, 2018.

H. Ismail-fawaz,

R. Pascanu, T. Mikolov, and Y. Bengio, Understanding the exploding gradient problem, 2012.

R. Pascanu, T. Mikolov, and Y. Bengio, On the difficulty of training recurrent neural networks, International Conference on Machine Learning, vol.28, 2013.

F. Petitjean, G. Forestier, G. I. Webb, A. E. Nicholson, Y. Chen et al., Faster and more accurate classification of time series by exploiting a novel dynamic time warping averaging algorithm, Knowledge Information Systems, vol.47, issue.1, pp.1-26, 2016.
URL : https://hal.archives-ouvertes.fr/hal-01455034

T. Poggio, H. Mhaskar, L. Rosasco, B. Miranda, and Q. Liao, Why and when can deep-but not shallow-networks avoid the curse of dimensionality: A review, International Journal of Automation and Computing, vol.14, issue.5, pp.503-519, 2017.

D. Rajan and J. Thiagarajan, A generative modeling approach to limited channel ecg classification, IEEE Engineering in Medicine and Biology Society, p.2571, 2018.

A. Rajkomar, O. E. Chen, K. Dai, A. M. Hajaj, N. Liu et al., Scalable and accurate deep learning for electronic health records, NPJ Digital Medicine, vol.1, p.18, 2018.

C. A. Ratanamahatana and E. Keogh, Three myths about dynamic time warping data mining, SIAM International Conference on Data Mining, pp.506-510, 2005.

A. Rowe and P. C. Abbott, Daubechies wavelets and mathematica, Computers in Physics, vol.9, issue.6, pp.635-648, 1995.

O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh et al., ImageNet large scale visual recognition challenge, International Journal of Computer Vision, vol.115, issue.3, pp.211-252, 2015.

T. N. Sainath, A. R. Mohamed, B. Kingsbury, and B. Ramabhadran, Deep convolutional neural networks for LVCSR, IEEE International Conference on Acoustics, Speech and Signal Processing, pp.8614-8618, 2013.

T. Santos and R. Kern, A literature survey of early time series classification and deep learning, International Conference on Knowledge Technologies and Data-driven Business, 2017.

P. Schäfer, The BOSS is concerned with time series classification in the presence of noise, Data Mining and Knowledge Discovery, vol.29, issue.6, pp.1505-1530, 2015.

J. Serrà, S. Pascual, and A. Karatzoglou, Towards a universal neural network encoder for time series, Artificial Intelligence Research and Development: Current Challenges, vol.308, p.120, 2018.

D. F. Silva, R. Giusti, E. Keogh, and G. Batista, Speeding up similarity search under dynamic time warping by pruning unpromising alignments, Data Mining and Knowledge Discovery, vol.32, issue.4, pp.988-1016, 2018.

N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, Dropout: A simple way to prevent neural networks from overfitting, Journal of Machine Learning Research, vol.15, pp.1929-1958, 2014.

N. Strodthoff and C. Strodthoff, Detecting and interpreting myocardial infarction using fully convolutional neural networks, Physiological Measurement, vol.40, issue.1, p.15001, 2019.

G. A. Susto, A. Cenedese, and M. Terzi, Time-series classification methods: Review and applications to power systems data, Big Data Application in Power Systems, pp.179-220, 2018.

I. Sutskever, O. Vinyals, and Q. V. Le, Sequence to sequence learning with neural networks, Neural Information Processing Systems, pp.3104-3112, 2014.

C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed et al., Going deeper with convolutions, IEEE Conference on Computer Vision and Pattern Recognition, pp.1-9, 2015.

, Deep learning for time series classification: a review 43

P. Tanisaro and G. Heidemann, Time series classification using time warping invariant echo state networks, IEEE International Conference on Machine Learning and Applications, pp.831-836, 2016.

R. Tripathy and U. R. Acharya, Use of features from RR-time series and EEG signals for automated classification of sleep stages in deep neural network framework, Biocybernetics and Biomedical Engineering, vol.38, pp.890-902, 2018.

M. Uemura, M. Tomikawa, T. Miao, R. Souzaki, S. Ieiri et al., Feasibility of an AI-based measure of the hand motions of expert and novice surgeons, Computational and Mathematical Methods in Medicine, 2018.

D. Ulyanov, A. Vedaldi, and V. Lempitsky, Instance normalization: The missing ingredient for fast stylization, 2016.

A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones et al., Polosukhin I (2017) Attention is all you need, Advances in Neural Information Processing Systems, pp.5998-6008

J. Wang, Y. Chen, S. Hao, X. Peng, and L. Hu, Deep learning for sensor-based activity recognition: A survey, Pattern Recognition Letters, 2018.

J. Wang, Z. Wang, J. Li, and J. Wu, Multilevel wavelet decomposition network for interpretable time series analysis, ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp.2437-2446, 2018.

L. Wang, Z. Wang, and S. Liu, An effective multivariate time series classification approach using echo state network and adaptive differential evolution algorithm, Expert Systems with Applications, vol.43, pp.237-249, 2016.

S. Wang, G. Hua, G. Hao, and C. Xie, A cycle deep belief network model for multivariate time series classification, Mathematical Problems in Engineering, vol.2017, pp.1-7, 2017.

W. Wang, C. Chen, W. Wang, P. Rai, and C. L. , Earliness-aware deep convolutional networks for early time series classification, 2016.

Z. Wang and T. Oates, Encoding time series as images for visual inspection and classification using tiled convolutional neural networks, Workshops at AAAI Conference on Artificial Intelligence, pp.40-46, 2015.

Z. Wang and T. Oates, Imaging time-series to improve classification and imputation, International Conference on Artificial Intelligence, pp.3939-3945, 2015.

Z. Wang and T. Oates, Spatially encoding temporal correlations to classify temporal data using convolutional neural networks, 2015.

Z. Wang, W. Song, L. Liu, F. Zhang, J. Xue et al., Representation learning with deconvolution for multivariate time series classification and visualization, 2016.

Z. Wang, W. Yan, and T. Oates, Time series classification from scratch with deep neural networks: A strong baseline, International Joint Conference on Neural Networks, pp.1578-1585, 2017.

F. Wilcoxon, Individual comparisons by ranking methods, Biometrics Bulletin, vol.1, issue.6, pp.80-83, 1945.

Q. Yang and X. Wu, 10 challenging problems in data mining research, Information Technology & Decision Making, vol.05, issue.04, pp.597-604, 2006.

L. Ye and E. Keogh, Time series shapelets: a novel technique that allows accurate, interpretable and fast classification, Data Mining and Knowledge Discovery, vol.22, issue.1, pp.149-182, 2011.

J. Yosinski, J. Clune, Y. Bengio, and H. Lipson, How transferable are features in deep neural networks? In: International Conference on Neural Information Processing Systems, vol.2, pp.3320-3328, 2014.

M. D. Zeiler, ADADELTA: An adaptive learning rate method, 2012.

C. Zhang, S. Bengio, M. Hardt, B. Recht, O. Vinyals et al., Understanding deep learning requires rethinking generalization, International Conference on Learning Representations, vol.28, pp.162-169, 2017.

H. Ismail-fawaz,

Y. Zheng, Q. Liu, E. Chen, Y. Ge, and J. L. Zhao, Time series classification using multi-channels deep convolutional neural networks, Web-Age Information Management, pp.298-310, 2014.

Y. Zheng, Q. Liu, E. Chen, Y. Ge, and J. L. Zhao, Exploiting multi-channels deep convolutional neural networks for multivariate time series classification, Frontiers of Computer Science, vol.10, issue.1, pp.96-112, 2016.

B. Zhou, A. Khosla, A. Lapedriza, A. Oliva, and A. Torralba, Learning deep features for discriminative localization, IEEE Conference on Computer Vision and Pattern Recognition, pp.2921-2929, 2016.

A. Ziat, E. Delasalles, L. Denoyer, and P. Gallinari, Spatio-temporal neural networks for space-time series forecasting and relations discovery, IEEE International Conference on Data Mining, pp.705-714, 2017.
URL : https://hal.archives-ouvertes.fr/hal-02297513