R. T. Alexander, J. M. Bieman, and A. A. Andrews, Towards the systematic testing of aspect-oriented programs Dwell-andspring: undo for direct manipulation, Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'12), pp.1-9, 2004.

D. Amalfitano, A. R. Fasolino, P. Tramontana, S. De-carmine, and A. M. Memon, Using GUI ripping for automated testing of Android applications, Proceedings of the 27th IEEE/ACM International Conference on Automated Software Engineering, ASE 2012, pp.258-261, 2012.
DOI : 10.1145/2351676.2351717

A. S. Arlt, C. Podelski, M. Bertolini, I. Schaf, A. M. Banerjee et al., Lightweight Static Analysis for GUI Testing, 2012 IEEE 23rd International Symposium on Software Reliability Engineering, pp.301-310, 2012.
DOI : 10.1109/ISSRE.2012.25

[. Adamoli, D. Zaparanuks, M. Jovic, and M. Hauswirth, Automated GUI performance testing, Software Quality Journal, vol.36, issue.5
DOI : 10.1007/s11219-011-9135-x

R. [. Bsekken and . Alexander, A candidate fault model for aspectj pointcuts, Software Reliability Engineering ISSRE '06. 17th International Symposium on, pp.169-178, 2006.

A. Blouin and O. Beaudoux, Improving modularity and usability of interactive systems with Malai, Proceedings of the 2nd ACM SIGCHI symposium on Engineering interactive computing systems, EICS '10, pp.115-124, 2010.
DOI : 10.1145/1822018.1822037
URL : https://hal.archives-ouvertes.fr/inria-00477627

M. [. Belli, N. Beyazit, and . Güler, Event-Based GUI Testing and Reliability Assessment Techniques -- An Experimental Insight and Preliminary Results, 2011 IEEE Fourth International Conference on Software Testing, Verification and Validation Workshops, pp.212-221, 2011.
DOI : 10.1109/ICSTW.2011.59

J. Arvid-børretzen and R. Conradi, Results and experiences from an empirical study of fault reports in industrial projects, Proc. of PROFES'06, pp.389-394, 2006.

[. Beaudoux, M. Clavreul, and A. Blouin, Binding orthogonal views for user interface design, Proceedings of the 1st Workshop on View-Based, Aspect-Oriented and Orthographic Software Modelling, VAO '13, p.4, 2013.
DOI : 10.1145/2489861.2489865
URL : https://hal.archives-ouvertes.fr/hal-00826705

B. Beizer, Software Testing Techniques, 1990.

R. V. Binder, Object-oriented software testing, Communications of the ACM, vol.37, issue.9
DOI : 10.1145/182987.182988

R. V. Binder, Testing Object-oriented Systems: Models, Patterns, and Tools, 1999.

. Michel-beaudouin-lafon, Instrumental interaction, Proceedings of the SIGCHI conference on Human factors in computing systems , CHI '00, pp.446-453, 2000.
DOI : 10.1145/332040.332473

H. M. Michel-beaudouin-lafon and . Lassen, The architecture and implementation of CPN2000, a post-WIMP graphical application, Proceedings of the 13th annual ACM symposium on User interface software and technology , UIST '00, pp.181-190, 2000.
DOI : 10.1145/354401.354761

A. Blouin, Un modèle pour l'ingénierie des systèmes interactifs dédiés à la manipulation de données, 2009.

[. Barnett, K. Rustanm, W. Leino, and . Schulte, The Spec# Programming System: An Overview, Construction and Analysis of Safe, Secure, and Interoperable Smart Devices, pp.49-69, 2005.
DOI : 10.1007/978-3-540-30569-9_3

R. Black and J. L. Mitchell, Advanced Software Testing - Guide to the ISTQB Advanced Certification As an Advanced Technical Test Analyst, 2011.

W. J. Brown, R. C. Malveau, H. W. Mccormick, I. , and T. J. Mowbray, AntiPatterns: Refactoring Software, Architectures, and Projects in Crisis, 1998.

B. Bmn-+-11-]-arnaud-blouin, G. Morin, O. Nain, P. Beaudoux, J. Albers et al., Combining aspect-oriented modeling with property-based reasoning to improve user interface adaptation, Proceedings of the 3rd ACM SIGCHI Symposium on Engineering Interactive Computing Systems, pp.85-94, 2011.

B. [. Brooks, A. M. Robinson, and . Memon, An Initial Characterization of Industrial Graphical User Interface Systems, 2009 International Conference on Software Testing Verification and Validation
DOI : 10.1109/ICST.2009.11

R. Chillarege, S. Inderpal, . Bhandari, K. Jarir, . Chaar et al., Orthogonal defect classification-a concept for in-process measurements, IEEE Transactions on Software Engineering, vol.18, issue.11
DOI : 10.1109/32.177364

S. [. Cohen, A. M. Huang, and . Memon, AutoInSpec: Using Missing Test Coverage to Improve Specifications in GUIs, 2012 IEEE 23rd International Symposium on Software Reliability Engineering, pp.251-260, 2012.
DOI : 10.1109/ISSRE.2012.33

P. [. Ceccato, F. Tonella, and . Ricca, s aop code easier or harder to test than oop code?, Proceedings of the 1st Workshop on Testing Aspect- Oriented Programs (WTAOP), held in conjunction with the 4th international Conference on Aspect-Oriented Software Development (AOSD), 2005.

W. Chen and J. Wang, Bad Smells and Refactoring Methods for GUI Test Scripts, 2012 13th ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing, pp.289-294, 2012.
DOI : 10.1109/SNPD.2012.10

R. Siddhartha, A. Dalal, N. Jain, . Karunanithi, . Jm-leaton et al., Modelbased testing in practice, Proceedings of the 21st International Conference on Software Engineering, ICSE '99, pp.285-294, 1999.

A. [. Deursen, L. M. Marin, and . Moonen, AS y s t e m a t i cA s p e c t oriented Refactoring and Testing Strategy, and Its Application to JHot- Draw, 2005.

[. Fontana, P. Braione, and M. Zanoni, Automatic detection of bad smells in code: An experimental assessment Interactive cockpits as critical applications: a model-based and a fault-tolerant approach, Journal of Object Technology IJCCBS, vol.12, issue.43, pp.1-3, 2013.

M. Fowler, Refactoring: Improving the Design of Existing Code, 1999.
DOI : 10.1007/3-540-45672-4_31

[. Gamma, R. Helm, R. Johnson, and J. Vlissides, Design patterns: elements of reusable object-oriented software, 1995.

J. Garcia, D. Popescu, G. Edwards, and N. Medvidovic, Identifying Architectural Bad Smells, 2009 13th European Conference on Software Maintenance and Reengineering, pp.2-5, 2009.
DOI : 10.1109/CSMR.2009.59

R. B. Grady, Practical Software Metrics for Project Management and Process Improvement, 1992.

[. Suryanarayana and T. Sharma, Refactoring for Software Design Smells, 2015.

Q. [. Grechanik, C. Xie, and . Fu, Maintaining and evolving guidirected test scripts, Software Engineering, 2009. ICSE 2009. IEEE 31st International Conference on, pp.408-418, 2009.

M. Anna, G. Gaitani, E. Vassilis, N. A. Zafeiris, E. A. Diamantidis et al., Automated refactoring to the null object design pattern, Information and Software Technology

E. L. Hutchins, J. D. Hollan, D. A. Norman, T. Hall, M. Zhang et al., Direct manipulation interfaces Some code smells have a significant but small effect on faults, Hum.-Comput. Interact. ACM Transactions on Software Engineering and Methodology, vol.133, issue.234, pp.1-3339, 2014.

[. Iec, Nuclear power plants -main control-room -verification and validation of design, 1995.

[. Iec, Nuclear power plants -control rooms -design, 2010.

[. Ieee, Standard classification for software anomalies, IEEE Std, pp.1044-2009

J. K. Robert, A. Jacob, L. M. Girouard, M. S. Hirshfield, O. Horn et al., Realitybased interaction: A framework for post-wimp interfaces, Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '08, pp.201-210, 2008.

Y. Jia and M. Harman, An Analysis and Survey of the Development of Mutation Testing, IEEE Transactions on Software Engineering, vol.37, issue.5, pp.649-678, 2011.
DOI : 10.1109/TSE.2010.62

A. Jaimes and N. Sebe, Multimodal human-computer interaction: A surveySpecial Issue on Vision for Human-Computer Interaction, Comput. Vis. Image Underst, vol.1, issue.8

[. Karagkasidis, Developing GUI applications: Architectural patterns revisited, EuroPLoP 2008: 13th Annual European Conference on Pattern Languages of Programming CEUR Workshop Proceedings. CEUR-WS.org, 2008.

[. Kim, J. A. Clark, and J. A. Mcdermid, Class mutation: Mutation testing for object-oriented programs, PROC. Net.ObjectDays Conf. Object-Oriented Software Systems, 2000.

K. [. Kumar-maji, S. Hao, S. Sultana, and . Bagchi, Characterizing Failures in Mobile OSes: A Case Study with Android and Symbian, 2010 IEEE 21st International Symposium on Software Reliability Engineering, pp.249-258, 2010.
DOI : 10.1109/ISSRE.2010.45

S. [. Krasner and . Pope, A description of the model-view-controller user interface paradigm in smalltalk80 system, Journal of Object Oriented Programming, vol.1, pp.2-6

[. Khomh, S. Vaucher, Y. Guéhéneuc, and H. Sahraoui, BDTEX: A GQM-based bayesian approach for the detection of antipatterns A field study of refactoring challenges and benefits, Proceedings of the ACM SIGSOFT 20th International Symposium on the Foundations of Software Engineering, p.50, 2012.

[. Lelli, A. Blouin, and B. Benoit, Classifying and Qualifying GUI Defects, 2015 IEEE 8th International Conference on Software Testing, Verification and Validation (ICST), pp.1-10, 2015.
DOI : 10.1109/ICST.2015.7102582
URL : https://hal.archives-ouvertes.fr/hal-01114724

V. Lelli, A. Blouin, B. Benoit, F. Coulon, and B. Olivier, Automatic detection of GUI design smells, Proceedings of the 8th ACM SIGCHI Symposium on Engineering Interactive Computing Systems, EICS '16, pp.1-10, 2015.
DOI : 10.1145/2933242.2933260
URL : https://hal.archives-ouvertes.fr/hal-01308625

V. Lelli, Challenges of Testing for Critical Interactive Systems, 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation, pp.509-510, 2013.
DOI : 10.1109/ICST.2013.68
URL : https://hal.archives-ouvertes.fr/hal-00804876

[. Li, Z. Li, and X. Sun, Classification of software defect detected by black-box testing: An empirical study, Proc. of WCSE'10, 2010.

]. R. Lm04, I. C. Lutz, and . Mikulski, Empirical analysis of safety-critical anomalies during operations, IEEE Trans. Softw. Eng, pp.172-180, 2004.

S. Lu, S. Park, E. Seo, and Y. Zhou, Learning from mistakes ?-a comprehensive study on real world concurrency bug characteristics, Proceedings of Architectural Support for Programming Languages and Operating Systems (ASPLOS), 2008.

W. Li and R. Shatnawi, An empirical study of the bad smells and class error probability in the post-release object-oriented system evolution, Dynamic Resource Management in Distributed Real-Time Systems, pp.1120-1128, 2007.
DOI : 10.1016/j.jss.2006.10.018

K. Magel and I. Alsmadi, GUI structural metrics and testability testing, Proceedings of the 11th IASTED International Conference on Software Engineering and Applications, SEA '07, pp.91-95, 2007.

[. Marinescu, Detection strategies: metrics-based rules for detecting design flaws, 20th IEEE International Conference on Software Maintenance, 2004. Proceedings., pp.350-359, 2004.
DOI : 10.1109/ICSM.2004.1357820

M. Atif, I. Memon, A. Banerjee, and . Nagarajan, GUI ripping: Reverse engineering of graphical user interfaces for testing, Proceedings of The 10th Working Conference on Reverse Engineering, 2003.

A. Memon, I. Banerjee, B. Nguyen, and B. Robbins, The first decade of GUI ripping: Extensions, applications, and broader impacts, 2013 20th Working Conference on Reverse Engineering (WCRE), 2013.
DOI : 10.1109/WCRE.2013.6671275

F. [. Mccluskey and . Clegg, Fault equivalence in combinational logic networks. Computers, IEEE Transactions, issue.11, pp.201286-1293, 1971.

T. J. Mccabe, A Complexity Measure, Proceedings of the 2Nd International Conference on Software Engineering, ICSE '76, p.407, 1976.
DOI : 10.1109/TSE.1976.233837

W. Mark, D. Maier, R. Emery, and . Hilliard, Software architecture: introducing ieee standard 1471, Computer,3, vol.4, issue.4

M. Atif and . Memon, Advances in GUI testing, Highly Dependable Software ? Advances in Computers, pp.149-201, 2003.

M. Atif and . Memon, An event-flow model of GUI-based applications for testing

M. Atif and . Memon, Automatically repairing event sequence-based GUI test suites for regression testing, ACM Trans. Softw. Eng. Methodol, vol.18, issue.2, pp.4-5, 2008.

Y. Moha, L. Gueheneuc, L. Duchien, and . Meur, Decor, Proceedings of the twenty-second IEEE/ACM international conference on Automated software engineering , ASE '07, pp.0-3, 2002.
DOI : 10.1145/1321631.1321727
URL : https://hal.archives-ouvertes.fr/tel-00321081

[. Mauser, A. Klaus, R. Zhang, and L. Duan, GUI failure analysis and classification for the development of in-vehicle infotainment, Proc. of VALID'12, pp.79-84, 2012.

V. Mika, C. Mantyla, and . Lassenius, What types of defects are really discovered in code reviews?, IEEE Transactions on Software Engineering, vol.35, issue.3, pp.430-448, 2009.

F. Moha, M. Palma, B. Nayrolles, . Conseil, . Yann-gael et al., Specification and Detection of SOA Antipatterns, International Conference on Service Oriented Computing
DOI : 10.1007/978-3-642-34321-6_1
URL : https://hal.archives-ouvertes.fr/hal-00722472

[. Mariani, M. Pezzè, O. Riganelli, and M. Santoro, AutoBlackTest, Proceeding of the 33rd international conference on Software engineering, ICSE '11, pp.1013-1015, 2011.
DOI : 10.1145/1985793.1985979

. A. Brad and . Myers, Separating application code from toolkits: Eliminating the spaghetti of call-backs, Proceedings of the 4th Annual ACM Symposium on User Interface Software and Technology, UIST '91, pp.211-220, 1991.

. A. Brad and . Myers, User interface software tools, ACM Transactions on Computer-Human Interaction, vol.2, issue.1

A. Donald and . Norman, The Design of Everyday Things. Basic Books, reprint paperback edition, 2002.

[. Navarre, P. Palanque, J. Ladry, and E. Barboni, ICOs, ACM Transactions on Computer-Human Interaction, vol.16, issue.4, pp.1-5
DOI : 10.1145/1614390.1614393

B. N. Nguyen, B. Robbins, I. Banerjee, and A. Memon, GUI- TAR: an innovative tool for automated testing of gui-driven software, Automated Software Engineering, vol.1, issue.2 1

[. Nguyen, P. Strooper, and J. G. Süß, Automated functionality testing through GUIs, Proceedings of the 33th Australasian Conference on Computer Science, pp.153-162, 2010.

J. Offutt, R. Alexander, Y. Wu, Q. Xiao, and C. Hutchinson, A fault model for subtype inheritance and polymorphism, Proceedings 12th International Symposium on Software Reliability Engineering
DOI : 10.1109/ISSRE.2001.989461

[. Omg, UML 2.1.1 Specification, 2007.

[. Ocariza, K. Pattabiraman, and A. Mesbah, Detecting Inconsistencies in JavaScript MVC Applications, 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering, p.11, 2015.
DOI : 10.1109/ICSE.2015.52

[. Offutt and R. H. Untch, Mutation testing for the new century, pp.34-44, 2000.

. Pbdp-+-14-]-f, G. Palomba, M. D. Bavota, R. Penta, D. Oliveto et al., Mining version histories for detecting code smells, Software Engineering IEEE Transactions, pp.1-4

C. R. Ana, . Paiva, C. P. João, R. F. Faria, and . Vidal, Specificationbased testing of user interfaces, Interactive Systems. Design, Specification , and Verification,volume2844ofLecture Notes in Computer Science, pp.139-153, 2003.

[. Pretschner, D. Holling, R. Eschbach, and M. Gemmar, A Generic Fault Model for Quality Assurance, Proc of MOD- ELS'13
DOI : 10.1007/978-3-642-41533-3_6

A. Pimenta, Automated Specification-Based Testing of Graphical User Interfaces, 2006.

R. Pawlak, M. Monperrus, N. Petitprez, C. Noguera, and L. Seinturier, Spoon v2: Large scale source code analysis and transformation for java, 2006.

M. Potel, MVP: Model-view-presenter the taligent programming model for c++ and java, Taligent Inc, vol.1, pp.9-9

[. Research, Extensions for defects in GUI, user documentation , build and national language support (nls) http

[. Research, Orthogonal defect classification v 5.2 for software design and code, 2015.

[. Raneburger, R. Popp, and J. Vanderdonckt, An automated layout approach for model-driven WIMP-UI generation, Proceedings of the 4th ACM SIGCHI symposium on Engineering interactive computing systems, EICS '12, pp.91-100, 2012.
DOI : 10.1145/2305484.2305501

D. Romano, S. Raemaekers, and M. Pinzger, Refactoring Fat Interfaces Using a Genetic Algorithm, 2014 IEEE International Conference on Software Maintenance and Evolution, pp.351-360, 2014.
DOI : 10.1109/ICSME.2014.57

[. Ricca and P. Tonella, Web Testing: a Roadmap for the Empirical Research, Seventh IEEE International Symposium on Web Site Evolution, pp.63-70, 2005.
DOI : 10.1109/WSE.2005.23

L. José, J. Silva, A. C. Creissac-campos, . C. Paivascss14-]-j, J. C. Silva et al., Model-based user interface testing with spec explorer and ConcurTaskTrees An approach for graphical user interface external bad smells detection, New Perspectives in Information Systems and Technologies of Advances in Intel ligent Systems and Computing, pp.0-8

J. David and . Sheskin, Handbook Of Parametric And Nonparametric Statistical Procedures, Fourth Edition, 2007.

[. Shneiderman, Direct Manipulation: A Step Beyond Programming Languages, Computer, vol.16, issue.8, pp.5-7
DOI : 10.1109/MC.1983.1654471

M. Skbd14-]-dilan-sahin, S. Kessentini, K. Bechikh, and . Deb, Code-smell detection as a bilevel problem, ACM Trans. Softw. Eng. Methodol, vol.246, issue.1, pp.1-6, 2014.

R. Seyed, W. Shahamiri, S. Mohd-nasir-wan-kadir, S. Ibrahim, and . Hashim, An automated framework for software test oracle. Information and Software Technology

J. Strecker and A. Memon, Relationships between Test Suites, Faults, and Fault Detection in GUI Testing, 2008 International Conference on Software Testing, Verification, and Validation, pp.12-21, 2008.
DOI : 10.1109/ICST.2008.26

[. Smith, WPF apps with the model-view-viewmodel design pattern, 2009.

J. Silva, C. E. Silva, R. Gonçalo, J. A. Saraiva, and J. Campos, The GUISurfer tool, Proceedings of the 2nd ACM SIGCHI symposium on Engineering interactive computing systems, EICS '10, pp.181-186, 2010.
DOI : 10.1145/1822018.1822045

]. S. Sta07 and . Staiger, Static analysis of programs with graphical user interface, Software Maintenance and Reengineering CSMR '07. 11th European Conference on, pp.252-264, 2007.

I. K. Dag, A. Sjoberg, . Yamashita, C. D. Bente, A. Anda et al., Quantifying the effect of code smells on maintenance effort, IEEE Transactions on Software Engineering, vol.3, issue.8, p.9

T. Takala, M. Katara, and J. Harty, Experiences of systemlevel model-based GUI testing of an android application, Software Testing, Verification and Validation (ICST), 2011 IEEE Sixth International Conference on, pp.377-386, 2011.

A. Gregor-von-bochmann, R. Das, M. Dssouli, A. Dubuc, G. Ghedamsi et al., Fault models in testing [vD97] Andries van Dam. Post-WIMP user interfaces, Protocol Test Systems, pp.17-3063, 1991.

[. Vallespir, F. Grazioli, and J. Herbert, A framework to evaluate defect taxonomies, Proceeding of the 15th Argentine Congress on Computer Sciences, pp.643-652, 2009.

[. Weißleder, Test models and coverage criteria for automatic model-based test generation with UML state machines, 2010.

X. Yang, Graphic User Interface Modelling and Testing Automation, 2011.

[. Yuan, M. B. Cohen, and A. M. Memon, GUI interaction testing: Incorporating event context. Software Engineering, IEEE Transactions, vol.7, issue.4

W. Yang, . Mukulr, T. Prasad, and . Xie, A Grey-Box Approach for Automated GUI-Model Generation of Mobile Applications, Fundamental Approaches to Software Engineering,v o l u m e7 7 9 3o fLecture Notes in Computer Science, pp.250-265, 2013.
DOI : 10.1007/978-3-642-37057-1_19

M. Zanoni, F. A. Fontana, and F. Stella, On applying machine learning techniques for design pattern detection, Journal of Systems and Software, vol.103
DOI : 10.1016/j.jss.2015.01.037

[. Zhu, P. A. Hall, and J. H. May, Software unit test coverage and adequacy, ACM Computing Surveys, vol.29, issue.4, pp.366-427, 1997.
DOI : 10.1145/267580.267590

S. Zhang, H. Lü, and M. D. Ernst, Finding errors in multithreaded GUI applications, Proceedings of the 2012 International Symposium on Software Testing and Analysis, ISSTA 2012, pp.243-253, 2012.
DOI : 10.1145/2338965.2336782

S. Zhang, H. Lü, and M. D. Ernst, Automatically repairing broken workflows for evolving GUI applications, Proceedings of the 2013 International Symposium on Software Testing and Analysis, ISSTA 2013, pp.45-55, 2013.
DOI : 10.1145/2483760.2483775

[. Zaeem, M. R. Prasad, and S. Khurshid, Automated Generation of Oracles for Testing User-Interaction Features of Mobile Apps, 2014 IEEE Seventh International Conference on Software Testing, Verification and Validation
DOI : 10.1109/ICST.2014.31