微信服务号

微信订阅号

2025年6月1日 7:50 星期日
首页 > 过刊浏览>2020年第31卷第8期 >2404-2431. DOI:10.13328/j.cnki.jos.006076
PDF HTML阅读 XML下载 导出引用 引用提醒
机器学习赋能的软件自适应性综述
作者:
作者简介:

张明悦(1994-),男,博士生,主要研究领域为自适应软件,强化学习;赵海燕(1966-),女,博士,副教授,CCF高级会员,主要研究领域为需求工程,软件复用,程序语言;金芝(1962-),女,博士,教授,博士生导师,CCF会士,主要研究领域为需求工程,知识工程;罗懿行(1996-),女,博士生,CCF学生会员,主要研究领域为自适应软件,需求工程,无人自主软件系统可靠性.

通讯作者:

金芝,E-mail:zhijin@pku.edu.cn

基金项目:

国家自然科学基金（61620106007，61751210）


Survey of Machine Learning Enabled Software Self-adaptation
Author:
Fund Project:

National Natural Science Foundation of China (61620106007, 61751210)

  • 摘要
    • | |
  • 访问统计
    • |
  • 参考文献 [126]
    • |
  • 相似文献 [20]
    • | | |
  • 文章评论
    摘要:

    软件系统自适应提供了应对动态变化的环境和不确定的需求的技术方案.在已有的软件系统自适应性的相关研究中，有一类工作将软件系统自适应性转换为回归、分类、聚类、决策等问题，并利用强化学习、神经网络/深度学习、贝叶斯决策理论和概率图模型、规则学习等机器学习算法进行问题建模与求解，并以此构造软件系统自适应机制.将其称为机器学习赋能的软件自适应性.通过系统化的文献调研，综述了该研究方向的前沿工作：首先介绍基本概念，然后分别从机器学习、软件自适应的视角对当前工作进行分类；按机器学习算法、软件对外交互、软件对内控制、自适应过程、自适应任务和学习能力的对应关系等方面进行分析；最后对未来的研究进行展望.

    Abstract:

    Software self-adaptation (SSA) provides a way of dealing with dynamic environment and uncertain requirement. There are existing works that transform the dynamic and uncertainty concerned by SSA into regression, classification, cluster, or decision problems; and apply machine learning algorithms, including reinforcement learning, neural network/deep learning, Bayesian decision theory and probabilistic graphical model, rule learning, to problem formulation and solving. These kinds of work are called as “machine learning enabled SSA” in this study. The survey is conducted on the state-of-the-art research about machine learning enabled SSA by firstly explaining the related concepts of SSA and machine learning; and then proposing a taxonomy based on current work from SSA perspective and machine learning perspective respectively; analyzing the machine learning algorithms, software external interaction, software internal control, adaptation process, the relationship between SSA task and learning ability under this taxonomy; as well as identifying finally deficiency of current work and highlighting future research trends.

    参考文献
    [1] De Lemos R, Giese H, Müller HA, et al. Software engineering for self-adaptive systems:A second research roadmap. In:Proc. of the Software Engineering for Self-adaptive Systems II. Berlin, Heidelberg:Springer-Verlag, 2013. 1-32.
    [2] Yang QL, Ma XX, Xing JC, et al. Software self-adaptation:Control theory based approach. Chinese Journal of Computers, 2016, 39(11):2189-2215(in Chinese with English abstract).
    [3] Patikirikorala T, Colman A, Han J, et al. A systematic survey on the design of self-adaptive software systems using control engineering approaches. In:Proc. of the 7th Int'l Symp. on Software Engineering for Adaptive and Self-managing Systems. IEEE, 2012. 33-42.
    [4] Salehie M, Tahvildari L. Self-adaptive software:Landscape and research challenges. ACM Trans. on Autonomous and Adaptive Systems, 2009,4(2):Article No.14.
    [5] Shen J, Wang Q, Mei H. Self-adaptive software:Cybernetic perspective and an application server supported framework. In:Proc. of the Computer Software and Applications Conf. IEEE Computer Society, 2004. 92-95.
    [6] Silva Souza VE, Lapouchnian A, Robinson WN, et al. Awareness requirements for adaptive systems. In:Proc. of the 6th Int'l Symp. on Software Engineering for Adaptive and Self-managing Systems. Waikiki:ACM, 2011. 60-69.
    [7] Karlsson M, Karamanolis C, Zhu X. Triage:Performance differentiation for storage systems using adaptive control. ACM Trans. on Storage, 2005,1(4):457-480.
    [8] Hu H, Jiang CH, Cai KY. Adaptive software testing in the context of an improved controlled Markov chain model. In:Proc. of the 32nd Annual IEEE Int'l Computer Software and Applications Conf. IEEE, 2008. 853-858.
    [9] Liu X, Zhu X, Padala P, et al. Optimal multivariate control for differentiated services on a shared hosting platform. In:Proc. of the 46th IEEE Conf. on Decision and Control. IEEE, 2007. 3792-3799.
    [10] Litoiu M, Woodside M, Zheng T. Hierarchical model-based autonomic control of software systems. ACM SIGSOFT Software Engineering Notes, 2005,30(4):1-7.
    [11] Weyns D, Malek S, Andersson J. FORMS:A formal reference model for self-adaptation. In:Proc. of the 7th Int'l Conf. on Autonomic Computing. Washington:ACM, 2010. 205-214.
    [12] Zhang J, Cheng BHC. Model-based development of dynamically adaptive software. In:Proc. of the 28th Int'l Conf. on Software Engineering. Shanghai:ACM, 2006. 371-380.
    [13] Liu C, Jiang C, Hu H, et al. A control-based approach to balance services performance and security for adaptive service based systems (ASBS). In:Proc. of the 33rd Annual IEEE Int'l Computer Software and Applications Conf., Vol.2. IEEE, 2009. 473-478.
    [14] Brun Y, Serugendo GD, Gacek C, et al. Engineering self-adaptive systems through feedback loops. In:Proc. of Software Engineering for Self-adaptive Systems. Berlin, Heidelberg:Springer-Verlag, 2009. 48-70.
    [15] Kephart JO, Chess DM. The vision of autonomic computing. IEEE Computer, 2003,36(1):41-50.
    [16] Garlan D, Cheng SW, Huang AC, Schmerl B, Steenkiste P. Rainbow:Architecture-based self-adaptation with reusable infrastructure. IEEE Computer, 2004,37(10):46-54.
    [17] Müller H, Pezzè M, Shaw M. Visibility of control in adaptive systems. In:Proc. of the 2nd Int'l Workshop on Ultra-large-scale Software-intensive Systems. Leipzig:ACM, 2008. 23-26.
    [18] Elkhodary A, Esfahani N, Malek S. FUSION:A framework for engineering self-tuning self-adaptive software systems. In:Proc. of the 18th ACM SIGSOFT Int'l Symp. on Foundations of Software Engineering. Santa Fe:ACM, 2010. 7-16.
    [19] Baah GK, Gray A, Harrold MJ. On-line anomaly detection of deployed software:A statistical machine learning approach. In:Proc. of the 3rd Int'l Workshop on Software Quality Assurance. Portland:ACM, 2006. 70-77.
    [20] Rodrigues A, Caldas RD, Rodrigues GN, et al. A learning approach to enhance assurances for real-time self-adaptive systems. In:Proc. of the IEEE/ACM 13th Int'l Symp. on Software Engineering for Adaptive and Self-managing Systems (SEAMS). Gothenburg:IEEE, 2018. 206-216.
    [21] Tesauro G. Reinforcement learning in autonomic computing:A manifesto and case studies. IEEE Internet Computing, 2007,11(1):22-30.
    [22] Kim D, Park S. Reinforcement learning-based dynamic adaptation planning method for architecture-based self-managed software. In:Proc. of the ICSE Workshop on Software Engineering for Adaptive and Self-managing Systems. Vancouver:IEEE, 2009. 76-85.
    [23] Wang H, Zhou X, Zhou X, et al. Adaptive service composition based on reinforcement learning. In:Proc. of the Int'l Conf. on Service-oriented Computing. Berlin, Heidelberg:Springer-Verlag, 2010. 92-107.
    [24] Mitchell T. Machine Learning. New York:McGraw Hill, 1997.
    [25] Sutton R, Barto A. Reinforcement Learning:An Introduction. MIT Press, 1998.
    [26] Zhao T, Zhang W, Zhao H, et al. A reinforcement learning-based framework for the generation and evolution of adaptation rules. In:Proc. of the IEEE Int'l Conf. on Autonomic Computing (ICAC). Columbus:IEEE, 2017. 103-112.
    [27] Schmid S, Gerostathopoulos I, Prehofer C, et al. Self-adaptation based on big data analytics:A model problem and tool. In:Proc. of the IEEE/ACM 12th Int'l Symp. on Software Engineering for Adaptive and Self-managing Systems (SEAMS). IEEE, 2017. 102-108.
    [28] Ho HN, Lee E. Model-based reinforcement learning approach for planning in self-adaptive software system. In:Proc. of the 9th Int'l Conf. on Ubiquitous Information Management and Communication. ACM, 2015.
    [29] Tesauro G, Jong NK, Das R, et al. A hybrid reinforcement learning approach to autonomic resource allocation. In:Proc. of the IEEE Int'l Conf. on Autonomic Computing. Dublin:IEEE, 2006. 65-73.
    [30] Pandey A, Moreno GA, Cámara J, et al. Hybrid planning for decision making in self-adaptive systems. In:Proc. of the IEEE 10th Int'l Conf. on Self-adaptive and Self-organizing Systems (SASO). Augsburg:IEEE, 2016. 130-139.
    [31] Lecun Y, Bengio Y, Hinton G. Deep learning. Nature, 2015,521:436-444.
    [32] Esfahani N, Elkhodary A, Malek S. A learning-based framework for engineering feature-oriented self-adaptive software systems. IEEE Trans. on Software Engineering, 2013,39(11):1467-1493.
    [33] Porter B, Rodrigues Filho R. Losing control:The case for emergent software systems using autonomous assembly, perception, and learning. In:Proc. of the IEEE 10th Int'l Conf. on Self-adaptive and Self-organizing Systems (SASO). Augsburg:IEEE, 2016. 40-49.
    [34] Bodík P, Griffith R, Sutton CA, et al. Statistical machine learning makes automatic control practical for internet datacenters. In:Proc. of the IEEE Int'l Conf. on Cloud Computing Technology and Science. IEEE, 2009.
    [35] Tanabe M, Tei K, Fukazawa Y, et al. Learning environment model at runtime for self-adaptive systems. In:Proc. of the Symp. on Applied Computing. Marrakech:ACM, 2017. 1198-1204.
    [36] Han D, Xing J, Yang Q, et al. Handling uncertainty in self-adaptive software using self-learning fuzzy neural network. In:Proc. of the IEEE 40th Annual Computer Software and Applications Conf. (COMPSAC), Vol.2. IEEE, 2016. 540-545.
    [37] Borges RV, Garcez AA, Lamb LC, et al. Learning to adapt requirements specifications of evolving systems (NIER track). In:Proc. of the 33rd Int'l Conf. on Software Engineering. Waikiki:ACM, 2011. 856-859.
    [38] Verstaevel N, Boes J, Nigon J, et al. Lifelong machine learning with adaptive multi-agent systems. In:Proc. of the Int'l Conf. on Agents & Artificial Intelligence. 2017. 275-286.
    [39] Lama P, Zhou X. Autonomic provisioning with self-adaptive neural fuzzy control for percentile-based delay guarantee. ACM Trans. on Autonomous and Adaptive Systems (TAAS), 2013,8(2):No.9.
    [40] Lama P, Zhou X. Autonomic provisioning with self-adaptive neural fuzzy control for end-to-end delay guarantee. In:Proc. of the IEEE Int'l Symp. on Modeling, Analysis and Simulation of Computer and Telecommunication Systems. IEEE, 2010. 151-160.
    [41] Mnih V, Kavukcuoglu K, Silver D, et al. Playing atari with deep reinforcement learning. arXiv preprint arXiv:1312.5602, 2013.
    [42] Lillicrap TP, Hunt JJ, Pritzel A, et al. Continuous control with deep reinforcement learning. In:Proc. of the Int'l Conf. on Learning Representations. San Diego, 2016.
    [43] Schulman J, Levine S, Abbeel P, et al. Trust region policy optimization. In:Proc. of the Int'l Conf. on Machine Learning. Lille:JMLR, 2015. 1889-1897.
    [44] Heckerman D. A Tutorial on Learning with Bayesian Networks. Dordrecht:Springer-Verlag, 1998. 301-354.
    [45] Koller D, Friedman N. Probabilistic Graphical Models:Principles and Techniques. MIT Press, 2009.
    [46] Wang H, Wu Q, Chen X, et al. Integrating gaussian process with reinforcement learning for adaptive service composition. In:Proc. of the Int'l Conf. on Service-oriented Computing. Berlin, Heidelberg:Springer-Verlag, 2015. 203-217.
    [47] Wang H, Wu Q, Chen X, et al. Adaptive and dynamic service composition via multi-agent reinforcement learning. In:Proc. of the IEEE Int'l Conf. on Web Services. IEEE, 2014. 447-454.
    [48] Moreno GA, Cámara J, Garlan D, et al. Efficient decision-making under uncertainty for proactive self-adaptation. In:Proc. of the IEEE Int'l Conf. on Autonomic Computing (ICAC). IEEE, 2016. 147-156.
    [49] Fürnkranz J, Gamberger D, Lavrač N. Foundations of Rule Learning. Springer Science & Business Media, 2012.
    [50] Alrajeh D, Kramer J, Russo A, et al. Learning operational requirements from goal models. In:Proc. of the 31st Int'l Conf. on Software Engineering. IEEE Computer Society, 2009. 265-275.
    [51] Ray O. Using abduction for induction of normal logic programs. In:Proc. of the 2nd Workshop on AIAI and Scientific Modelling. 2006. 28-31.
    [52] Muggleton SH, Bryant CH. Theory completion using inverse entailment. In:Proc. of the Int'l Conf. on Inductive Logic Programming. Berlin, Heidelberg:Springer-Verlag, 2000. 130-146.
    [53] Esposito F, Semeraro G, Fanizzi N, Ferilli S. Multistrategy theory revision:Induction and abduction in INTHELEX. Machine Learning, 2000,38(1-2):133-156.
    [54] Pan SJ, Yang Q. A survey on transfer learning. IEEE Trans. on Knowledge and Data Engineering, 2009,22(10):1345-1359.
    [55] Jamshidi P, Velez M, Kästner C, et al. Transfer learning for improving model predictions in highly configurable software. In:Proc. of the 12th Int'l Symp. on Software Engineering for Adaptive and Self-managing Systems. Buenos Aires:IEEE, 2017. 31-41.
    [56] Jamshidi P, Siegmund N, Velez M, et al. Transfer learning for performance modeling of configurable systems:An exploratory analysis. In:Proc. of the 32nd IEEE/ACM Int'l Conf. on Automated Software Engineering. Urbana:IEEE, 2017. 497-508.
    [57] Kitchenham B. Procedures for Performing Systematic Reviews. Keele:Keele University, 2004. 1-26.
    [58] Guivarch V, Camps V, Péninou A. AMADEUS:An adaptive multi-agent system to learn a user's recurring actions in ambient systems. ADCAIJ:Advances in Distributed Computing and Artificial Intelligence Journal, 2013,1(3):1-10.
    [59] Liu Q, Sun Y, Zhang S. A scalable Web service composition based on a strategy reused reinforcement learning approach. In:Proc. of the 8th Web Information Systems and Applications Conf. IEEE, 2011. 58-62.
    [60] Nigon J, Gleizes MP, Migeon F. Self-adaptive model generation for ambient systems. In:Proc. of the 7th Int'l Conf. on Ambient Systems, Networks and Technologies (ANT). Elsevier, 2016. 675-679.
    [61] Ramirez AJ, Jensen AC, Cheng BHC. A taxonomy of uncertainty for dynamically adaptive systems. In:Proc. of the 7th Int'l Symp. on Software Engineering for Adaptive and Self-managing Systems. Zurich:IEEE, 2012. 99-108.
    [62] Gu X. IDES:Self-adaptive software with online policy evolution extended from rainbow. In:Proc. of the Computer and Information Science 2012. Berlin, Heidelberg:Springer-Verlag, 2012. 181-195.
    [63] Lobo J, Bhatia R, Naqvi S. A policy description language. In:Proc. of the National Conf. on Artificial Intelligence. AAAI, 1999. 291-298.
    [64] Fleurey F, Dehlen V, Bencomo N, et al. Modeling and validating dynamic adaptation. In:Proc. of the Int'l Conf. on Model Driven Engineering Languages and Systems. Berlin, Heidelberg:Springer-Verlag, 2008. 97-108.
    [65] Hu SS. Principles of Automatic Control. 6th ed., Beijing:Science Press, 2013(in Chinese).
    [66] Mahfoudh HB, Serugendo GDM, Boulmier A, et al. Coordination model with reinforcement learning for ensuring reliable on-demand services in collective adaptive systems. In:Proc. of the Int'l Symp. on Leveraging Applications of Formal Methods. Cham:Springer-Verlag, 2018. 257-273.
    [67] Knauss A, Damian D, Franch X, et al. ACon:A learning-based approach to deal with uncertainty in contextual requirements at runtime. Information and Software Technology, 2016,70:85-99.
    [68] Zavala E, Franch X, Marco J, et al. SACRE:Supporting contextual requirements' adaptation in modern self-adaptive systems in the presence of uncertainty at runtime. Expert Systems with Applications, 2018,98:166-188.
    [69] Paucar LHG, Bencomo N. RE-STORM:Mapping the decision-making problem and non-functional requirements trade-off to partially observable Markov decision processes. In:Proc. of the 13th Int'l Conf. on Software Engineering for Adaptive and Self-managing Systems. Gothenburg:ACM, 2018. 19-25.
    [70] Bencomo N, Belaggoun A, Issarny V. Dynamic decision networks for decision-making in self-adaptive systems:A case study. In:Proc. of the 8th Int'l Symp. on Software Engineering for Adaptive and Self-managing Systems. San Francisco:IEEE, 2013. 113-122.
    [71] Bahati RM, Bauer MA. Towards adaptive policy-based management. In:Proc. of the IEEE Network Operations and Management Symp. (NOMS). IEEE, 2010. 511-518.
    [72] Sykes D, Corapi D, Magee J, et al. Learning revised models for planning in adaptive systems. In:Proc. of the 35th Int'l Conf. on Software Engineering (ICSE). San Francisco:IEEE, 2013. 63-71.
    [73] Zhao T. The generation and evolution of adaptation rules in requirements driven self-adaptive systems. In:Proc. of the IEEE 24th Int'l Requirements Engineering Conf. (RE). Beijing:IEEE, 2016. 456-461.
    [74] Ganguly KK, Sakib K. A reusable adaptation component design for learning-based self-adaptive systems. In:Proc. of the 12th Int'l Conf. on Software Engineering Advances (ICSEA). Tahiti:IEEE, 2017. 244-249.
    [75] Epifani I, Ghezzi C, Mirandola R, et al. Model evolution by run-time parameter adaptation. In:Proc. of the 31st Int'l Conf. on Software Engineering. Vancouver:IEEE Computer Society, 2009. 111-121.
    [76] Braberman V, D'Ippolito N, Kramer J, et al. Morph:A reference architecture for configuration and behaviour self-adaptation In:Proc. of the 1st Int'l Workshop on Control Theory for Software Engineering. Bergamo:ACM, 2015. 9-16.
    [77] Ghahremani S, Adriano CM, Giese H. Training prediction models for rule-based self-adaptive systems. In:Proc. of the IEEE Int'l Conf. on Autonomic Computing (ICAC). IEEE, 2018. 187-192.
    [78] Rook A, Knauss A, Damian D, et al. A case study of applying data mining to sensor data for contextual requirements analysis. In:Proc. of the IEEE 1st Int'l Workshop on Artificial Intelligence for Requirements Engineering (AIRE). Karlskrona:IEEE, 2014. 43-50.
    [79] Huber N, Walter J, Bähr M, et al. Model-based autonomic and performance-aware system adaptation in heterogeneous resource environments:A case study. In:Proc. of the Int'l Conf. on Cloud and Autonomic Computing. IEEE, 2015. 181-191.
    [80] Filieri A, Grunske L, Leva A. Lightweight adaptive filtering for efficient learning and updating of probabilistic models. In:Proc. of the 37th Int'l Conf. on Software Engineering. Florence:IEEE, 2015. 200-211.
    [81] Jamshidi P, Sharifloo A, Pahl C, et al. Fuzzy self-learning controllers for elasticity management in dynamic cloud architectures. In:Proc. of the 12th Int'l ACM SIGSOFT Conf. on Quality of Software Architectures (QoSA). IEEE, 2016. 70-79.
    [82] Magableh B. A deep recurrent Q network towards self-adapting distributed microservices architecture. arXiv preprint arXiv:1901. 04011, 2019.
    [83] Jamshidi P, Sharifloo AM, Pahl C, et al. Self-learning cloud controllers:Fuzzy q-learning for knowledge evolution. In:Proc. of the Int'l Conf. on Cloud and Autonomic Computing. IEEE, 2015. 208-211.
    [84] Sutton RS. Temporal credit assignment in reinforcement learning[Ph.D. Thesis]. Amherst:University of Massachusetts, 1984.
    [85] Canavera KR, Esfahani N, Malek S. Mining the execution history of a software system to infer the best time for its adaptation. In:Proc. of the ACM SIGSOFT 20th Int'l Symp. on the Foundations of Software Engineering. Cary:ACM, 2012.
    [86] Sharifloo AM, Metzger A. Mcaas:Model checking in the cloud for assurances of adaptive systems. In:Proc. of the Software Engineering for Self-adaptive Systems III. Cham:Springer-Verlag, 2017. 137-153.
    [87] Bowling M, Veloso M. Multiagent learning using a variable learning rate. Artificial Intelligence, 2002,136(2):215-250.
    [88] Wang H, Chen X, Wu Q, et al. Integrating on-policy reinforcement learning with multi-agent techniques for adaptive service composition. In:Proc. of the Int'l Conf. on Service-oriented Computing. Berlin, Heidelberg:Springer-Verlag, 2014. 154-168.
    [89] Braberman V, D'Ippolito N, Kramer J, et al. An extended description of MORPH:A reference architecture for configuration and behaviour self-adaptation. In:Proc. of the Software Engineering for Self-adaptive Systems III. Cham:Springer-Verlag, 2017. 377-408.
    [90] Rodrigues A, Rodrigues GN, Knauss A, et al. Enhancing context specifications for dependable adaptive systems:A data mining approach. Information and Software Technology, 2019,112:115-131.
    [91] Shoham Y, Leyton-Brown K. Multiagent Systems:Algorithmic, Game-theoretic, and Logical Foundations. London:Cambridge University Press, 2008.
    [92] Baresi L, Pasquale L. Adaptive goals for self-adaptive service compositions. In:Proc. of the IEEE Int'l Conf. on Web Services. IEEE, 2010. 353-360.
    [93] Bencomo N, Belaggoun A. Supporting decision-making for self-adaptive systems:From goal models to dynamic decision networks. In:Proc. of the Int'l Working Conf. on Requirements Engineering:Foundation for Software Quality. Berlin:Springer-Verlag, 2013. 221-236.
    [94] Zhao T, Zan T, Zhao H, et al. Integrating goal model into rule-based adaptation. In:Proc. of the 23rd Asia-Pacific Software Engineering Conf. (APSEC). IEEE, 2016. 289-296.
    [95] Berral JL, Gavalda R, Torres J. Adaptive scheduling on power-aware managed data-centers using machine learning. In:Proc. of the 2011 IEEE/ACM 12th Int'l Conf. on Grid Computing. IEEE Computer Society, 2011. 66-73.
    [96] Ding Z, Zhou Y, Zhou MC. Modeling self-adaptive software systems with learning Petri nets. IEEE Trans. on Systems, Man, and Cybernetics:Systems, 2015,46(4):483-498.
    [97] Moustafa A, Zhang M. Multi-objective service composition using reinforcement learning. In:Proc. of the Int'l Conf. on Service-oriented Computing. Berlin, Heidelberg:Springer-Verlag, 2013. 298-312.
    [98] Richert W, Kleinjohann B. Adaptivity at every layer:A modular approach for evolving societies of learning autonomous systems. In:Proc. of the ICSE Workshop on Software Engineering for Adaptive and Self-managing Systems (SEAMS). ACM, 2008. 113-120.
    [99] Rudolph S, Tomforde S, Sick B, Hähner J. A mutual influence detection algorithm for systems with local performance measurement. In:Proc. of the IEEE 9th Int'l Conf. on Self-adaptive and Self-organizing Systems. IEEE, 2015. 144-149.
    [100] Petruzzi PE, Pitt J, Busquets D. Inter-institutional social capital for self-organising ‘nested enterprises’. In:Proc. of the 10th IEEE Int'l Conf. on Self-adaptive and Self-organizing Systems (SASO). Augsburg:IEEE, 2016. 90-99.
    [101] D'Angelo M, Gerasimou S, Ghahremani S, Grohmann J, Nunes I, Pournaras E, Tomforde S. On learning in collective self-adaptive systems:State of practice and a 3D framework. In:Proc. of the IEEE/ACM 14th Int'l Symp. on Software Engineering for Adaptive and Self-managing Systems (SEAMS). Montreal:IEEE, 2019. 13-24.
    [102] Cecchet E, Marguerite J, Zwaenepoel W, et al. Performance and scalability of EJB applications. In:Proc. of 17th Conf. on Object-Oriented Programming, Systems, Languages, and Applications (OOPSLA). ACM, 2002. 246-261.
    [103] Chen T, Bahsoon R. Self-adaptive and online QoS modeling for cloud-based software services. IEEE Trans. on Software Engineering, 2016,43(5):453-475.
    [104] Kitano H, Asada M, Kuniyoshi Y, et al. RoboCup:A challenge problem for AI and robotics. In:Proc. of the Robot Soccer World Cup. 1998. 1-19.
    [105] Quigley M, Gerkey B, Conley K, et al. ROS:An open-source robot operating system. In:Proc. of the Int'l Conf. on Robotics and Automation Workshop Open Source Software. 2009. 1-6.
    [106] Klös V, Göthel T, Glesner S. Comprehensible and dependable self-learning self-adaptive systems. Journal of Systems Architecture, 2018,85:28-42.
    [107] Ismail A, Cardellini V. Decentralized planning for self-adaptation in multi-cloud environment. In:Proc. of the European Conf. on Service-oriented and Cloud Computing. Cham:Springer-Verlag, 2014. 76-90.
    [108] Amoui M, Salehie M, Mirarab S, et al. Adaptive action selection in autonomic software using reinforcement learning. In:Proc. of the 4th Int'l Conf. on Autonomic and Autonomous Systems (ICAS). IEEE, 2008. 175-181.
    [109] Calinescu R, Rafiq Y, Johnson K, et al. Adaptive model learning for continual verification of non-functional properties. In:Proc. of the 5th ACM/SPEC Int'l Conf. on Performance Engineering. New York:ACM, 2014. 87-98.
    [110] Yan Y, Zhang B, Guo J. An adaptive decision making approach based on reinforcement learning for self-managed cloud applications. In:Proc. of the IEEE Int'l Conf. on Web Services (ICWS). IEEE, 2016. 720-723.
    [111] Dowling J, Cahill V. Self-managed decentralised systems using K-components and collaborative reinforcement learning. In:Proc. of the 1st ACM SIGSOFT Workshop on Self-managed Systems. Newport Beach:ACM, 2004. 39-43.
    [112] Porter B, Grieves M, Rodrigues Filho R, et al. REX:A development platform and online learning approach for runtime emergent software systems. In:Proc. of the 12th USENIX Symp. on Operating Systems Design and Implementation (OSDI). USENIX, 2016. 333-348.
    [113] Bahati RM, Bauer MA. Reinforcement learning in policy-driven autonomic management. In:Proc. of the IEEE Network Operations and Management Symp. (NOMS). IEEE, 2008. 899-902.
    [114] Tesauro G. Online resource allocation using decompositional reinforcement learning. In:Proc. of the AAAI Conf. on Artificial Intelligence (AAAI), Vol.5. AAAI, 2005. 886-891.
    [115] Boes J, Migeon F, Glize P, et al. Model-free optimization of an engine control unit thanks to self-adaptive multi-agent systems. In:Proc. of the Enbedded Real Time Software and Systems. 2014.
    [116] Boes J, Nigon J, Verstaevel N, et al. The self-adaptive context learning pattern:Overview and proposal. In:Proc. of the Int'l and Interdisciplinary Conf. on Modeling and Using Context. Cham:Springer-Verlag, 2015. 91-104.
    [117] Dezfuli ZT, Nazemi E, Ziari M. An algorithm for online planning to improve availability and performance of self-adaptive websites. In:Proc. of the 5th Iranian Joint Congress on Fuzzy and Intelligent Systems (CFIS). IEEE, 2017. 213-218.
    [118] Klös V, Göthel T, Glesner S. Be prepared:Learning environment profiles for proactive rule-based production planning. In:Proc. of the 44th Euromicro Conf. on Software Engineering and Advanced Applications (SEAA). IEEE, 2018. 89-96.
    [119] Rao J, Bu X, Xu CZ, et al. A distributed self-learning approach for elastic provisioning of virtualized cloud resources. In:Proc. of the 19th Annual Int'l Symp. on Modelling, Analysis, and Simulation of Computer and Telecommunication Systems. IEEE, 2011. 45-54.
    [120] Gil R. Automated planning for self-adaptive systems. In:Proc. of the IEEE/ACM 37th IEEE Int'l Conf. on Software Engineering (ICSE). ACM, 2015. 839-842.
    [121] Krupitzer C, Pfannemüller M, Kaddour J, et al. SATISFy:Towards a self-learning analyzer for time series forecasting in self-improving systems. In:Proc. of the IEEE 3rd Int'l Workshops on Foundations and Applications of Self* Systems (FAS* W). IEEE, 2018. 182-189.
    [122] Leitner P, Hummer W, Dustdar S. Cost-based optimization of service compositions. IEEE Trans. on Services Computing, 2011, 6(2):239-251.
    [123] Barrett E, Howley E, Duggan J. Applying reinforcement learning towards automating resource allocation and application scalability in the cloud. Concurrency and Computation:Practice and Experience, 2013,25(12):1656-1674.
    附中文参考文献:
    [2] 杨启亮,马晓星,邢建春,胡昊,王平,韩德帅.软件自适应:基于控制理论的方法.计算机学报,2016,39(11):2189-2215.
    [65] 胡寿松.自动控制原理.第6版,北京:科学出版社,2013.
    引证文献
    网友评论
    网友评论
    分享到微博
    发 布
引用本文

张明悦,金芝,赵海燕,罗懿行.机器学习赋能的软件自适应性综述.软件学报,2020,31(8):2404-2431

复制
分享
文章指标
  • 点击次数:4361
  • 下载次数: 8677
  • HTML阅读次数: 6909
  • 引用次数: 0
历史
  • 收稿日期:2019-10-15
  • 最后修改日期:2020-04-04
  • 在线发布日期: 2020-05-26
  • 出版日期: 2020-08-06
文章二维码
友情链接:中国科学院软件研究所中国计算机学会中国科学院国家自然科学基金委员会CCF数字图书馆Int'l J of Softw Info计算机系统应用
您是第19986322位访问者
版权所有：中国科学院软件研究所 京ICP备05046678号-3
地址：北京市海淀区中关村南四街4号,邮政编码：100190
电话：010-62562563 传真：010-62562533 Email：jos@iscas.ac.cn
技术支持：北京勤云科技发展有限公司

京公网安备 11040202500063号