S.O.B (Save Our Budget) - A Simulation-Based Method for Prediction of Acquisition Costs of Constituents of aSystem-of-Systems

Authors

  • Valdemar Vicente Graciano Neto Universidade Federal de Goiás
  • Flávio Eduardo Aoki Horita Universidade Federal do ABC
  • Rodrigo Santos Universidade Federal do Estado do Rio de Janeiro
  • Davi Viana Universidade Federal do Maranhão
  • Mohamad Kassab Pennsylvania State University
  • Wallace Manzano Universidade de São Paulo
  • Elisa Yumi Nakagawa Universidade de São Paulo

Keywords:

Acquisition, Cost, Prediction, Architecture, System-of-Systems, Evaluation, Quality Attribute

Abstract

Software economics, acquisition, and pricing are important concerns for Systems-of-Systems (SoS). SoS are alliances of independent software-intensive systems combined to offer holistic functionalities as a result of the constituents interoperability. SoS engineering involves separately acquiring constituents and combining them to form the SoS. Despite the existence of cost prediction techniques, predicting SoS acquisition costs at design-time should also include the analysis of different suppliers of constituents, their respective prices and quality. However, known methods cover only two out of these three parameters.  The main contribution of this article is to present the S.O.B. (Save Our Budget) method, a novel simulation-based method to predict, at design-time, the acquisition cost of constituents, while still considering quality attributes and different suppliers. Results of a case study in the Smart Building domain revealed that S.O.B. method supports a precise prediction of acquisition cost of constituents to build a SoS for that domain. Furthermore, it also contributes to estimate the cost based on a pre-established quality attribute (functional suitability), as well as to support the selection of coalition that exhibits better results through the analysis of cost-benefit ratio.

Downloads

Download data is not yet available.

Author Biographies

Valdemar Vicente Graciano Neto, Universidade Federal de Goiás

Coordenador da Comissão Especial de Sistemas de Informação (CESI) da Sociedade Brasileira de Computação (SBC) entre 2018 e 2019. Professor Adjunto do Instituto de Informática da Universidade Federal de Goiás.

Flávio Eduardo Aoki Horita, Universidade Federal do ABC

Professor Adjunto A no Centro de Matemática, Computação e Cognição (CMCC) da Universidade Federal do ABC (UFABC) em Santo André/SP, Brasil. Doutor em Ciência da Computação e Matemática Computacional pelo Instituto de Computação e Matemática Computacional (ICMC) da Universidade de São Paulo (USP/São Carlos) tendo realizado estágio-sanduíche no Departamento de Sistemas de Informação e Supply Chain Management (Prof.-Ing. Bernd Hellingrath) do European Research Center for Information Systems (ERCIS) na Universidade de Münster em Münster na Alemanha. 

Rodrigo Santos, Universidade Federal do Estado do Rio de Janeiro

Professor Adjunto do Departamento de Informática Aplicada (DIA) e membro efetivo do Programa de Pós-Graduação em Informática (PPGI) da Universidade Federal do Estado do Rio de Janeiro (UNIRIO). Doutor (2016) e Mestre (2010) em Engenharia de Sistemas e Computação pela COPPE/UFRJ, onde realizou também o seu Pós-doutorado pelo CNPq em 2016, e Bacharel (2007) em Ciência da Computação pela UFLA.

Davi Viana, Universidade Federal do Maranhão

Atualmente é Professor Adjunto A da Universidade Federal do Maranhão. Doutor e Mestre em Informática pelo Programa de Pós-Graduação em Informática da Universidade Federal do Amazonas (UFAM). Graduado em Ciência da Computação pela UFAM. Possui curso técnico em informática pela Fundação Nokia de Ensino. Além disso, é docente permanente do Programa de Pós-Graduação em Ciência da Computação (PPGCC) da UFMA. Tem interesse nas áreas de qualidade de software, melhoria processo de software (MPS), implementação de programas de MPS com ênfase na adoção de modelos de maturidade, Engenharia de Software Experimental e Sistemas de Informação.

Mohamad Kassab, Pennsylvania State University


Mohamad Kassab é professor associado de pesquisa de engenharia de software, recebeu seu Ph.D. e M.S. graduados em ciência da computação pela Concordia University em Montreal, Canadá. Ele possui um B.S. em ciência da computação pela Universidade de Windsor no Canadá e B.Eng. em engenharia da computação da Universidade Americana do Líbano. Foi professor assistente adjunto no departamento de ciência da computação e engenharia de software da Universidade Concordia e pesquisador de pós-doutorado em engenharia de software na Université du Quebec.

Wallace Manzano, Universidade de São Paulo

Bacharelando em Sistemas de Informação pelo Instituto de Ciências Matemáticas e Computação (ICMC-USP). Tem interece na área de Arquitetura de Software e Engenharia de Software.

Elisa Yumi Nakagawa, Universidade de São Paulo

É professora associada do Departamento de Sistemas de Computação do Instituto de Ciências Matemáticas e de Computação da Universidade de São Paulo (ICMC/USP). Atua no Programa de Pós-Graduação em Ciências de Computação e Matemática Computacional do ICMC/USP (Nível 7 da Capes) como orientadora de alunos de mestrado e doutorado e como responsável ministrando disciplinas de pós-graduação. Também é co-orientadora no PhD-Program of Computer Science e do Regular Master in Computer Science da Universidade de Kaiserslautern, Alemanha, e do Groningen Graduate School of Science da Universidade de Groningen, Holanda.

References

Acker, D. D. (1983). Defense systems acquisition review process: A history and evalua-tion. Technical report, Defense Systems Management Coll Fort Belvoir Va.

Agner, L. T. W., Soares, I. W., Stadzisz, P. C., and Sim ?ao, J. M. (2013). A BrazilianSurvey on UML and Model-driven Practices for Embedded Software Development.J.Syst. Software, 86(4):997-1005.

Akintoye, A. and Fitzgerald, E. (2000). A survey of current cost estimating practices inthe uk.Construction Management & Economics, 18(2):161-172.

Amorim, S. S., McGregor, J. D., de Almeida, E. S., and von Flach G. Chavez, C. (2017).The architect's role in software ecosystems health. InWASHES, pages 1-4.

Asiedu, Y. and Besant, R. (2000). Simulation-based cost estimation under economicuncertainty using kernel estimators. International Journal of Production Research,38(9):2023-2035.

Axelsson, J. (2018). An initial analysis of operational emergent properties in a platooningsystem-of-systems. In2018 Annual IEEE International Systems Conference (SysCon),pages 1-8.

Basili, V., Caldiera, G., and Rombach, H. D. (1992). Software modeling and measure-ment: the goal/question/metric paradigm. Technical Report CS-TR-2956, UMIACS-TR-92-96, University of Maryland, College Park, Maryland, USA.

Bass, L., Clements, P., and Kazman, R. (2012).Software Architecture in Practice.Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA.

Boehm, B., Abts, C., and Chulani, S. (2000). Software development cost estimationapproaches-a survey.Annals of software engineering, 10(1-4):177-205.

Burton, F. R., Paige, R. F., Poulding, S., and Smith, S. (2014). System of systems acqui-sition trade-offs.Procedia Computer Science, 28:11-18.

Burton et al. (2012). Solving acquisition problems using model-driven engineering. InECMFA, volume 7349, pages 428-443, Lyngby, Denmark. Springer.

Cavalcante, E., Batista, T. V., and Oquendo, F. (2015). Supporting dynamic software ar-chitectures: From architectural description to implementation. InWICSA 2015, pages31-40, Montreal, Canada. IEEE.

de Oliveira Neves, V., Bertolino, A., Angelis, G. D., and Garces, L. (2018). Do we neednew strategies for testing systems-of-systems? In6th IEEE/ACM International Work-shop on Software Engineering for Systems-of-Systems, SESoS@ICSE 2018, Gothen-burg, Sweden, May 29, 2018, pages 29-32.

Gassara, A., Bouassida, I., and Jmaiel, M. (2017). A tool for modeling sos architecturesusing bigraphs. In32nd Symposium on Applied Computing (SAC 2017), pages 1787-1792, Marrakech, Morocco. ACM.

Graciano Neto, V. V., Guessi, M., Oliveira, L. B. R., Oquendo, F., and Nakagawa, E. Y.(2014). Investigating the model-driven development for systems-of-systems. In Proceedings of the 2014 European Conference on Software Architecture Workshops, EC-SAW '14, pages 22:1-22:8, Vienna, Austria. ACM.

Graciano Neto, V. V., Horita, F. E. A., Santos, R. P., Viana, D., and Kassab, M. (2018a).How much does it cost? a simulation-based method for cost prediction in systems-of-systems acquisition processes. In WASHES, pages 1-10, Natal, Brazil.

Graciano Neto, V. V., Manzano, W., Kassab, M., and Nakagawa, E. Y. (2018b). Model-based engineering & simulation of software-intensive systems-of-systems: experiencereport and lessons learned. InProceedings of the 12th European Conference on Soft-ware Architecture: Companion Proceedings, ECSA 2018, Madrid, Spain, September24-28, 2018, pages 27:1-27:7.

Graciano Neto, V. V., Oquendo, F., and Nakagawa, E. Y. (2017a).Smart Systems-of-Information Systems: Foundations and an Assessment Model for Research Develop-ment, pages 1-12. Brazilian Computer Society, Porto Alegre, Brazil.

Graciano Neto, V. V., Paes, C. E., Garc ?es, L., Guessi, M., Oquendo, F., and Nakagawa,E. Y. (2017b). Stimuli-SoS: A model-based approach to derive stimuli generators insimulations of software architectures of systems-of-systems.

Graciano Neto, V. V., Rodriguez, L. M. G., Guessi, M., Paes, C., Manzano, W., Oquendo,F., and Nakagawa, E. Y. (2018c). ASAS: an approach to support simulation of smartsystems. In51st Hawaii International Conference on System Sciences - HICSS 2018,pages 5777-5786, Hilton Waikoloa Village, Hawaii, USA. IEEE.

Gregor, S. and Hevner, A. R. (2013). Positioning and presenting design science researchfor maximum impact.MIS quarterly, pages 337-355.

Hachem, J. E., Pang, Z. Y., Chiprianov, V., Babar, A., and Aniort ?e, P. (2016). Modeldriven software security architecture of systems-of-systems. In23rd Asia-Pacific Soft-ware Engineering Conference, pages 89-96, Hamilton, New Zealand. IEEE.ISO (2011). Iso/iec/ieee systems and software engineering - architecture description.

ISO/IEC/IEEE 42010:2011(E) (Revision of ISO/IEC 42010:2007 and IEEE Std 1471-2000), pages 1-46.ISO/IEC (2011).

ISO/IEC 25010 - Systems and software engineering - Systems and soft-ware Quality Requirements and Evaluation (SQuaRE) - System and software qualitymodels. Technical report.

Johnson, S. B. (2015). System health management. In Rainey, L. B. and Tolk, A., editors,Modeling and Simulation Support for System of Systems Engineering Applications,pages 131-144. Wiley, Hoboken, New Jersey, USA.

Lowe, P. N. and Chen, M. W. (2008). System of systems complexity: Modeling andsimulation issues. InProceedings of the 2008 Summer Computer Simulation Confer-ence, SCSC '08, pages 36:1-36:10, Vista, CA. Society for Modeling & SimulationInternational.

Maier, M. W. (1998). Architecting principles for systems-of-systems.Systems Engineer-ing, 1(4):267-284.

Manzano, W., Graciano Neto, V. V., and Nakagawa, E. Y. (2018). Dynamic-SoS: An ap-proach for the simulation of system-of-systems dynamic architectures.The ComputerJournal, X:1-23. Accepted for Publication.

Moløkken-Østvold, K., Jørgensen, M., Tanilkan, S. S., Gallis, H., Lien, A. C., and Hove,S. (2004). A survey on software estimation in the norwegian industry. In10th Inter-national Symposium on Software Metrics, 2004. Proceedings., pages 208-219. IEEE.

Neto, A. A. and Conte, T. (2013). A conceptual model to address threats to validityin controlled experiments. InProceedings of the 17th International Conference onEvaluation and Assessment in Software Engineering, EASE '13, pages 82-85, Portode Galinhas, Brazil. ACM.

Neto, V. V. G., Horita, F. E. A., Cavalcante, E., Rohling, A. J., Hachem, J. E., Santos,D. S., and Nakagawa, E. Y. (2018). A study on goals specification for systems-of-information systems: Design principles and a conceptual model. InProceedings of theXIV Brazilian Symposium on Information Systems, SBSI 2018, Caxias do Sul, Brazil,June 04-08, 2018, pages 21:1-21:8.

Nielsen, C. B., Larsen, P. G., Fitzgerald, J., Woodcock, J., and Peleska, J. (2015). Systemsof Systems Engineering: Basic Concepts, Model-Based Techniques, and Research Di-rections.ACM Comput. Surv., 48(2):18:1-18:41.

Olagbemiro, A., Shing, M.-T., and Mun, J. (2009). Application of real options theory tosoftware-intensive system acquisitions. Technical report, NAVAL POSTGRADUATESCHOOL MONTEREY CA DEPT OF COMPUTER SCIENCE.

Oquendo, F. (2016). Formally Describing the Software Architecture of Systems-of-Systems with SosADL. In11th Annual System of Systems Engineering (SOSE 2016),pages 1-6, Kongsberg, Norway. IEEE.

Ricci, N., Rhodes, D. H., Ross, A. M., and Fitzgerald, M. E. (2013). Considering alterna-tive strategies for value sustainment in systems-of-systems. In2013 IEEE InternationalSystems Conference (SysCon), pages 725-730.

Robbins, W., Lam, S., and Lalancette, C. (2005). Towards a collaborative engineeringenvironment to support capability engineering. InProceedings of the 2005 INCOSEInternational Symposium, pages 211-221, Rochester, NY, USA.

Rodriguez, L. M. G. and Nakagawa, E. Y. (2017). A process to establish, model andvalidate missions of systems-of-systems in reference architectures. InSAC 2017, pages1765-1772, Marrakech, Morocco. ACM.

Runeson, P. and H ?ost, M. (2009). Guidelines for conducting and reporting case studyresearch in software engineering.Empirical Softw. Engg., 14(2):131-164.Seaman, C. B. (1999). Qualitative methods in empirical studies of software engineering.IEEE Transactions on software engineering, 25(4):557-572.

Sharma, N., Bajpai, A., and Litoriya, M. R. (2012). A comparison of software costestimation methods: A survey.The International Journal of Computer Science andApplications (TIJCSA), 1(3).

Silva, E., Batista, T., and Cavalcante, E. (2015). A mission-oriented tool for system-of-systems modeling. InSESoS, pages 31-36, Florence, Italy. IEEE.

Takakuwa, S. (1997). The use of simulation in activity-based costing for flexible manu-facturing systems. InWinter Simulation Conference Proceedings,, pages 793-800.

Urwin, E. N., Pilfold, S. A., and Henshaw, M. (2010). Through life capability man-agement: benefits and behaviours. InInternational Conference on Contemporary Er-gonomics and Human Factors, pages 153-162. CRC Press.

Weinreich, R. and Groher, I. (2016). The architect's role in practice: From decision makerto knowledge manager?IEEE Software, 33(6):63-69.

Wohlin, C., Runeson, P., H ?ost, M., Ohlsson, M. C., Regnell, B., and Wessl ?en, A. (2000).Experimentation in Software Engineering: An Introduction. Kluwer Academic Pub-lishers, Norwell, MA, USA.

Yang, D., Wang, Q., Li, M., Yang, Y., Ye, K., and Du, J. (2008). A survey on software costestimation in the chinese software industry. InProceedings of the Second ACM-IEEE nternational symposium on Empirical software engineering and measurement, pages253-262. ACM.Yang, I.-T. (2005). Simulation-based estimation for correlated cost elements.Interna-tional Journal of Project Management, 23(4):275 - 282.

Yin, R. K. (2017).Case study research and applications: Design and methods. Sagepublications.

Zeigler, B. P., Mittal, S., and Traore, M. K. (2018). Mbse with/out simulation: State ofthe art and way forward.Systems, 6(4).

Zeigler, B. P., Sarjoughian, H. S., Duboz, R., and Souli, J.-C. (2012).Guide to Modelingand Simulation of Systems of Systems. Springer, Berlim, Germany.

Downloads

Published

2019-10-22

How to Cite

Graciano Neto, V. V., Horita, F. E. A., Santos, R., Viana, D., Kassab, M., Manzano, W., & Nakagawa, E. Y. (2019). S.O.B (Save Our Budget) - A Simulation-Based Method for Prediction of Acquisition Costs of Constituents of aSystem-of-Systems. ISys - Brazilian Journal of Information Systems, 12(4), 6–35. Retrieved from https://seer.unirio.br/isys/article/view/8421

Issue

Vol. 12 No. 4 (2019)

Section

SPECIAL ISSUE ARTICLES

License

Autores que publicam nesta revista concordam com os seguintes termos: Autores mantém os direitos autorais e concedem à revista o direito de primeira publicação, com o trabalho simultaneamente licenciado sob a Licença Creative Commons Attribution - http://creativecommons.org/licenses/by/3.0/ que permite o compartilhamento do trabalho com reconhecimento da autoria e publicação inicial nesta revista. Autores têm autorização para assumir contratos adicionais separadamente, para distribuição não-exclusiva da versão do trabalho publicada nesta revista (ex.: publicar em repositório institucional ou como capítulo de livro), com reconhecimento de autoria e publicação inicial nesta revista. Autores têm permissão e são estimulados a publicar e distribuir seu trabalho online (ex.: em repositórios institucionais ou na sua página pessoal) a qualquer ponto antes ou durante o processo editorial, já que isso pode gerar alterações produtivas, bem como aumentar o impacto e a citação do trabalho publicado (acrescentando nesta distribuição a citação completa ao artigo na iSys).