Jatupol Pongnark, Sansiri Tanachutiwat · 2017
In this article, we evaluate existing open source Phasor Measurement Unit (PMU) and Phasor Data Concentrator (PDC) software systems and benchmark their performance and reliability with various database systems. We also evaluate usability of the PDC systems and to list additional feature for the system. Among two open source PDC software, we found that OpenPDC out performs other PDC software in terms of resource usage, performance, and reliability. And, the selection of database systems has minimal effects of the performance and resource usage of the overall system. Based on the performance limitation of the PDC software, we design a preliminary structure of the PMU-PDC network for Thailand smart grid power system.
Cited by 2
Zhili He, Wei Chen, Yuanfang Dang et al. · 2018 IEEE CSAA Guidance, Navigation and Control Conference (CGNCC) · 2018
When combining several modules into a flight control software system, it is non-trivial to determine, prior to deployment, performance and reliability values of the software system. Moreover, once the system is deployed, it is often the case that during operation it fails to meet its performance and reliability requirement and one needs to detect what has gone wrong (i. e., performance/reliability bottlenecks). To study these issues, a Semi-Markov Process (SMP) formulation is proposed in this work for the reliability and performance of flight control software systems. By explicitly including failure states into the SMP representation of a module, we can compute both its performance and reliability using a single SMP. We can also detect its performance and reliability bottlenecks by applying the formal sensitivity analysis technique. We demonstrate our approach by choosing a representative flight control software system that is validated using experiments on real flight control computer.
Cited by 0
Koç, Murat, Öztürk, Barışcan, SANGÜN, LEVENT · Erciyes University - AVESIS · 2025
Abstract The aim of this study was to investigate the reliability and validity of Kinovea, a video motion analysis software, on rapid change of direction (COD) performance in young football players. A total of 30 amateur soccer players with a mean age of 16.67 ± 0.8 years (95%IC: 16.99–16.35), mean height of 1.75 ± 0.06 meters (95%IC: 1.78–1.73), mean body mass of 66.03 ± 7,28 kg (95% IC: 68.70–63.36), mean body mass index (BMI) of 21.33 ± 1.67 (95% IC: 21.94–20.72) and mean sports age of 6.12 ± 1.70 years (95% IC: 6.75–5.50) participated in this study. COD data were obtained using the Witty gate photocell system and a simultaneous video recording system. Data were analysed using JASP Team statistical program. Pearson correlation test was applied for the relationship between two different measurement methods, while Bland-Altman analysis was applied for the agreement of the methods. High levels of correlation (r = 0.981, p <.001) and reliability (Kinovea ICC = 0.864–0.935; Witty ICC = 0.914) were found between Witty and Kinovea systems. According to Bland-Altman analysis, a small but systematic difference was observed between the two systems (bias =-0.042 s, 95% CI: - 0.071 to- 0.014), and the Witty system measured 0.73% lower times than Kinovea. These results show that Kinovea can be a valid and reliable alternative to the Witty system. Keywords: Change of Direction, Reliability-Validity, Kinovea Öz Atıcılık Bu çalışmanın amacı, genç futbolcularda hızlı yön değiştirme (COD) performansında video hareket analiz yazılımı olan Kinovea’nın güvenilirliğini ve geçerliliğini araştırmaktı. Çalışmaya yaş ortalaması 16,67 ± 0,8 yıl (95% GA: 16,99–16,35), boy ortalaması 1,75 ± 0,06 metre (95% GA: 1,78–1,73), vücut ağırlığı ortalaması 66,03 ± 7,28 kg (95% GA: 68,70–63,36), vücut kitle indeksi (VKİ) ortalaması 21,33 ± 1,67 (95% GA: 21,94–20,72) ve spor yaşı ortalaması 6,12 ± 1,70 yıl (95% GA: 6,75–5,50) olan toplam 30 amatör futbolcu katılmıştır. COD verileri, Witty kapı fotohücre sistemi ve eşzamanlı video kayıt sistemi kullanılarak elde edilmiştir. Veriler JASP Team istatistik programı ile analiz edilmiştir. İki farklı ölçüm yöntemi arasındaki ilişki için Pearson korelasyon testi, yöntemlerin uyumu için ise Bland-Altman analizi uygulanmıştır. Witty ve Kinovea sistemleri arasında yüksek düzeyde korelasyon (r = 0,981, p < .001) ve güvenilirlik (Kinovea ICC = 0,864–0,935; Witty ICC = 0,914) bulunmuştur. Bland-Altman analizine göre, iki sistem arasında küçük fakat sistematik bir fark gözlenmiş (bias = -0,042 sn, 95% GA: -0,071 ila -0,014), Witty sistemi Kinovea’dan %0,73 daha düşük süreler ölçmüştür. Bu sonuçlar, Kinovea’nın Witty sistemine geçerli ve güvenilir bir alternatif olabileceğini göstermektedir. Anahtar Kelimeler: Yön Değiştirme, Güvenilirlik-Geçerlilik, Kinovea
Cited by 0Open access
Nazanin Akhtarian, Hamzeh Khazaei, Marin Litoiu · arXiv (Cornell University) · 2024
In the ever-shifting landscape of software engineering, we recognize the need for adaptation and evolution to maintain system dependability. As each software iteration potentially introduces new challenges, from unforeseen bugs to performance anomalies, it becomes paramount to understand and address these intricacies to ensure robust system operations during the lifetime. This work proposes employing software diversity to enhance system reliability and performance simultaneously. A cornerstone of our work is the derivation of a reliability metric. This metric encapsulates the reliability and performance of each software version under adverse conditions. Using the calculated reliability score, we implemented a dynamic controller responsible for adjusting the population of each software version. The goal is to maintain a higher replica count for more reliable versions while preserving the diversity of versions as much as possible. This balance is crucial for ensuring not only the reliability but also the performance of the system against a spectrum of potential failures. In addition, we designed and implemented a diversity-aware autoscaling algorithm that maintains the reliability and performance of the system at the same time and at any scale. Our extensive experiments on realistic cloud microservice-based applications show the effectiveness of the proposed approach in this paper in promoting both reliability and performance.
Cited by 0Open access
Nazanin Akhtarian, Hamzeh Khazaei, Marin Litoiu · 2024
In the ever-shifting landscape of software engineering, continuous adaptation is essential for maintaining system dependability. Software iterations often introduce new challenges, such as unexpected bugs and performance anomalies, underscoring the importance of addressing these complexities to ensure sustained, robust operations. This work proposes employing software multi-versioning to enhance system reliability and performance simultaneously. A cornerstone of our approach is the derivation of a reliability metric, which encapsulates the reliability and performance of each software version under adverse conditions. Using this metric, a dynamic controller was designed to adjust the population of software versions, maintaining higher replica counts for more reliable versions while preserving diversity. Our diversity-aware autoscaling algorithm further optimizes system performance and reliability at any scale. Extensive experiments on realistic cloud microservice applications validate the effectiveness of our methodology.
Cited by 0
R. SCHABOWSKY, E. Gai, B. Walker et al. · Digital Avionics Systems Conference · 1984
The system concept and requirements for an Advanced Information Processing System (AIPS) are briefly described, but the emphasis of this paper is on the evaluation methodologies being developed and utilized in the AIPS program. The evaluation tasks include hardware reliability, maintainability and availability, software reliability, performance, and performability. Hardware RMA and software reliability are addressed with Markov modeling techniques. The performance analysis for AIPS is based on queueing theory. Performability is a measure of merit which combines system reliability and performance measures. The probability laws of the performance measures are obtained from the Markov reliability models. Scalar functions of this law such as the mean and variance provide measures of merit in the AIPS performability evaluations.
Cited by 4
Edward C. Soistman, Katherine B. Ragsdale · 1985
Abstract : The objective of this study was to develop techniques, for predicting total system reliability, which include the combined effects of software and hardware. Since hardware reliability techniques are much further developed, the study emphasized methods of characterizing software reliability. The software reliability prediction methodology contained in the report is compatible with hardware reliability techniques and definitions and is applicable during early development so that the predictions can influence the design and development process. The software reliability prediction techniques use both software product and development process characteristics to develop estimates of the reliability of the various software components which comprise the system. The software component reliabilities are combined via a Markov model to obtain estimates of software system reliability. Estimates of the execution frequencies of the various software components, as a function of the mission profile, are required by the methodology. Procedures for application of the techniques are provided and are intended for use by a reliability engineer having a basic knowledge of software engineering practices. The techniques offer a rudimentary framework for predicting total system reliability. Validation and refinement of the techniques using software development and field reliability performance data remains to be accomplished. (Author)
Cited by 4
Yong Guo, Peijun Ma, Xiaohong Su · Journal of Software · 2013
Internet software is an emerging software paradigm. Traditional evaluation methods for software reliability are no longer applicable because of the open and dynamic characteristics of the Internet software. In order to evaluate its reliability accurately, there must be a dynamic and open reliability evaluation approach. This paper presents the collection approach of the reliability-related data for the Internet software and its components. The paper also designs a software system for the reliability evaluation. The approach bases on the characteristics of Internet software; it uses aspect-oriented programming and pattern programming techniques to trace component real-time running data and save the data to a database. The approach can trace different granularity data according to the performance requirements of the system. The reliability evaluation system can predict the components and system reliability using the real-time data. This makes the components be selected expediently when the Internet software system is assembled dynamically. A case study is presented to illustrate the effectiveness of this approach.
Cited by 2
Edward C. Soistman, Katherine B. Ragsdale · 1985
Abstract : The objective of this study was to develop techniques, for predicting total system reliability, which include the combined effects of software and hardware. Since hardware reliability techniques are much further developed, the study emphasized methods of characterizing software reliability. The software reliability prediction methodology contained in the report is compatible with hardware reliability techniques and definitions and is applicable during early development so that the predictions can influence the design and development process. The software reliability prediction techniques use both software product and development process characteristics to develop estimates of the reliability of the various software components which comprise the system. The software component reliabilities are combined via a Markov model to obtain estimates of software system reliability. Estimates of the execution frequencies of the various software components, as a function of the mission profile, are required by the methodology. Procedures for application of the techniques are provided and are intended for use by a reliability engineer having a basic knowledge of software engineering practice. The techniques offer a rudimentary framework for predicting total system reliability. Validation and refinement of the techniques using software development and field reliability performance data remains to be accomplished. (Author)
Cited by 2
Jean Rahme, Haiping Xu · 2015
Correctly measuring the reliability and availability of a cloud-based system is critical for evaluating its system performance. Due to the promised high reliability of physical facilities provided for cloud services, software faults have become one of the major factors for the failures of cloud-based systems. In this paper, we focus on the software aging phenomenon where system performance may be progressively degraded due to exhaustion of system resources, fragmentation and accumulation of errors. We use a proactive technique, called software rejuvenation, to counteract the software aging problem. The dynamic fault tree (DFT) formalism is adopted to model the system reliability before and during a software rejuvenation process in an aging cloud-based system. A novel analytical approach is presented to derive the reliability function of a cloud-based Hot SPare (HSP) gate, which is further verified using Continuous Time Markov Chains (CTMC) for its correctness. We use a case study of a cloud-based system to illustrate the validity of our approach. Based on the reliability analytical results, we show how cost-effective software rejuvenation schedules can be created to keep the system reliability consistently staying above a predefined critical level.
Cited by 0
Dr. R. Satya Prasad, N. Geetha Rani · 2016
The past 4 decades have seen the formulation of several software reliability growth models to predict the reliability and error content of software systems. This paper presents Pareto type II model as a software reliability growth model, together with expressions for various reliability performance measures. Theory of probability, distribution function, probability distributions plays major role in software reliability model building. This paper presents estimation procedures to access reliability of a software system using Pareto distribution, which is based on
Cited by 0
Koichi Tokuno, Shigeru Yamada · Asia Pacific Journal of Operational Research · 2008
We propose the performance evaluation method for the multi-task system with software reliability growth process. The software fault-detection phenomenon in the dynamic environment is described by the Markovian software reliability model with imperfect debugging. We assume that the cumulative number of tasks arriving at the system follows the homogeneous Poisson process. Then we can formulate the distribution of the number of tasks whose processes can be complete within a prespecified processing time limit with the infinite-server queueing model. From the model, several quantities for software performance measurement considering the real-time property can be derived and given as the functions of time and the number of debuggings. Finally, we present several numerical examples of the quantities to analyze the relationship between the software reliability characteristics and the system performance measurement.
Cited by 1
George A. Reis, Jonathan Chang, Neil Vachharajani et al. · ACM Transactions on Architecture and Code Optimization · 2005
Traditional fault-tolerance techniques typically utilize resources ineffectively because they cannot adapt to the changing reliability and performance demands of a system. This paper proposes software-controlled fault tolerance, a concept allowing designers and users to tailor their performance and reliability for each situation. Several software-controllable fault-detection techniques are then presented: SWIFT, a software-only technique, and CRAFT, a suite of hybrid hardware/software techniques. Finally, the paper introduces PROFiT, a technique which adjusts the level of protection and performance at fine granularities through software control. When coupled with software-controllable techniques like SWIFT and CRAFT, PROFiT offers attractive and novel reliability options.
Cited by 160Open access
Lei Xiong, Qingping Tan · 2011
Compared with hardware-based methods, software-based methods which need not additional hardware costs are regarded as efficient methods to tolerate soft errors. Software-based methods which are implemented by software protection have performance sacrifice. This paper proposes a new configurable approach whose purpose is to balance system reliability and performance, to tolerate soft errors via partial software protection. Those unprotected software regions which are motivated by soft error mask on software level are related to statically dead codes, those codes whose probabilities to be executed are low and some partially dead codes. For those protected codes, we copy every data and operate every operation twice to ensure those data stored into memory are right. Additionally, we ensure every branch instruction can jump to the right address by checking condition and destination address. Finally, our approach is implemented by modification of compiler. System reliability and performance are evaluated with different configurations. Experimental results demonstrate our purpose to balance system reliability and performance.
Cited by 5
Jianli Xu · Proceedings · 2006
The run-time quality properties of software architecture, such as reliability and performance, are fundamental to telecom systems, but they are very hard to be precisely specified and evaluated with conventional methods. In our contribution we focus on modeling and analysis of architectural level run-time quality properties using formal methods. Colored Petri nets (CPN) is used to create specific system behavior models of reliability and performance properties of software architecture, these properties are then evaluated with analysis and simulation techniques supported by CPN and its tools. In this paper we report our approach and experience on using CPN to model and evaluate the reliability and performance properties of different architecture designs of a critical software subsystem in a telephone switch system. The reliability and performance properties of two alternative solutions were modeled and compared through model analysis and extensive model simulation. The results helped us to find an ideal solution with high performance, low cost and acceptable reliability that met the industry standards
Cited by 3
Fathollah Bistouni, Mohsen Jahanshahi · Journal of the Institute of Electronics and Computer · 2020
In the component-based software, as its name indicates, the overall system performance is a reflection of the performance of its components. The correct analysis of reliability, which is known as a critical factor in component-based software engineering process, is one of the necessary tasks in such a system. However, most of the previous studies do not provide a practical and complete approach on this issue of this field. So, the aim of this work is to introduce a new systematic approach for software reliability analysis. The system architecture is used by this approach for time-dependent reliability evaluation.
Cited by 67Open access
Jiangyun Xu, Weichang Du · 2004
In service-oriented distributed systems, software services are located in different computers; such services collaborate with each other to carry out computation tasks. This paper presents design and implementation of lightweight software brokers for quality of services in service-oriented distributed systems. Such brokers help clients in a distributed system to use software services provided by other distributed software components with desired qualities in terms of performance and reliability. The performance software broker can dynamically discover the software service in a distributed system that can provide the best performance according to the client's functional and performance requirements. The reliability software broker can provide fault tolerant service to clients by dynamically migrating clients' service requests among multiple software services. The software brokers are implemented in Java Jini-based distributed systems.
Cited by 3
M. S. Alam, W.H. Chen, W.K. Ehrlich et al. · 2002
Operational testing is expensive and time-consuming in applications with highly critical but infrequent event occurrences, and procedures are needed for obtaining valid software reliability estimates. Two such procedures are accelerated stress testing and experimental design techniques. Examples of accelerated stress in software include: a higher request arrival rate, increasing data traffic "burstiness", and so on. Furthermore, when the software is tested by executing the system under emergency conditions or exception events, it is critical that experimental design techniques are used to account for "carry-over" effects in failure performance. An application of software reliability testing of a telecommunication system node controller is used to describe the issues and our overall approach to software reliability assessment. The reliability projections based on our approach are compared to reliability estimates derived analytically and through simulation. Our results suggest that these statistical techniques are useful techniques for measuring reliability performance under critical events that have a low probability of occurrence.
Cited by 16
Yanhao Zeng · 2017
Hardware-software co-design systems abound in diverse modern application areas such as automobile control, telecommunications, big data processing and cloud computing. Reliability of a hardware-software co-design system relates to why, when and how system hardware or software failures occur. Existing works on reliability modeling of such co-design systems have mostly assumed hardware and software subsystems behave independently of each other. However, these two subsystems may have significant interactions in practice. In this thesis, we develop Markov and integration based approaches to analyze reliability of hardware-software co-design systems considering interactions between hardware and software during the system performance degradation and failure process. The proposed integration approach is applicable to arbitrary types of time-to-failure distributions. Case studies on systems without and with warm standby sparing are performed to illustrate the proposed methodologies. Effects of different component parameters on system performance are also investigated through examples..
Cited by 0
Wang Ru · MATEC Web of Conferences · 2018
This paper analyzes the requirements of software reliability model prediction and evaluation system, describes the overall structure of the system, the specific module functions and the design of database. This paper USES JavaScript, Js, Html and other technologies to complete the design of software reliability model evaluation system and analyzes the hierarchical structure of classes and key program packages. Finally, the test scheme is designed to complete the test of the reliability model evaluation system, including the system’s function, performance, reliability, security and operability.
Cited by 1Open access