How Does the Degree of Variability Affect Bug-Finding?

    Publikation: Konference artikel i Proceeding eller bog/rapport kapitelKonferencebidrag i proceedingsForskningpeer review

    Abstract

    Software projects embrace variability to increase adaptability and to lower cost; however, others blame variability for increasing complexity and making reasoning about programs more difficult. We carry out a controlled experiment to quantify the impact of variability on debugging of preprocessor-based programs. We measure speed and precision for bug finding tasks defined at three different degrees of variability on several subject programs derived from real systems.
    The results show that the speed of bug finding decreases linearly with the number of features, while effectiveness of finding bugs is relatively independent of the degree of variability. Still, identifying the set of configurations in which the bug manifests itself is difficult already for a low number of features. Surprisingly, identifying the exact set of affected configurations appears to be harder than finding the bug in the first place. The difficulty in reasoning about several configurations is a likely reason why the variability bugs are actually introduced in configurable programs.
    We hope that the detailed findings presented here will inspire the creation of programmer support tools addressing the challenges faced by developers when reasoning about configurations, contributing to more effective debugging and, ultimately, fewer bugs in highly-configurable systems.
    OriginalsprogEngelsk
    TitelICSE '16 Proceedings of the 38th International Conference on Software Engineering
    Antal sider12
    ForlagAssociation for Computing Machinery
    Publikationsdato14 maj 2016
    Sider679-690
    ISBN (Trykt)978-1-4503-3900-1
    DOI
    StatusUdgivet - 14 maj 2016

    Emneord

    • Variability management
    • Debugging performance
    • Preprocessor-based programs
    • Bug finding strategies
    • Configuration complexity

    Fingeraftryk

    Dyk ned i forskningsemnerne om 'How Does the Degree of Variability Affect Bug-Finding?'. Sammen danner de et unikt fingeraftryk.

    Citationsformater