[prev in list] [next in list] [prev in thread] [next in thread] 

List:       openssh-unix-dev
Subject:    Test coverage results available online
From:       Harri Porten <porten () froglogic ! com>
Date:       2015-04-24 11:06:06
Message-ID: alpine.DEB.2.11.1504241212570.7784 () greco ! froglogic ! com
[Download RAW message or body]

Dear OpenSHH developers,

in case this helps with your testing efforts:

At

  http://www.opencoverage.net/projects/openssh/index_html/sources.html

you'll find an overview of the condition/decision code coverage as 
achieved through a run of the test suite. The state last used is from the 
git master branch commit 70860b6.

You might find the total coverage 27.8% to be much lower than what you've 
seen before. Main reason is the use of the condition/decision metric which 
is more ambitious than plain branch or line coverage. It requires testing 
of more input combinations to achieve a higher level. On the positive side 
chances of missing out a bug decrease.

Known and potential issues:

  - Some statements are flagged as dead (unreachable) code which might be 
fine according to the project's coding style. Like a 'break' after a 
'goto'.

  - The code configuration or test execution setup might be non-optimal and 
have some features or tests disabled.

Todos:

  - Improve the test execution name to be more meaningful than just 'ssh 
(33)'.

  - Filter out false negatives like above cases of dead code.

If you have any questions about the results, see a problem, or have a 
suggestion just let me know. While the analysis of Open Source projects 
started as an internal dogfooding project for our company's tool Squish 
Coco we also hope to contribute something back to the quality of software 
we all rely on.

Harri.
_______________________________________________
openssh-unix-dev mailing list
openssh-unix-dev@mindrot.org
https://lists.mindrot.org/mailman/listinfo/openssh-unix-dev
[prev in list] [next in list] [prev in thread] [next in thread]