[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: Coverage of code in our Starman process not counted?
- Subject: Re: Coverage of code in our Starman process not counted?
- From: Erik Huelsmann <..hidden..>
- Date: Sun, 7 Feb 2016 23:22:54 +0100
After a full day of fiddling and trying, I've now merged two branches:
1. Use 'nginx' to serve static files and reverse-proxy requests for the app server (reduces/eliminates the intermittent failures)
2. Stop using Starman as the app server while testing: change '.travis.yml' and 'tools/starman.psgi' to use HTTP::Server::PSGI (plack's server)
and include coverage results in Devel::Cover output
With these branches committed (the first is required to make the second even complete the coverage variant of the tests), coverage jumped up from 11.7% to 15.4%.
The primary reason behind the jump is the fact that the BDD tests I had written over the past weeks never made the coverage go up. This inspired me to go search for the reason behind the stable coverage outcome when I at least thought I had added significant coverage to - at least - setup.pm
and the modules it uses.
The above jump in coverage proves that indeed coverage should have gone up when I initially committed the BDD tests.
Now that coverage of the Perl code is fully measured and reported, I think it'd be nice to try and write enough tests to get to 70% of our (Perl) code exercised. Why that number? Well, because I think it's too hard to get it to 95% in the short term and because I think that even with 70% we can get a pretty good idea about the quality of our releases. Longer term, I advocate trying to get as high as 95%.
As you can imagine, I could get some help creating tests to get to the 95% - or even the 70% - figure. If you can help out by creating BDD scripts (even if just the end-user part of it) or when you could help out writing unit tests, please drop by in #ledgersmb on irc://chat.freenode.net
. I'll gladly help anybody get started!
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
Ledger-smb-devel mailing list