Two "cultural" improvements have helped a lot. First, the interface to the Bugzilla bug tracker has been greatly enhanced, so it's relatively easy for end-users to report problems with enough detail so that they can be reproduced. The Bugzilla Assistant is graphical and workflow-based, leading users through the otherwise complex process of reporting a bug. Second, the release timeline has been locked into a predictable schedule. This means developers know when their work will get shipped (if it meets the quality threshold) and prevents people playing politics by trying to sync releases with the work of high-status individuals. Both improvements have boosted LibreOffice.
All the same, breakage happens, but a brilliantly simple invention by team member Bjoern Michaelsen of Canonical has allowed anyone on the QA team to locate the bugs that cause regressions. Git includes the
git bisect command, which helps pinpoint regressions. The developer identifies a version of the code with the defect under investigation, as well as a historic version that did not exhibit the defect. Git then offers a commit between those two and asks if that version exhibits the defect. By repeatedly bisecting the list of commits, Git permits rapid isolation of the point the defect was introduced.
A new enhancement for Git
Standard enough, but LibreOffice is a huge, complex code base, with often 50 or more commits per day. Building any one of them could take several hours, rendering the bisect process infeasible.
Michaelsen realized this could be overcome by storing the binary build the Tinderboxes create after each commit. He's established a repository specifically for them, so it's now easy to check out the fully built version of LibreOffice that matches each commit offered for testing by the
git bisect command. Using this "binary bisect" approach (shortened to "bi-bisect"), a relatively inexperienced tester who doesn't even know how to construct the code could verify the location of a defect in a quarter of the time it would take for one build. Even subtle bugs needing detailed investigation have surrendered to bi-bisect. Indeed, one I reported has been fixed this way.
Does all this innovation deliver? Meeks showed statistics suggesting it does. Despite complex refactoring and a diverse developer community with varying skill levels, stability is improving and bug levels remain under control.
Meeks offered a lesson from all this. He noted that traditional enterprise development uses a slow, conservative process to achieve quality because conventional wisdom says a higher rate of change decreases quality. But he suggested the curve has two sides. The approach TDF is using is so open and so rapid that -- despite the high rate of change for the code -- the low-process environment, rapid build approach, and rapid release timeline together mean new bugs are fixed fast.
There's much to learn from this experience. Even if your development team is unwilling to embrace the super-rapid iteration approach, techniques such as bi-bisect, continuous integration, simplified bug reporting, and permissionless commits can all be adopted piecemeal.
The most important point of all was right at the start. Meeks emphasized that an open source project may seem to be about code, but is actually about people.
Developers and end-users gather in an open source community because of their own interests and needs. To succeed, any community must focus on this: on ethos, on reciprocity rather than exploitation, on licensing as a constitution for the community, on friendship, and especially on keeping everything fun.
LibreOffice succeeds not because of the code but because of the way the people who work on it self-organize and treat one another, starting each involvement with assumed trust and empowerment. That's a lesson every open source community needs to take away.
This article, "What you can learn from the monster LibreOffice project," was originally published at InfoWorld.com. Read more of the Open Sources blog and follow the latest developments in open source at InfoWorld.com. For the latest business technology news, follow InfoWorld.com on Twitter.