fesco

Clone
Source Code
GIT

#517 Updates Metrics
Closed None Opened 13 years ago by kevin.

Closed
Reopen Issue

We need to identify what metrics we currently have on updates and improve them to where they match the Board's vision for updates:

"Project members should be able to transparently measure or monitor a new updates process to objectively measure its effectiveness, and determine whether the updates process is achieving the aforementioned vision statements."

Luke: Can you run what you have for bodhi stats again against all the old releases you have so we see where we are?

= Fedora 12 =

  • 6527 updates
  • 6023 stable updates
  • 100 testing updates
  • 58 pending updates
  • 346 obsolete updates
  • 3830 bugfix updates (58.68%)
  • 1385 enhancement updates (21.22%)
  • 369 security updates (5.65%)
  • 943 newpackage updates (14.45%)
  • 5949 bugs resolved
  • 503 critical path updates (7.71%)
  • 458 approved critical path updates
  • 0 unapproved critical path updates
  • 1263 updates received feedback (19.35%)
  • 9158 +0 comments
  • 2418 +1 comments
  • 628 -1 comments
  • 812 unique authenticated karma submitters
  • 22 proventesters
  • 643 anonymous users gave feedback (5.31%)
  • 4452 out of 6023 stable updates went through testing (73.92%)
  • 3455 went from testing to stable without karma (77.61%)
  • 58 updates were pushed to stable with negative karma (0.96%)
  • 190 critical path updates pushed without karma
  • Time spent in testing:
  • mean = 15 days
  • median = 13 days
  • mode = 8 days
  • 3447 packages updated

= Fedora 13 =

  • 6793 updates
  • 6210 stable updates
  • 202 testing updates
  • 63 pending updates
  • 318 obsolete updates
  • 4225 bugfix updates (62.20%)
  • 1388 enhancement updates (20.43%)
  • 284 security updates (4.18%)
  • 896 newpackage updates (13.19%)
  • 5307 bugs resolved
  • 623 critical path updates (9.17%)
  • 595 approved critical path updates
  • 0 unapproved critical path updates
  • 2189 updates received feedback (32.22%)
  • 7530 +0 comments
  • 4786 +1 comments
  • 530 -1 comments
  • 794 unique authenticated karma submitters
  • 45 proventesters
  • 504 anonymous users gave feedback (3.94%)
  • 5169 out of 6210 stable updates went through testing (83.24%)
  • 3281 went from testing to stable without karma (63.47%)
  • 26 updates were pushed to stable with negative karma (0.42%)
  • 25 critical path updates pushed without karma
  • Time spent in testing:
  • mean = 13 days
  • median = 10 days
  • mode = 8 days
  • 3780 packages updated

= Fedora 14 =

  • 4101 updates
  • 3463 stable updates
  • 232 testing updates
  • 53 pending updates
  • 353 obsolete updates
  • 2755 bugfix updates (67.18%)
  • 755 enhancement updates (18.41%)
  • 138 security updates (3.37%)
  • 453 newpackage updates (11.05%)
  • 2981 bugs resolved
  • 397 critical path updates (9.68%)
  • 347 approved critical path updates
  • 0 unapproved critical path updates
  • 1425 updates received feedback (34.75%)
  • 590 +0 comments
  • 3006 +1 comments
  • 283 -1 comments
  • 440 unique authenticated karma submitters
  • 47 proventesters
  • 193 anonymous users gave feedback (5.00%)
  • 3110 out of 3463 stable updates went through testing (89.81%)
  • 1970 went from testing to stable without karma (63.34%)
  • 18 updates were pushed to stable with negative karma (0.52%)
  • 27 critical path updates pushed without karma
  • Time spent in testing:
  • mean = 11 days
  • median = 9 days
  • mode = 8 days
  • 2792 packages updated

= Fedora EPEL 5 =

  • 2279 updates
  • 1935 stable updates
  • 112 testing updates
  • 28 pending updates
  • 204 obsolete updates
  • 1036 bugfix updates (45.46%)
  • 354 enhancement updates (15.53%)
  • 134 security updates (5.88%)
  • 755 newpackage updates (33.13%)
  • 1192 bugs resolved
  • 0 critical path updates (0.00%)
  • 0 approved critical path updates
  • 0 unapproved critical path updates
  • 232 updates received feedback (10.18%)
  • 3368 +0 comments
  • 266 +1 comments
  • 87 -1 comments
  • 265 unique authenticated karma submitters
  • 6 proventesters
  • 57 anonymous users gave feedback (1.53%)
  • 1877 out of 1935 stable updates went through testing (97.00%)
  • 1675 went from testing to stable without karma (89.24%)
  • 17 updates were pushed to stable with negative karma (0.88%)
  • 0 critical path updates pushed without karma
  • Time spent in testing:
  • mean = 25 days
  • median = 17 days
  • mode = 15 days
  • 1401 packages updated

= Fedora EPEL 4 =

  • 589 updates
  • 501 stable updates
  • 35 testing updates
  • 6 pending updates
  • 47 obsolete updates
  • 287 bugfix updates (48.73%)
  • 91 enhancement updates (15.45%)
  • 55 security updates (9.34%)
  • 156 newpackage updates (26.49%)
  • 326 bugs resolved
  • 0 critical path updates (0.00%)
  • 0 approved critical path updates
  • 0 unapproved critical path updates
  • 18 updates received feedback (3.06%)
  • 852 +0 comments
  • 19 +1 comments
  • 2 -1 comments
  • 86 unique authenticated karma submitters
  • 2 proventesters
  • 2 anonymous users gave feedback (0.23%)
  • 464 out of 501 stable updates went through testing (92.61%)
  • 448 went from testing to stable without karma (96.55%)
  • 2 updates were pushed to stable with negative karma (0.40%)
  • 0 critical path updates pushed without karma
  • Time spent in testing:
  • mean = 18 days
  • median = 16 days
  • mode = 15 days
  • 377 packages updated

= Totals =
Out of 13762 total updates, 3864 received feedback (28.08%)
Out of 972 total unique karma submitters, the top 20 are:
* adamwill (201)
* filiperosset (194)
* kevin (194)
* jdulaney (184)
* masami (171)
* mrunge (169)
* shinobi (155)
* boblfoot (144)
* bernie (127)
* cweyl (126)
* watzkej (114)
* redwolfe (108)
* notting (102)
* salimma (94)
* mschwendt (90)
* kwright (84)
* mtasaka (73)
* robatino (71)
* genes (66)
* mooninite (59)

Kyle is going to look at these and see if we can adjust or add any needed by fesco.
Thanks.

Many updates get edited and go through more than one "revision" (is that the proper term?). I would like to see the number of old revisions and how many of them got pushed to testing. It might be useful to combine these numbers with the number of obsolete updates.

kylem is going to look at this some.

Fresh metrics!

== Fedora 15 ==

  • 3938 updates
  • 2797 packages updated
  • 3334 stable updates
  • 233 testing updates
  • 65 pending updates
  • 306 obsolete updates
  • 2663 bugfix updates (67.62%)
  • 781 enhancement updates (19.83%)
  • 122 security updates (3.10%)
  • 372 newpackage updates (9.45%)
  • 2403 bugs resolved
  • 490 critical path updates (12.44%)
  • 424 approved critical path updates
  • 0 unapproved critical path updates
  • 1463 updates received feedback (37.15%)
  • 5296 +0 comments
  • 2842 +1 comments
  • 280 -1 comments
  • 404 unique authenticated karma submitters
  • 52 proventesters
  • 1621 +1's from proventesters
  • 91 -1's from proventesters
  • 148 anonymous users gave feedback (1.76%)
  • 712 updates reached the stable karma threshold (21.36%)
  • 2712 updates reached the minimum time in testing threshold (81.34%)
  • 2065 went from testing to stable without karma (63.75%)
  • 6 updates were pushed to stable with negative karma (0.18%)
  • 0 critical path updates pushed to stable without karma
  • Time spent in testing:
  • mean = 7 days
  • median = 5 days
  • mode = 4 days

== Fedora 14 ==

  • 6997 updates
  • 3921 packages updated
  • 6125 stable updates
  • 217 testing updates
  • 48 pending updates
  • 607 obsolete updates
  • 4428 bugfix updates (63.28%)
  • 1321 enhancement updates (18.88%)
  • 330 security updates (4.72%)
  • 918 newpackage updates (13.12%)
  • 5323 bugs resolved
  • 636 critical path updates (9.09%)
  • 529 approved critical path updates
  • 0 unapproved critical path updates
  • 2284 updates received feedback (32.64%)
  • 3605 +0 comments
  • 4610 +1 comments
  • 499 -1 comments
  • 658 unique authenticated karma submitters
  • 58 proventesters
  • 1996 +1's from proventesters
  • 96 -1's from proventesters
  • 448 anonymous users gave feedback (5.16%)
  • 257 updates reached the stable karma threshold (4.20%)
  • 4930 updates reached the minimum time in testing threshold (80.49%)
  • 3825 went from testing to stable without karma (66.57%)
  • 39 updates were pushed to stable with negative karma (0.64%)
  • 12 critical path updates pushed to stable without karma
  • Time spent in testing:
  • mean = 11 days
  • median = 8 days
  • mode = 8 days

== Fedora 13 ==

  • 8339 updates
  • 4222 packages updated
  • 7712 stable updates
  • 122 testing updates
  • 47 pending updates
  • 458 obsolete updates
  • 5098 bugfix updates (61.13%)
  • 1681 enhancement updates (20.16%)
  • 453 security updates (5.43%)
  • 1107 newpackage updates (13.27%)
  • 6640 bugs resolved
  • 788 critical path updates (9.45%)
  • 733 approved critical path updates
  • 0 unapproved critical path updates
  • 2436 updates received feedback (29.21%)
  • 8927 +0 comments
  • 5165 +1 comments
  • 559 -1 comments
  • 828 unique authenticated karma submitters
  • 49 proventesters
  • 980 +1's from proventesters
  • 47 -1's from proventesters
  • 531 anonymous users gave feedback (3.64%)
  • 75 updates reached the stable karma threshold (0.97%)
  • 3140 updates reached the minimum time in testing threshold (40.72%)
  • 4560 went from testing to stable without karma (68.47%)
  • 32 updates were pushed to stable with negative karma (0.41%)
  • 67 critical path updates pushed to stable without karma
  • Time spent in testing:
  • mean = 13 days
  • median = 9 days
  • mode = 8 days

== Fedora EPEL 6 ==

  • 689 updates
  • 682 packages updated
  • 516 stable updates
  • 116 testing updates
  • 1 pending updates
  • 56 obsolete updates
  • 263 bugfix updates (38.17%)
  • 140 enhancement updates (20.32%)
  • 43 security updates (6.24%)
  • 243 newpackage updates (35.27%)
  • 421 bugs resolved
  • 0 critical path updates (0.00%)
  • 0 approved critical path updates
  • 0 unapproved critical path updates
  • 70 updates received feedback (10.16%)
  • 17 +0 comments
  • 88 +1 comments
  • 7 -1 comments
  • 46 unique authenticated karma submitters
  • 9 proventesters
  • 16 +1's from proventesters
  • 0 -1's from proventesters
  • 8 anonymous users gave feedback (7.14%)
  • 16 updates reached the stable karma threshold (3.10%)
  • 530 updates reached the minimum time in testing threshold (102.71%)
  • 462 went from testing to stable without karma (90.23%)
  • 0 updates were pushed to stable with negative karma (0.00%)
  • 0 critical path updates pushed to stable without karma
  • Time spent in testing:
  • mean = 18 days
  • median = 15 days
  • mode = 15 days

== Fedora EPEL 5 ==

  • 2871 updates
  • 1623 packages updated
  • 2459 stable updates
  • 108 testing updates
  • 29 pending updates
  • 275 obsolete updates
  • 1310 bugfix updates (45.63%)
  • 466 enhancement updates (16.23%)
  • 173 security updates (6.03%)
  • 922 newpackage updates (32.11%)
  • 1622 bugs resolved
  • 0 critical path updates (0.00%)
  • 0 approved critical path updates
  • 0 unapproved critical path updates
  • 319 updates received feedback (11.11%)
  • 3390 +0 comments
  • 400 +1 comments
  • 95 -1 comments
  • 300 unique authenticated karma submitters
  • 13 proventesters
  • 57 +1's from proventesters
  • 27 -1's from proventesters
  • 78 anonymous users gave feedback (2.01%)
  • 16 updates reached the stable karma threshold (0.65%)
  • 1048 updates reached the minimum time in testing threshold (42.62%)
  • 2124 went from testing to stable without karma (88.76%)
  • 21 updates were pushed to stable with negative karma (0.85%)
  • 0 critical path updates pushed to stable without karma
  • Time spent in testing:
  • mean = 24 days
  • median = 17 days
  • mode = 15 days

== Fedora EPEL 4 ==

  • 740 updates
  • 442 packages updated
  • 648 stable updates
  • 26 testing updates
  • 7 pending updates
  • 59 obsolete updates
  • 357 bugfix updates (48.24%)
  • 111 enhancement updates (15.00%)
  • 67 security updates (9.05%)
  • 205 newpackage updates (27.70%)
  • 430 bugs resolved
  • 0 critical path updates (0.00%)
  • 0 approved critical path updates
  • 0 unapproved critical path updates
  • 27 updates received feedback (3.65%)
  • 857 +0 comments
  • 30 +1 comments
  • 2 -1 comments
  • 89 unique authenticated karma submitters
  • 4 proventesters
  • 4 +1's from proventesters
  • 0 -1's from proventesters
  • 2 anonymous users gave feedback (0.22%)
  • 2 updates reached the stable karma threshold (0.31%)
  • 188 updates reached the minimum time in testing threshold (29.01%)
  • 587 went from testing to stable without karma (96.07%)
  • 2 updates were pushed to stable with negative karma (0.31%)
  • 0 critical path updates pushed to stable without karma
  • Time spent in testing:
  • mean = 18 days
  • median = 16 days
  • mode = 15 days

== Totals ==
* Out of 23574 total updates, 6599 received feedback (27.99%)
* Out of 1218 total unique karma submitters, the top 50 are:
* autoqa (1340)
* notting (426)
* adamwill (361)
* mclasen (360)
* jkeating (322)
* masami (227)
* rdieter (215)
* filiperosset (192)
* cwickert (183)
* jdulaney (183)
* mooninite (177)
* pbrobinson (167)
* tomspur (162)
* boblfoot (144)
* mtasaka (143)
* cweyl (126)
* cschwangler (123)
* shinobi (115)
* redwolfe (110)
* peter (107)
* xake (101)
* tagoh (92)
* mschwendt (88)
* michich (88)
* kwright (84)
* hadess (83)
* robatino (83)
* salimma (78)
* bpepple (78)
* thomasj (76)
* pravins (76)
* dp67 (73)
* remi (73)
* sundaram (73)
* athmane (72)
* oget (72)
* mhlavink (71)
* spot (69)
* alexlan (69)
* raven (69)
* kkofler (68)
* fab (67)
* dwalsh (66)
* twaugh (62)
* orion (61)
* kwizart (60)
* robert (57)
* limb (55)
* nphilipp (52)
* jonathan11 (51)

Here are some fresh metrics with some new proventester data.

{{{

 Fedora 14

================================================================================

================================================================================
Fedora 15
================================================================================

================================================================================
Fedora 16
================================================================================

Out of 23255 total updates, 6375 received feedback (27.41%)
Out of 1259 total unique karma submitters, the top 50 are:
* autoqa (28787)
* kevin (861)
* adamwill (719)
* ausil (580)
* caillon (545)
* masami (474)
* mschwendt (357)
* mrunge (354)
* athmane (290)
* boblfoot (257)
* robatino (249)
* watzkej (246)
* ellert (228)
* kalev (220)
* peter (216)
* bernie (214)
* jdulaney (208)
* robert (190)
* filiperosset (179)
* salimma (177)
* stevetraylen (175)
* redwolfe (167)
* mtasaka (167)
* lmacken (164)
* shinobi (160)
* notting (158)
* raven (156)
* rdieter (140)
* oldfart (132)
* orion (131)
* pbrobinson (128)
* kwright (122)
* nb (116)
* jlaska (109)
* tflink (108)
* petersen (106)
* mooninite (102)
* remi (102)
* bojan (99)
* evillagr (99)
* jussilehtola (96)
* iarnell (95)
* mclasen (95)
* antiaircraft (92)
* bpepple (92)
* tomspur (91)
* norbot (87)
* kkofler (85)
* elad (84)
* rjones (84)

}}}

I don't think we've done anything substantial with this. I also don't think the past two Boards have cared about this at all.

Fedora has a lot of updates. It's a product of our release cycle.

Is there any reason to keep this open?

No answer to Josh's question so I'm closing this. Feel free to open a new ticket if the situation changes.

Login to comment on this ticket.

Metadata
None
None
None
None
None
Powered by Pagure 5.13.3
Documentation • File an Issue • About • SSH Hostkey/Fingerprint
© Red Hat, Inc. and others.