#20 pkgdb-cli list --user seems slow and lists eol/orphaned by default
Closed: Fixed None Opened 9 years ago by petersen.

Not sure if the slowness and listing eol packages is related or not.

"pkgdb-cli list --user <user>" can take several minutes sometimes.

It lists EOL packages too without --eol.

If they are unrelated, I will happily split into two bugs.
I just thought the two might be related perhaps...


I forget to say this is with git 731a4d3 (from yesterday).

The response time seems to depend on the number of maintained/watched packages:

{{{
$ time pkgdb-cli list --user haskell-sig
:
Total: 291 packages

real 4m50.551s
}}}

For a user with fewer packages (< 50) the time might be < 40s.
When I timed for myself now it was > 5 min.

Anyway the times seem much slower than with pkgdb1 so it seems like a performance regression.
But I don't know if it is on the server or client side: at least the new web interface
seems similarly responsive to pkgdb1. I am happy to open a pkgdb bug too if that is needed.

If you run with --debug you will have a better idea of what it is doing and what is taking so long :)

This will help for the --user but not for --eol, there I'll need to look a little more into it

https://git.fedorahosted.org/cgit/pkgdb2.git/commit/?id=bea006dc2e40631f50ab2b2eec2f209edfcc6ced

It lists EOL packages too without --eol.

--eol is about collections btw, not packages,

Do you have an example of wrong behavior?

Do you have an example of wrong behavior?

I'm waiting for you on this, just to be sure to get it fixed for the next release :)

With the new implementation:
{{{
$ time python pkgdb2_cli.py list --user haskell-sig
[...]
Total: 281 packages
python pkgdb2_cli.py list --user haskell-sig 0.23s user 0.04s system 8% cpu 3.364 total
}}}

This is listing 10 packages less than your output, but seems to be consistent with https://admin.fedoraproject.org/pkgdb/packager/haskell-sig/

Sorry for the slow reply.

It is looking really great now (tested with commit 972922f).
And it seems noticeably faster than pkgdb1 now. :-)
Thank you very much!

Hope it can get pushed to koji/bodhi soon so everyone can benefit from this!

I'm doing too much releases these days, so I'd like to get the last one in epel6 before doing another one :)

So still a little bit of patience but hopefully not too long! :)

Login to comment on this ticket.

Metadata