Ticket #339 (new enhancement)

Opened 19 months ago

Last modified 9 months ago

software collections in Fedora

Reported by: mmaslano Owned by:
Priority: major Milestone:
Component: Guideline Draft Version:
Keywords: Cc: bkabrda@…, msuchy, skottler@…, maxamillion@…, kwade@…, robyn.bergeron@…, jzb@…, lzap, pmkovar, hhorak, tdawson@…, j_dulaney@…, tadej.janez@…, herrold@…, sanjay.ankur@…, vondruch, mbooth@…
Blocked By: Blocking:

Description

Hi FPC,

I'd like to start discussion about inclusion of collections into Fedora. My first draft is here: https://fedoraproject.org/wiki/User:Mmaslano/SCLinFedora

Packaging guidelines were also prepared: https://fedoraproject.org/wiki/User:Bkabrda/SCLGuidelinesDraft

I'm still working on list of changes needed in tooling, but I'd rather have the proposal accepted first.

Change History

comment:1 Changed 19 months ago by msuchy

  • Cc msuchy added

comment:2 Changed 19 months ago by skottler

  • Cc skottler@… added

comment:3 Changed 19 months ago by maxamillion

  • Cc maxamillion@… added

comment:4 Changed 19 months ago by quaid

  • Cc kwade@… added

comment:5 Changed 19 months ago by rbergero

  • Cc robyn.bergeron@… added

comment:6 Changed 19 months ago by jzb

  • Cc jzb@… added

comment:7 Changed 19 months ago by corsepiu

As long as SCL keeps on using /opt/rh, which is a glass clear violation of the FHS, all votes from me on any thing related to SCLs will be -1.

Less harshly formulated: Why can't you use a different path? /var/lib/scl, /var/lib/redhat/scl or even /usr/lib/scl ?

comment:8 Changed 19 months ago by skottler

Are you raising issue with the "rh" portion of that path or "/opt"? If it's the former, then I think we can easily switch to "/opt/scl".

comment:9 Changed 19 months ago by rdieter

/opt prefix is the problem, notice none of the suggested alternatives include it.

comment:10 Changed 19 months ago by mattdm

From my peanut gallery position here, I strongly prefer /usr/lib/scl to anything under /var. Putting it under /var would also be a clear FHS violation. This packages are really not all that different from standard RPMs -- they are not variable data.

In fact, it's a stronger violation than /opt, which says

/opt is reserved for the installation of add-on application software packages.

And arguably that's what these are -- that term is poorly defined.

However, opt is problematic because the FHS also says that while distributions may install software in /opt, they must not delete or overwrite existing software, so if local installation has /opt/rh for whatever other reason, RPM doesn't have a good mechanism for dealing with that. That's a reasonable argument for staying clear, although one could also argue that the FHS should evolve to allow vendor prefixes within /opt to belong to a certain vendor.

comment:11 Changed 19 months ago by toshio

Would that be /usr/lib/scl or %{_libdir}/scl?

comment:12 Changed 19 months ago by lzap

  • Cc lzap added

comment:13 Changed 19 months ago by mmaslano

It obviously should be /opt/fedora on Fedora :) I'll change it.

If you think about scl installed in /opt as a add-on to Fedora, then it's according to FHS. I don't like idea of /var or /usr/lib in Fedora and /opt in all other scls. It's confusing for users who already packaged their stuff.

comment:14 Changed 19 months ago by msuchy

SCL was not intended to be part of standard Fedora. I mean part of Ring0 and Ring1 in meaning of Fedora.Next. So it will be add-on in the same sense as FHS have for /opt.

Additionally we will provide some basic collections, but it is expected that users will build collections on their own (mostly they will depend on those basic collection). And these guidelines are receipt to standardize it. And it really does not make sense that Fedora will have SCL under /usr, while users will put them in /opt. And it does not have sense to me that user will put their own SCL under /usr.

comment:15 Changed 19 months ago by remi

I think it make sense to allow SCL package, at least to be able to provide additional packages for RHSCL in EPEL.

In all case /opt/rh going to be an issue (as IIRC centos use /opt/centos, so package build against DTS or RHSCL will be only usable on RHEL, not on any other clone).

comment:16 Changed 19 months ago by pmkovar

  • Cc pmkovar added

comment:17 Changed 19 months ago by notting

1) As Remi says - I think having compatible versions of the Red Hat Software Collection product available for EPEL is a good thing, and since EPEL feeds from Fedora, we should allow that to be built.

2) In the same way, having those compatbile versions for Fedora can be useful as well, for apps that want portability.

3) I'm fine with /opt/<vendor> - it's the de-facto usage already. Even the FHS says "Distributions may install software in /opt, but must not modify or delete software installed by the local system administrator without the assent of the local system administrator.", and, well, choosing a package to install via yum does require the assent of the local system administrator, so it still follows the standard.

comment:18 Changed 19 months ago by remi

SCL metapackage: the metapackage must be arch specific, otherwise it may be noarch.

As the metapackage runtime subpackage own %_libir, AFAIK this one must be arched.

So probably "the metapackage must be arch specific" in all case (simpler).

Inter-SCL Dependencies

I think this is more about requiring package from a collection (in another collection or not) So this doesn't need to be conditional

    - %{?scl:Requires: %scl_require ruby193}. 
    + %Requires: %scl_require ruby193

comment:19 follow-up: ↓ 20 Changed 19 months ago by toshio

The scl location issue strikes me as something that wants to have separate directories but I don't know if scls are flexible enough to do that (or if they could be enhanced to do it). For Fedora Commons, scls probably belong under %{_libdir} because Fedora Commons is being provided by the distribution. For other things in Ring 2/3 it could make sense to have a vendor-location. Local users will want to have a third location (the reason being that once they start creating scls if they're installed to the same location as either of the other two they start to run the risk of conflicts between their packages and their vendor's packages.) Third parties providing things packaged as scls would also benefit tremendously from a separate install location (this is just a generalization of the split between Fedora Commons and Fedora Addons in Ring 2/3).

Some of this becomes even more relevant when we think about how to apply this to EPEL. There we have several distinct vendors -- RHEL itself, RH SCLs, EPEL SCLs, CENTOS SCLs, and local user SCLs.

There are other possibilities to solve this than separate directory locations (although separate directories also allow us to address the FHS concerns). One way would be for scl packages to bear vendor prefixes (I heard from mmaslano and langdon that this was under discussion for perhaps different reasons as well). The vendor prefixes would carry over to what is installed on the filesystem. So you'd have something like /opt/scl/centos-ruby2.0 /opt/scl/rht-ruby2.0 /opt/scl/fdr-ruby2.0 ) I haven't yet thought these alternate strategies through to figure out if they're better or worse than the others (I have a feeling that deps may be tricky but it's very possible they are not trickier than inter-scl deps in general.)

comment:20 in reply to: ↑ 19 ; follow-up: ↓ 22 Changed 19 months ago by mmaslano

Replying to toshio:

The scl location issue strikes me as something that wants to have separate directories but I don't know if scls are flexible enough to do that (or if they could be enhanced to do it). For Fedora Commons, scls probably belong under %{_libdir} because Fedora Commons is being provided by the distribution. For other things in Ring 2/3 it could make sense to have a vendor-location. Local users will want to have a third location (the reason being that once they start creating scls if they're installed to the same location as either of the other two they start to run the risk of conflicts between their packages and their vendor's packages.) Third parties providing things packaged as scls would also benefit tremendously from a separate install location (this is just a generalization of the split between Fedora Commons and Fedora Addons in Ring 2/3).

It seems to me like lot of space for packaging errors. Even current packages are not packaged properly and ask people to decide what should go into %{_libdir} and what should go into /opt seems like another weak spot.

comment:21 Changed 19 months ago by remi

I'm really against the idea of having any <vendor> specific part in the %_scl_root (even if present in RHSCL). I think we should use a generic path, such as /opt/scl.

@toshio, I think SCL is not for "Fedora Common" (so no need to use %{_libdir}, according to your comment, but only /opt should be fine)

Perhaps we need to state if SCL can be used by non-SCL pakage, at build time (I think yes), at runtime (probably no).

comment:22 in reply to: ↑ 20 ; follow-up: ↓ 23 Changed 19 months ago by toshio

Replying to mmaslano:

It seems to me like lot of space for packaging errors. Even current packages are not packaged properly and ask people to decide what should go into %{_libdir} and what should go into /opt seems like another weak spot.

If you're building a package for Fedora Commons => %{_libdir} If you're building for one of the Rings, => /opt. That part should be easy. The question of whether scl is flexible enough to handle this and in what way is not so easy (do the spec files look the same and just the macros get adjusted? Do the spec files look different?)

comment:23 in reply to: ↑ 22 Changed 19 months ago by bkabrda

Replying to toshio:

If you're building a package for Fedora Commons => %{_libdir} If you're building for one of the Rings, => /opt. That part should be easy. The question of whether scl is flexible enough to handle this and in what way is not so easy (do the spec files look the same and just the macros get adjusted? Do the spec files look different?)

IMO placing collections in two different locations will just make mess of things. It is possible, but I'd be strongly against it.

I know that people have various interpretations of FHS. But if you consider %_libdir (be it /usr/lib or /usr/lib64), FHS statest [1]: "/usr/lib includes object files, libraries, and internal binaries that are not intended to be executed directly by users or shell scripts." So IMO placing SCLs there would violate FHS.

Under /opt, on the other hand [2] "/opt/bin, /opt/doc, /opt/include, /opt/info, /opt/lib, and /opt/man are reserved for local system administrator use". Also, "Programs to be invoked by users must be located in the directory /opt/<package>/bin or under the /opt/<provider>" - so using /opt/fedora (assuming "fedora" is the LANANA name) seems to be the proper place to place SCLs.

@corsepiu could you please explain the glass clear violation? It's not glass clear for me.

[1] http://www.pathname.com/fhs/pub/fhs-2.3.html#USRLIBLIBRARIESFORPROGRAMMINGANDPA [2] http://www.pathname.com/fhs/pub/fhs-2.3.html#OPTADDONAPPLICATIONSOFTWAREPACKAGES

comment:24 follow-up: ↓ 25 Changed 19 months ago by mmaslano

I can't attend FPC meetings, so I'd like to sum up issues from your last meeting and receive guidance for next development of my draft.

1/ Installation path

I'd like to see /opt as installation path. If you disagree than please propose better place for installation. It shouldn't be problem to set macros in scl-utils differently, but it will confuse downstreams using the opt directory.

2/ core+addons discussion

This discussion is premature. I do not know what will Fedora become. I'd like to provide stable versions of some languages badly needed but some projects. SCL are not trying to define addons, because they'd existed before I first heard about whole Fedora.next initiative.

3/ not defining restrictions

I was hoping FPC can give me a list of missing parts in the proposal. I can propose a restriction policy on SCLs, but I'd like to know first if FPC is interested in such work. I already stated in the proposal SCL SIG should approve SCLs. Could you give me directions if it's not enough? For example should new SCL be approved by FESCo as a new Change?

Thanks.

comment:25 in reply to: ↑ 24 Changed 19 months ago by toshio

I sent out a message to packaging@… just now with what Langdon, Remi, and I spent Friday and the weekend working on. It's a starting point for discussion.

Replying to mmaslano:

I can't attend FPC meetings, so I'd like to sum up issues from your last meeting and receive guidance for next development of my draft.

I've been talking with langdon. I hope that is okay? I don't want to get biased ideas but at the same time IRC is the best way to move this forwards quickly. (It would be even more helpful if you and I or bkabrda could have IRC meetings about this so we could directly work on the draft but I'll take what I can get :-)

1/ Installation path

I'd like to see /opt as installation path. If you disagree than please propose better place for installation. It shouldn't be problem to set macros in scl-utils differently, but it will confuse downstreams using the opt directory.

There were several questions about this in the message I just sent. I think that FPC isn't completely ready to vote on this yet -- there's several ideas for where the installation could be and I think we can narrow it down to fewer options before we vote on it.

2/ core+addons discussion

This discussion is premature. I do not know what will Fedora become. I'd like to provide stable versions of some languages badly needed but some projects. SCL are not trying to define addons, because they'd existed before I first heard about whole Fedora.next initiative.

Addons provide something useful to the discussion because SCLs have very limited use within Fedora. Certain policies and guidelines that we could implement would, IMHO, mean that scls had no use within Fedora. By figuring out the complete picture we can see what possibility exists. For instance, you might want to have the language runtime in Fedora. But a language is of limited use without the stack of third party libraries that go with it. So then we have to figure out whether those also go in the same SCL, in separate SCLs, or in separate SCLs provided by the Addons/third parties. If we decided to ignore addons as an eventual part of the Fedora ecosystem, we'd be in a different position than we are if we count on them to be an important part of making things more useful later.

3/ not defining restrictions

I was hoping FPC can give me a list of missing parts in the proposal. I can propose a restriction policy on SCLs, but I'd like to know first if FPC is interested in such work.

Yes.

I already stated in the proposal SCL SIG should approve SCLs.

yeah, we didn't get to discussing that page. This particular part is something that I think I disagree with. Why treat SCLs different than other package reviews? If we have good criteria that can be applied to any package of SCLs to decide whether the SCL should be approved or not there's no reason for a separate process. If there aren't good criteria then the body that approves SCLs will be stuck with a constant burden of navigating what should be approved and not approved trying not to be unfair to their precedent, and at the same time being able to adapt to what they want to do in the future. The bundled library exception process is a similar thing in this respect -- and it's one that I think all FPC members would be happy to get rid of except that we haven't been smart enough to lay out the criteria for when bundling is allowed precisely enough that people could follow it yet.

I think SCL criteria (at least from talking with langdon) could be much simpler so we should attempt to nail that down. We can whittle out small corner cases as time progresses (and have wholly different criteria in addons if we want) but that will be a much easier process than if you end up with a morass like the bundled library exception approval process.

comment:26 Changed 19 months ago by mmaslano

Let's discuss it on packaging list.

I or Slavek can attend FPC meeting if we know, when scl is on agenda. Next week, right?

comment:27 follow-up: ↓ 28 Changed 19 months ago by kkofler

(Disclaimer: I am not an FPC member.)

IMHO, the whole concept of SCLs is a violation of the FHS, because the FHS clearly says where in /usr packages should install what kind of files, having a competing prefix to /usr (or as a subdirectory of /usr) is against the FHS. (We have an exception in Fedora to allow /usr/target as a prefix for cross compilers, but that's an exception, it's NOT part of the FHS.)

In addition, SCLs open a whole bunch of practical problems, e.g. having to set up a special environment before being able to build things against them, or in some cases even before being able to run things from the SCL. There are also all the other caveats of conflicting libraries, e.g. the dreaded symbol conflicts (so you'd need to be careful all the time what you build against what SCLs).

So, I don't think SCLs should be allowed in Fedora. Instead, we should spend the effort on making it unnecessary to install multiple versions of stuff in parallel, instead always shipping the latest version and making sure the stuff we ship works against that. Or in those few cases where there are multiple major versions of libraries which need to coexist, we should make sure they can coexist in /usr (see e.g. our kdelibs packaging). I can see how this is not possible in a RHEL environment (due to the slow release cycle), but in Fedora, it has always worked so far.

comment:28 in reply to: ↑ 27 Changed 19 months ago by mmaslano

Replying to kkofler:

(Disclaimer: I am not an FPC member.)

IMHO, the whole concept of SCLs is a violation of the FHS, because the FHS clearly says where in /usr packages should install what kind of files, having a competing prefix to /usr (or as a subdirectory of /usr) is against the FHS. (We have an exception in Fedora to allow /usr/target as a prefix for cross compilers, but that's an exception, it's NOT part of the FHS.)

Do you have any suggestions, where to put SCLs?

In addition, SCLs open a whole bunch of practical problems, e.g. having to set up a special environment before being able to build things against them, or in some cases even before being able to run things from the SCL. There are also all the other caveats of conflicting libraries, e.g. the dreaded symbol conflicts (so you'd need to be careful all the time what you build against what SCLs).

Libraries won't conflict. People are usually prefixing name of libraries (did you mean *.so). I'm aware of users who switched whole Qt stack into SCL and they didn't run to any issues.

So, I don't think SCLs should be allowed in Fedora. Instead, we should spend the effort on making it unnecessary to install multiple versions of stuff in parallel, instead always shipping the latest version and making sure the stuff we ship works against that. Or in those few cases where there are multiple major versions of libraries which need to coexist, we should make sure they can coexist in /usr (see e.g. our kdelibs packaging). I can see how this is not possible in a RHEL environment (due to the slow release cycle), but in Fedora, it has always worked so far.

I don't want to see everything in SCL and I agree with your point that everything in Fedora should be in latest version and working well together. SCL in Fedora should help projects running on various distributions namely cloud projects, who don't have time to move to latest Rails every Fedora release. I'm aware of many projects, which would like to have stable set of packages. Currently is development in Fedora not very good. In EPEL might be SCL more interesting for different kind of developers who want new php and similar stuff.

comment:29 follow-ups: ↓ 30 ↓ 32 Changed 18 months ago by kkofler

Do you have any suggestions, where to put SCLs?

Somewhere far from the official Fedora repository.

There is just no way to make this concept work that is compatible with the FHS, sorry.

comment:30 in reply to: ↑ 29 Changed 18 months ago by mmaslano

Replying to kkofler:

Do you have any suggestions, where to put SCLs?

Somewhere far from the official Fedora repository.

There is just no way to make this concept work that is compatible with the FHS, sorry.

I can't agree with you on this one. We need it in Fedora for some projects. If we have fedora-scl, same as fedora-testing then fine.

comment:31 Changed 18 months ago by mrunge

Besides Fedora being upstream for derived enterprise distros, I see use cases for SCL in Fedora itself.

Fedora has a really short release cycle and upgrades in a released version are forbidden. On the other side, Fedora wants to be first and to be used for development. When updating a component, which has a lot of dependencies, it's likely to break a dep. Until now, the way has been to build parallel installable versions, where it's possible. Still, there are cases, where it's not possible, and we can not expect upstreams to upgrade from one version to another version within days after a component has been released.

OpenStack? as example, is a fast moving target, and we want to have it on top of another fast moving target. Release cycles are not coupled together, like GNOME and Fedora. So there might be a OpenStack? release shortly after Fedora's feature freeze. On the other side, if you have a OpenStack? installation, there might be a good reason not to upgrade to a later version, but there might be a compelling reason to upgrade Fedora. SCL just decouple both components.

There are so many use cases, which of course don't exist in a perfect world. Just arguing against SCL because the path looks ugly, *not right* or else is just too simple.

comment:32 in reply to: ↑ 29 Changed 18 months ago by mrunge

Replying to kkofler:

Somewhere far from the official Fedora repository.

Well, that would fit for other components as well, depending on your viewpoint: Mate, v8, MySQL,...

comment:33 Changed 18 months ago by mattdm

I talk to a lot of people about Fedora and why they do or do not run Fedora -- specifically in the cloud, but in other environments as well. The overwhelming feedback I get is that Fedora is great, but that it's hard to manage change between releases. I want to combat that.

I don't know if you have seen this blog post http://groveronline.com/2013/06/fedora-for-servers/ about using Fedora for short-lived servers, where long lifespan isn't important but the ability to re-deploy quickly is. That's great, but a missing piece is helping users' code actually still run after the redeploy. SCLs are one way to address that problem. (Specifically, SCLs of language/platform stacks.)

I don't think they're the only way to address the problem. I'm not even sure they're the best way. But of the ideas I've heard, they're the one that is "shovel ready". I'd really, really like to see that happen, because it addresses a very real need.

To give a concrete example, Rails 4 is a Fedora 20 change. This is good, and in line with our fast-moving mandate. But it means that people using Fedora must either upgrade their code on our schedule, or else leave for a different platform. I'd like them to stay. Having a Ruby 1.9.3 / Rails 3.2 SCL in Fedora will allow these users to use our platform and migrate on their own schedule.

comment:34 Changed 18 months ago by mattdm

On a separate note, I am working to combat the perception that Fedora is an unfriendly place for people who are currently outside of Fedora to collaborate and to eventually become part of Fedora. Fedora's mission is broad: to lead the advancement of free and open source software and content as a collaborative community. When we refuse to give a home to projects -- from Red Hat or any other place -- we are not fulfilling that mission.

We are also not making the world a better place in general, because these projects must have some sort of home, and without Fedora, they must find it elsewhere. I saw some discussion in the meeting logs about SCLs being something solely from Red Hat with no benefit for Fedora. Although I don't think that's true (see crucial Fedora use case in previous comment), I also don't think it matters. A lot of software we package is there to benefit various users of the project, not just a tight core of self-reflection. When we say "no", all we are doing is restricting our ability to influence the project in question in a positive way, bringing openness, transparency, and community to areas where it might not exist. If we can't find a way to do that, we're really failing ourselves.

Where there are technical problems, let's identify them and ask for or offer solutions. Where there are non-technical problems, let's exercise Fedora's "friends" value and find a way to be inclusive and positive.

comment:35 Changed 18 months ago by hhorak

  • Cc hhorak added

comment:36 Changed 18 months ago by tdawson

  • Cc tdawson@… added

comment:37 Changed 17 months ago by jdulaney

  • Cc j_dulaney@… added

comment:38 Changed 17 months ago by tadej

  • Cc tadej.janez@… added

comment:39 Changed 17 months ago by toshio

At last week's meeting we approved part of this draft: https://fedoraproject.org/wiki/User:Toshio/SCL_Guidelines_(draft)#SCL_Approval

#info SCL Approval section minus SCL Retirement section (will be voted on later) approved (+1:5, 0:0, -1:0)

We also discussed some other areas of the draft. All of these should now be on the mailing list for discussion:

comment:40 Changed 17 months ago by toshio

At last week's meeting we approved the retirement section of the draft.

#info retirement section of SCL draft approved (+1:5, 0:0, -1:0)

We also took a definitive vote on dots in version:

#info Agreed that the version portion of scl names must include dots. (+1:5, 0:1, -1:0)

The one dissenter would prefer not to have SCLs in Fedora until they have seen further use outside of Fedora.

Lastly, I asked if anyone had changed their minds about using /opt due to notting's comments: https://lists.fedoraproject.org/pipermail/packaging/2013-November/009728.html No one had. It looks like there will still be discussion of this on the mailing list this week as FHS may make a change which could influence some of FPC as well.

comment:41 Changed 17 months ago by herrold

  • Cc herrold@… added

comment:42 Changed 15 months ago by toshio

Talked with one of the LSB members after yesterday's LSB meeting regarding the /opt patch I proposed. Here's what he said:

<abadger1999> orc_fedo: If I might ask a question -- the last comment on my FHS /opt ticket is that it was discussed in triage... was there any feedback that I should act upon?
<abadger1999> https://bugs.linuxfoundation.org/show_bug.cgi?id=1164#c9
<orc_fedo> abadger1999: it is triaged .. fix will follow 5 issuance most prolly
<abadger1999> orc_fedo: Okay -- so that means the patch is acceptable; just won't be in an LSB/FHS release until later?
<orc_fedo> abadger1999: the patch has some verbiage that was not standards like, but rather behavioual 'best practices' that needed to be cleaned to match FHS style as I recall .. functionally it is correct
<orc_fedo> the bug as filed really covers two things - the /opt path stuff as to fedora, and some opt path stuff as a general rule
<orc_fedo> we are not so good about splitting bugs , esp as it is in the old tracker ;)
<orc_fedo> s/filed/developed/
<orc_fedo> I think comment 2, 3 and 4 in the bug basically says it is fine
<abadger1999> orc_fedo: Cool, thanks.  If there's any rewriting that you need me to do, just let me know.

So this isn't a guarantee that the change will go in but it's a good sign that it will likely be accepted in some form. Actually getting it in will likely be looked at after the release of LSB 5 (that's their priority right now).

FPC members (limburgher, I remember you specifically were willing to vote for /opt if this change went into FHS), is this sufficient for you? We'd probably note it as an exception to the FHS with the justification that the FHS is going to be updated on this point (with a link to the LSB bugzilla ticket).

comment:43 Changed 14 months ago by toshio

#action Add a temporary FHS exception to allow scls to use /opt/$vendor subdirs (+1:5, 0:0, -1:0)

So we've cleared that hurdle. We can use things like /opt/fedoraproject. Need to get a name registered with LANANA -- I'll talk with spot about that.

comment:44 Changed 14 months ago by ankursinha

  • Cc sanjay.ankur@… added

comment:45 Changed 10 months ago by mmaslano

List of blockers:

1/ Change the vendor string to match this

  • we need /opt/fedora instead of /opt/rh. It should be done in such way that Fedora SCL and RH SCL could run both fine on Fedora.

SOLVED - it will be in new scl-utils release

2/ /opt/fedora is still not registered, at least I didn't find any bug about it. The closest bug about FHS and Fedora is https://bugs.linuxfoundation.org/show_bug.cgi?id=1164

ACTION: should I open a ticket on linuxfoundation by myself or ask FESCo for guidance?

3/ Change _sysconfdir/rpm to the rpm macrodir in /usr/lib and NFS mount jzeleny: changing the macro dir should not be a problem, however all collections have to be rebuilt for it to have any effect

SOLVED - it will be in new scl-utils release

4/ %scl_name appears in the metapackage template

  • scl_name macro is not used anymore

ACTION: marcela will update template and let know FPC

5/ naming SCL team would like to discuss new naming proposal further, because there were also requests from users, which can't be fulfilled by current proposal

comment:46 Changed 10 months ago by toshio

I've pinged the LSB people and got a reply from Jeff Licquia. @spot: He says he's going to process his backlog of LANANA requests this week. If you don't get an email from him about it being done, feel free to ping him next week (IRC: licquia) and he'll dig out our specific request.

comment:47 Changed 10 months ago by mmaslano

I have a strange feeling no-one is reading packaging list. I wrote there more than two weeks ago such ticket doesn't exist and last week I created my own. Jeff took it.

<quote from packaging mail> I didn't receive any reply from anyone for more than two weeks, so I've asked for registration: https://lsbbugs.linuxfoundation.org/show_bug.cgi?id=3988

If someone believe (s)he should be the primary contact, then please log into the bugzilla and ask there directly. </quote>

comment:48 Changed 10 months ago by toshio

Apologies, I saw the original email but not your followup on Wednesday. I had already been in touch with Jeff on IRC by that time.

As for whether there should be a ticket -- the LANANA web page says that the way to get a new vendor entry is to send email rather than filing a ticket. It's certainly nicer to check for status on a ticket so perhaps the instructions should be changed.

http://www.lanana.org/lsbreg/instructions.html

comment:49 Changed 9 months ago by vondruch

Dear FPC,

I was trying to stay away from this discussion for a long time, but seeing log from yesterday with proposals such as "SCL packages must be separate packages, not separate branches in the git repos" I really wonder who will go and maintain any SCL in Fedora. It seems you try to make it as hard as possible, without thinking about sustainable evolution and maintenance of collections etc.

Let me remind you current guideline about SCL macros [1]. In that light I'll try to give you an example. Lets assume I have Ruby 2.0.0 in F20, which already contains every possible SCL macro and can build as a collection package. Now I'll prepare Ruby 2.1 for F21. So it would be natural to branch the Ruby 2.0.0 and keep them in repository and put Ruby 2.1 into the master for F21.

But now, it is not possible. Although the package was fine for F20, you try to make a re-review for making it F21 collection package. What is the reason? Why don't you keep people on focusing on important issues? This will lead just to formal reviews, where somebody click on some button, maybe run fedora-review above the package but that is it. It is just bureaucracy.

Also, if there should be some security update, or some packaging update, it is quite common, that the patch needs to be applied into all versions of the package, but keeping the packages in separate repositories makes it much harder. We are using Git but this approach of several repositories reminds me CVS era.

Finally, I understand our tooling is not good enough, you cannot delete private branches [2, 3], etc, but it seems that instead of improving the tooling, it is used against any progress.

As of now, I can't see how ruby193 SCL [4, 5] could get into Fedora ever, since you have not removed any obstacle in a way so far, but build others. You more or less ignore every knowledge and expertise we gained during development of SCLs in Red Hat and release of RHSCL for RHEL. The only think you achieved so far is that you pushed us forward to build softwarecollections.org. Well done guys.

I really admire Marcela, that she haven't completely gave up yet, but you are close to that point as far as I can tell.

[1] https://fedoraproject.org/wiki/Packaging:Guidelines#Software_Collection_Macros
[2] https://fedorahosted.org/rel-eng/ticket/5622
[3] https://fedorahosted.org/fesco/ticket/1321
[4] https://fedoraproject.org/wiki/Changes/Ruby193_in_SCL [5] https://fedorahosted.org/fpc/ticket/419

comment:50 Changed 9 months ago by vondruch

  • Cc vondruch added

comment:51 Changed 9 months ago by toshio

Since there was some confusion in other venues about the direction of SCLs in relation to mainstream packaging, at last week's FPC meeting we passed:

https://fedoraproject.org/wiki/User:Toshio/SCL_Macros_Change

#info https://fedoraproject.org/wiki/User:Toshio/SCL_Macros_Change which makes for strict separation between mainstream and SCLized packages (+1:5, 0:0, -1:0)

Hopefully that will stop us from having to do even more work in the future to revert changes to mainstream versions of packages.

We also started voting on whether to recommend to releng that the SCL packages need to be placed in separate package/git repos or in the same branch. Since more votes are needed for that one, I've created a new ticket to track those votes. I'll send the results to releng once completed:

EDIT: Correct link to voting ticket: https://fedorahosted.org/fpc/ticket/444

Last edited 9 months ago by toshio (previous) (diff)

comment:52 Changed 9 months ago by toshio

Sorry, the link to the ticket to vote is: https://fedorahosted.org/fpc/ticket/444

comment:53 follow-up: ↓ 54 Changed 9 months ago by toshio

@vondruch - the FPC discussion about making SCL Guidelines quickly settled on having separation of SCL and mainstream spec files similar to how mingw packages are managed. We officially voted on that at last week's meeting and changed the guidelines you're pointing to.

The need for re-review (although always assumed in FPC) was recently affirmed around discussion in this rel-eng ticket: https://fedorahosted.org/rel-eng/ticket/5894 Comment that has a large amount of the rationale is here: https://fedorahosted.org/rel-eng/ticket/5894#comment:26

It's odd that you talk about people being unwilling to refuse to improve tooling. I've been feeling the same way about the people pushing for SCL inclusion. FPC has talked about the things we'd like and the things we'd need in order to have SCLs in Fedora. But instead of working on improving rel-eng and infra code and to a lesser degree working on scl-utils (We've been blocked on this bug for months: https://bugzilla.redhat.com/show_bug.cgi?id=1066665 ) to make those things possible we've just heard the same arguments denigrating FPC's efforts over and over.

comment:54 in reply to: ↑ 53 Changed 9 months ago by vondruch

Replying to toshio:

@vondruch - the FPC discussion about making SCL Guidelines quickly settled on having separation of SCL and mainstream spec files similar to how mingw packages are managed. We officially voted on that at last week's meeting and changed the guidelines you're pointing to.

That decision is against basic design goal of SCLs! The first assumption of any SCL package is that it should be as simple as possible to build as regular package or SCL package. If you treat SCL package as different package, it is not that simple anymore. You assumptions makes the packages diverge much easier than necessary.

The need for re-review (although always assumed in FPC) was recently affirmed around discussion in this rel-eng ticket: https://fedorahosted.org/rel-eng/ticket/5894 Comment that has a large amount of the rationale is here: https://fedorahosted.org/rel-eng/ticket/5894#comment:26

This is *your* opinion. The only other person explicitly in favor of reviews in that thread is mattdm.

Actually, you might be surprised that I like reviews, but as long as you don't mandate review of every rebased package, or even every change in package, then this is just bureaucracy. If you take into account, that one RoR collection is more then 50 package, then I can't imagine, that somebody will spend his time and do the reviews carefully enough to be worthwhile. These reviews just decrease quality of the reviews and morale of reviewers.

It's odd that you talk about people being unwilling to refuse to improve tooling. I've been feeling the same way about the people pushing for SCL inclusion. FPC has talked about the things we'd like and the things we'd need in order to have SCLs in Fedora. But instead of working on improving rel-eng and infra code and to a lesser degree working on scl-utils (We've been blocked on this bug for months: https://bugzilla.redhat.com/show_bug.cgi?id=1066665 ) to make those things possible we've just heard the same arguments denigrating FPC's efforts over and over.

I agree that scl-utils are not evolving as fast as they should and as we'd like. There is not much I can do about that.

You might call my arguments denigrating, but this [1] is first ticket I remember about SCLs in Fedora. It was opened almost 2.5 years ago. Where we moved since that time? Nowhere. I just see basic disagreement between SCL proponents and FPC.

[1] https://fedorahosted.org/fpc/ticket/141

comment:55 Changed 9 months ago by mmaslano

I must agree with vondruch in all points. The communication between us didn't lead to our goal. We should continue through mediator.

comment:56 Changed 9 months ago by msuchy

If you take into account, that one RoR collection is more then 50 package, then I can't imagine, that somebody will spend his time and do the reviews carefully enough to be worthwhile. These reviews just decrease quality of the reviews and morale of reviewers.

+1

comment:57 Changed 9 months ago by mbooth

  • Cc mbooth@… added
Note: See TracTickets for help on using tickets.