diff mbox series

[meta-*] reproducibility: move repro excludes from AB config.json to meta-oe

Message ID 20240424114158.4102856-1-yoann.congal@smile.fr
State Accepted
Headers show
Series [meta-*] reproducibility: move repro excludes from AB config.json to meta-oe | expand

Commit Message

Yoann Congal April 24, 2024, 11:41 a.m. UTC 
For now, the known non-reproducible packages list is stored inside the
autobuilder config.json file. This is not ideal. Let's move this list
into each layers of meta-openembedded.

These lists can be used with, in local.conf:
  include conf/include/non-repro-meta-oe.inc
  OEQA_REPRODUCIBLE_EXCLUDED_PACKAGES = "${KNOWN_NON_REPRO_META_OE}"

Signed-off-by: Yoann Congal <yoann.congal@smile.fr>
---
Cc: Richard Purdie <richard.purdie@linuxfoundation.org>
Cc: Khem Raj <raj.khem@gmail.com>
Richard, Khem: The next step will be to move the current AB config to use these
files. And then, continue to cleanup reproducibility errors.
---
 .../include/non-repro-meta-filesystem.inc     |   9 ++
 .../conf/include/non-repro-meta-gnome.inc     |  13 +++
 .../conf/include/non-repro-meta-initramfs.inc |  23 ++++
 .../include/non-repro-meta-multimedia.inc     |  15 +++
 .../include/non-repro-meta-networking.inc     |  59 ++++++++++
 meta-oe/conf/include/non-repro-meta-oe.inc    | 107 ++++++++++++++++++
 .../conf/include/non-repro-meta-perl.inc      |  10 ++
 .../conf/include/non-repro-meta-python.inc    |  22 ++++
 .../conf/include/non-repro-meta-webserver.inc |   7 ++
 .../conf/include/non-repro-meta-xfce.inc      |   7 ++
 10 files changed, 272 insertions(+)
 create mode 100644 meta-filesystems/conf/include/non-repro-meta-filesystem.inc
 create mode 100755 meta-gnome/conf/include/non-repro-meta-gnome.inc
 create mode 100755 meta-initramfs/conf/include/non-repro-meta-initramfs.inc
 create mode 100755 meta-multimedia/conf/include/non-repro-meta-multimedia.inc
 create mode 100755 meta-networking/conf/include/non-repro-meta-networking.inc
 create mode 100755 meta-oe/conf/include/non-repro-meta-oe.inc
 create mode 100755 meta-perl/conf/include/non-repro-meta-perl.inc
 create mode 100755 meta-python/conf/include/non-repro-meta-python.inc
 create mode 100755 meta-webserver/conf/include/non-repro-meta-webserver.inc
 create mode 100755 meta-xfce/conf/include/non-repro-meta-xfce.inc

Comments

Richard Purdie April 24, 2024, 12:48 p.m. UTC | #1 
On Wed, 2024-04-24 at 13:41 +0200, Yoann Congal wrote:
> For now, the known non-reproducible packages list is stored inside
> the
> autobuilder config.json file. This is not ideal. Let's move this list
> into each layers of meta-openembedded.
> 
> These lists can be used with, in local.conf:
>   include conf/include/non-repro-meta-oe.inc
>   OEQA_REPRODUCIBLE_EXCLUDED_PACKAGES = "${KNOWN_NON_REPRO_META_OE}"
> 
> Signed-off-by: Yoann Congal <yoann.congal@smile.fr>
> ---
> Cc: Richard Purdie <richard.purdie@linuxfoundation.org>
> Cc: Khem Raj <raj.khem@gmail.com>
> Richard, Khem: The next step will be to move the current AB config to
> use these
> files. And then, continue to cleanup reproducibility errors.

Acked-by: Richard Purdie <richard.purdie@linuxfoundation.org>

Thanks for doing this, this should make issues more visible to people
and easier to update the lists as things change!

Cheers,

Richard
Khem Raj April 24, 2024, 1:19 p.m. UTC | #2 
On Wed, Apr 24, 2024 at 2:48 PM Richard Purdie <
richard.purdie@linuxfoundation.org> wrote:

> On Wed, 2024-04-24 at 13:41 +0200, Yoann Congal wrote:
> > For now, the known non-reproducible packages list is stored inside
> > the
> > autobuilder config.json file. This is not ideal. Let's move this list
> > into each layers of meta-openembedded.
> >
> > These lists can be used with, in local.conf:
> >   include conf/include/non-repro-meta-oe.inc
> >   OEQA_REPRODUCIBLE_EXCLUDED_PACKAGES = "${KNOWN_NON_REPRO_META_OE}"
> >
> > Signed-off-by: Yoann Congal <yoann.congal@smile.fr>
> > ---
> > Cc: Richard Purdie <richard.purdie@linuxfoundation.org>
> > Cc: Khem Raj <raj.khem@gmail.com>
> > Richard, Khem: The next step will be to move the current AB config to
> > use these
> > files. And then, continue to cleanup reproducibility errors.
>
> Acked-by: Richard Purdie <richard.purdie@linuxfoundation.org>
>
> Thanks for doing this, this should make issues more visible to people
> and easier to update the lists as things change!
>

Agreed


> Cheers,
>
> Richard
>
diff mbox series

Patch

diff --git a/meta-filesystems/conf/include/non-repro-meta-filesystem.inc b/meta-filesystems/conf/include/non-repro-meta-filesystem.inc
new file mode 100644
index 0000000000..50facbf174
--- /dev/null
+++ b/meta-filesystems/conf/include/non-repro-meta-filesystem.inc
@@ -0,0 +1,9 @@ 
+# List of known non-reproducible package of the meta-filesystem layer
+# Please keep this list sorted
+KNOWN_NON_REPRO_META_FILESYSTEMS = " \
+    e2tools-ptest \
+    xfsprogs-doc \
+    zfs \
+    zfs-dbg \
+    zfs-dev \
+"
diff --git a/meta-gnome/conf/include/non-repro-meta-gnome.inc b/meta-gnome/conf/include/non-repro-meta-gnome.inc
new file mode 100755
index 0000000000..553bc32cc6
--- /dev/null
+++ b/meta-gnome/conf/include/non-repro-meta-gnome.inc
@@ -0,0 +1,13 @@ 
+# List of known non-reproducible package of the meta-gnome layer
+# Please keep this list sorted
+KNOWN_NON_REPRO_META_GNOME = " \
+    geary \
+    geary-dbg \
+    gegl-dev \
+    gimp \
+    gimp-dbg \
+    gnome-terminal-src \
+    grilo-src \
+    gtk-vnc-src \
+    ibus \
+"
diff --git a/meta-initramfs/conf/include/non-repro-meta-initramfs.inc b/meta-initramfs/conf/include/non-repro-meta-initramfs.inc
new file mode 100755
index 0000000000..8f01f5624b
--- /dev/null
+++ b/meta-initramfs/conf/include/non-repro-meta-initramfs.inc
@@ -0,0 +1,23 @@ 
+# List of known non-reproducible package of the meta-initramfs layer
+# Please keep this list sorted
+KNOWN_NON_REPRO_META_INITRAMFS = " \
+    kexecboot-klibc \
+    kexecboot-klibc-dbg \
+    kexec-klibc \
+    kexec-tools-klibc-dbg \
+    mtdinfo-klibc \
+    ubiattach-klibc \
+    ubiblock-klibc \
+    ubicrc32-klibc \
+    ubidetach-klibc \
+    ubiformat-klibc \
+    ubimkvol-klibc \
+    ubinfo-klibc \
+    ubinize-klibc \
+    ubirename-klibc \
+    ubirmvol-klibc \
+    ubirsvol-klibc \
+    ubiupdatevol-klibc \
+    ubi-utils-klibc-dbg \
+    vmcore-dmesg-klibc \
+"
diff --git a/meta-multimedia/conf/include/non-repro-meta-multimedia.inc b/meta-multimedia/conf/include/non-repro-meta-multimedia.inc
new file mode 100755
index 0000000000..b02de42eb9
--- /dev/null
+++ b/meta-multimedia/conf/include/non-repro-meta-multimedia.inc
@@ -0,0 +1,15 @@ 
+# List of known non-reproducible package of the meta-multimedia layer
+# Please keep this list sorted
+KNOWN_NON_REPRO_META_MULTIMEDIA = " \
+    crossguid \
+    libcamera \
+    libcamera-dbg \
+    libcamera-src \
+    libgssdp-1.6-src \
+    libgupnp-1.6-src \
+    libsquish-staticdev \
+    oscam \
+    oscam-dbg \
+    oscam-src \
+    rtmpdump-staticdev \
+"
diff --git a/meta-networking/conf/include/non-repro-meta-networking.inc b/meta-networking/conf/include/non-repro-meta-networking.inc
new file mode 100755
index 0000000000..e0f448fe31
--- /dev/null
+++ b/meta-networking/conf/include/non-repro-meta-networking.inc
@@ -0,0 +1,59 @@ 
+# List of known non-reproducible package of the meta-networking layer
+# Please keep this list sorted
+KNOWN_NON_REPRO_META_NETWORKING = " \
+    blueman \
+    blueman-dbg \
+    blueman-src \
+    civetweb-dev \
+    dhcp-relay-staticdev \
+    ettercap-src \
+    fetchmail \
+    fetchmail-dbg \
+    freediameter \
+    freediameter-src \
+    freeradius \
+    htpdate-doc \
+    keepalived \
+    keepalived-dbg \
+    kernel-module-mdio-netlink-6.6.17-yocto-standard \
+    libbearssl-staticdev \
+    libfko3 \
+    libfko-client \
+    libfko-daemon \
+    libfko-dbg \
+    libmosquitto1 \
+    libowfat-staticdev \
+    libruli-staticdev \
+    libsamba-util0 \
+    mdio-netlink-dbg \
+    mosquitto \
+    mosquitto-dbg \
+    ncftp \
+    ncftp-dbg \
+    ncftp-src \
+    ndisc6-dbg \
+    ndisc6-misc \
+    ndisc6-ndisc6 \
+    ndisc6-rdisc6 \
+    ndisc6-rdnssd \
+    ndisc6-rltraceroute6 \
+    netsniff-ng-doc \
+    ntpsec-src \
+    openl2tp \
+    openl2tp-dbg \
+    ot-br-posix \
+    ot-br-posix-dbg \
+    postfix-cfg \
+    proftpd \
+    proftpd-dbg \
+    proftpd-dev \
+    rdist \
+    rdist-dbg \
+    samba-dbg \
+    tayga \
+    tayga-dbg \
+    wolfssl \
+    wolfssl-dbg \
+    znc \
+    znc-doc \
+"
diff --git a/meta-oe/conf/include/non-repro-meta-oe.inc b/meta-oe/conf/include/non-repro-meta-oe.inc
new file mode 100755
index 0000000000..7961d851f9
--- /dev/null
+++ b/meta-oe/conf/include/non-repro-meta-oe.inc
@@ -0,0 +1,107 @@ 
+# List of known non-reproducible package of the meta-oe layer
+# Please keep this list sorted
+KNOWN_NON_REPRO_META_OE = " \
+    boinc-client-dev \
+    cjson-ptest \
+    cpuid-doc \
+    crash \
+    crash-dbg \
+    crash-src \
+    dhrystone \
+    dhrystone-dbg \
+    dhrystone-dev \
+    dhrystone-src \
+    directfb \
+    directfb-dbg \
+    doxygen-src \
+    editorconfig-core-c-dev \
+    etcd-cpp-apiv3-dev \
+    fbgrab-doc \
+    fluentbit-src \
+    fvwm-dbg \
+    fvwm-doc \
+    fvwm-extra \
+    gcab-src \
+    gosu \
+    gosu-dbg \
+    gosu-dev \
+    gosu-staticdev \
+    gphoto2 \
+    gphoto2-dbg \
+    hddtemp-locale-de \
+    hdf5 \
+    hdf5-dbg \
+    hdf5-src \
+    hdf5-staticdev \
+    hplip \
+    hplip-dbg \
+    jpnevulator-doc \
+    jsonrpc-dev \
+    kpatch-build \
+    kpatch-doc \
+    ldns \
+    libbotan-3-bin \
+    libbotan-3-dbg \
+    libbotan-3-dev \
+    libck-doc \
+    libdbus-cxx-dev \
+    libforms \
+    libiio-src \
+    libjcat-dbg \
+    libjcat-ptest \
+    libthrift-c-glib-zlib-src \
+    libvncserver-dev \
+    libwebsockets-testapps \
+    libwmf \
+    libyui-ncurses-dbg \
+    libyui-ncurses-dev \
+    lmbench-staticdev \
+    log4cpp \
+    lprng \
+    lprng-dbg \
+    lshw \
+    lshw-locale-fr \
+    mariadb-dbg \
+    mariadb-server \
+    mariadb-src \
+    mce-test \
+    mime-support-doc \
+    minifi-cpp \
+    minifi-cpp-dbg \
+    minifi-cpp-src \
+    mozjs-115-src \
+    mpv \
+    mpv-dbg \
+    nana \
+    nbench-byte \
+    nbench-byte-dbg \
+    nbench-byte-src \
+    nspr-staticdev \
+    openocd \
+    openocd-dbg \
+    pcp \
+    pcp-dev \
+    pcp-doc \
+    pcp-src \
+    perfetto \
+    perfetto-dbg \
+    php-phar \
+    pidgin \
+    pidgin-dbg \
+    pim435-staticdev \
+    postgresql-server-dev \
+    qcbor-staticdev \
+    sharutils \
+    sharutils-dbg \
+    smemstat-doc \
+    soci-dev \
+    thin-provisioning-tools-dev \
+    vulkan-cts \
+    vulkan-cts-dbg \
+    waylandpp-dev \
+    yasm-src \
+    zlog-staticdev \
+    zsh \
+    zsh-dbg \
+    zsh-src \
+"
diff --git a/meta-perl/conf/include/non-repro-meta-perl.inc b/meta-perl/conf/include/non-repro-meta-perl.inc
new file mode 100755
index 0000000000..9082691f67
--- /dev/null
+++ b/meta-perl/conf/include/non-repro-meta-perl.inc
@@ -0,0 +1,10 @@ 
+# List of known non-reproducible package of the meta-perl layer
+# Please keep this list sorted
+KNOWN_NON_REPRO_META_PERL = " \
+    libencode-perl-src \
+    libhtml-tree-perl \
+    libhtml-tree-perl-doc \
+    libmodule-build-tiny-perl \
+    po4a \
+    po4a-doc \
+"
diff --git a/meta-python/conf/include/non-repro-meta-python.inc b/meta-python/conf/include/non-repro-meta-python.inc
new file mode 100755
index 0000000000..629dc4aa04
--- /dev/null
+++ b/meta-python/conf/include/non-repro-meta-python.inc
@@ -0,0 +1,22 @@ 
+# List of known non-reproducible package of the meta-python layer
+# Please keep this list sorted
+KNOWN_NON_REPRO_META_PYTHON = " \
+    python3-evdev-src \
+    python3-frozenlist \
+    python3-frozenlist-dbg \
+    python3-kivy-src \
+    python3-pandas \
+    python3-pandas-dbg \
+    python3-pandas-src \
+    python3-pycocotools-src \
+    python3-pydantic-core \
+    python3-pynacl \
+    python3-pynacl-dbg \
+    python3-pynacl-src \
+    python3-pyproj \
+    python3-pyproj-dbg \
+    python3-pyproj-src \
+    python3-pyzmq \
+    python3-yarl \
+    python3-yarl-dbg \
+"
diff --git a/meta-webserver/conf/include/non-repro-meta-webserver.inc b/meta-webserver/conf/include/non-repro-meta-webserver.inc
new file mode 100755
index 0000000000..ee998ea961
--- /dev/null
+++ b/meta-webserver/conf/include/non-repro-meta-webserver.inc
@@ -0,0 +1,7 @@ 
+# List of known non-reproducible package of the meta-webserver layer
+# Please keep this list sorted
+KNOWN_NON_REPRO_META_WEBSERVER = " \
+    netdata \
+    netdata-dbg \
+    php-phar \
+"
diff --git a/meta-xfce/conf/include/non-repro-meta-xfce.inc b/meta-xfce/conf/include/non-repro-meta-xfce.inc
new file mode 100755
index 0000000000..aad6b0c24d
--- /dev/null
+++ b/meta-xfce/conf/include/non-repro-meta-xfce.inc
@@ -0,0 +1,7 @@ 
+# List of known non-reproducible package of the meta-xfce layer
+# Please keep this list sorted
+KNOWN_NON_REPRO_META_XFCE = " \
+    catfish \
+    libsamba-util0 \
+    samba-dbg \
+"