Subject: linux: Please build with CONFIG_KERNEL_GZIP=y instead of CONFIG_KERNEL_XZ=y on sh4
Date: Fri, 25 Apr 2025 11:38:14 +0200
Source: linux
Version: 6.12.22-1
Severity: normal
User: [email protected]
Usertags: sh4
X-Debbugs-Cc: [email protected]
Hello,
src:linux currently fails to build from source on sh4 due to the kernel
image compression set to XZ (CONFIG_KERNEL_XZ=y). I tried setting the
compression to GZIP (CONFIG_KERNEL_GZIP=y) in debian/config/sh4/config
and disabling CONFIG_KERNEL_XZ with the following configuration:
##
## file: init/Kconfig
##
## choice: Kernel compression mode
#. Decompression is done by the bootloader, so we need to be
#. conservative here.
CONFIG_KERNEL_GZIP=y
# CONFIG_KERNEL_XZ is not set
# CONFIG_KERNEL_ZSTD is not set
## end choice
## choice: Compiler optimization level
CONFIG_CC_OPTIMIZE_FOR_SIZE=y
## end choice
But for some reason that still resulted in CONFIG_KERNEL_XZ=y ending up
in the .config file of the sh7751lr kernel image.
However, I can enter the schroot after the failed build, edit the .config
files in /build/reproducible-path/linux-6.12.22/debian/build/build_sh4_none_sh7751r
and manually set CONFIG_KERNEL_GZIP=y and # CONFIG_KERNEL_XZ is not set which
makes the kernel build succeed when just running "make".
Thus, could you modify the configuration on sh4 such that the kernel is
compressed with GZIP instead of XZ (and ZSTD) by default so that the
kernel package builds again on sh4?
Using XZ doesn't make sense on sh4 with its small image sizes anyway.
Thanks,
Adrian
--
.''`. John Paul Adrian Glaubitz
: :' : Debian Developer
`. `' Physicist
`- GPG: 62FF 8A75 84E0 2956 9546 0006 7426 3B37 F5B5 F913
Acknowledgement sent
to Ben Hutchings <[email protected]>:
Extra info received and forwarded to list. Copy sent to Debian Kernel Team <[email protected]>.
(Fri, 02 May 2025 16:57:02 GMT) (full text, mbox, link).
Control: tag -1 moreinfo
On Fri, 25 Apr 2025 11:38:14 +0200 John Paul Adrian Glaubitz <[email protected]> wrote:
> Source: linux
> Version: 6.12.22-1
> Severity: normal
> User: [email protected]
> Usertags: sh4
> X-Debbugs-Cc: [email protected]
>
> Hello,
>
> src:linux currently fails to build from source on sh4 due to the kernel
> image compression set to XZ (CONFIG_KERNEL_XZ=y).
You didn't say exactly why xz is a problem, but looking at the logs I
see xz sometimes failing with an out-of-memory error.
Are the sh4 builds running natively?
> I tried setting the
> compression to GZIP (CONFIG_KERNEL_GZIP=y) in debian/config/sh4/config
> and disabling CONFIG_KERNEL_XZ with the following configuration:
>
> ##
> ## file: init/Kconfig
> ##
> ## choice: Kernel compression mode
> #. Decompression is done by the bootloader, so we need to be
> #. conservative here.
> CONFIG_KERNEL_GZIP=y
> # CONFIG_KERNEL_XZ is not set
> # CONFIG_KERNEL_ZSTD is not set
> ## end choice
> ## choice: Compiler optimization level
> CONFIG_CC_OPTIMIZE_FOR_SIZE=y
> ## end choice
>
> But for some reason that still resulted in CONFIG_KERNEL_XZ=y ending up
> in the .config file of the sh7751lr kernel image.
That change should work, and it does work for me.
> However, I can enter the schroot after the failed build, edit the .config
> files in /build/reproducible-path/linux-6.12.22/debian/build/build_sh4_none_sh7751r
> and manually set CONFIG_KERNEL_GZIP=y and # CONFIG_KERNEL_XZ is not set which
> makes the kernel build succeed when just running "make".
>
> Thus, could you modify the configuration on sh4 such that the kernel is
> compressed with GZIP instead of XZ (and ZSTD) by default so that the
> kernel package builds again on sh4?
>
> Using XZ doesn't make sense on sh4 with its small image sizes anyway.
Well, speaking of that, you have not yet reported back on whether my
fix-sh7785lcr branch works. I just rebased this and uploaded fresh
packages to <https://people.debian.org/~benh/packages/linux-sh4/>.
If we apply this config change on top of that, the kernel image size for
sh7785lcr will again go over the 4 MiB limit. So we would need to
either (1) trim the config further or (2) drop the sh7785lcr flavour. I
do not intend to spend more time on (1) so this is really up to you (or
other sh4 porters) now.
Ben.
--
Ben Hutchings
It's easier to fight for one's principles than to live up to them.
Acknowledgement sent
to John Paul Adrian Glaubitz <[email protected]>:
Extra info received and forwarded to list. Copy sent to Debian Kernel Team <[email protected]>.
(Fri, 02 May 2025 18:03:02 GMT) (full text, mbox, link).
Subject: Re: linux: Please build with CONFIG_KERNEL_GZIP=y instead of
CONFIG_KERNEL_XZ=y on sh4
Date: Fri, 02 May 2025 19:59:02 +0200
Hi,
On Fri, 2025-05-02 at 18:54 +0200, Ben Hutchings wrote:
> > src:linux currently fails to build from source on sh4 due to the kernel
> > image compression set to XZ (CONFIG_KERNEL_XZ=y).
>
> You didn't say exactly why xz is a problem, but looking at the logs I
> see xz sometimes failing with an out-of-memory error.
Sorry, I thought I mentioned this.
> Are the sh4 builds running natively?
They're qemu-based except for tirpitz which is a native machine (actual hardware)
> > I tried setting the
> > compression to GZIP (CONFIG_KERNEL_GZIP=y) in debian/config/sh4/config
> > and disabling CONFIG_KERNEL_XZ with the following configuration:
> >
> > ##
> > ## file: init/Kconfig
> > ##
> > ## choice: Kernel compression mode
> > #. Decompression is done by the bootloader, so we need to be
> > #. conservative here.
> > CONFIG_KERNEL_GZIP=y
> > # CONFIG_KERNEL_XZ is not set
> > # CONFIG_KERNEL_ZSTD is not set
> > ## end choice
> > ## choice: Compiler optimization level
> > CONFIG_CC_OPTIMIZE_FOR_SIZE=y
> > ## end choice
> >
> > But for some reason that still resulted in CONFIG_KERNEL_XZ=y ending up
> > in the .config file of the sh7751lr kernel image.
>
> That change should work, and it does work for me.
>
> > However, I can enter the schroot after the failed build, edit the .config
> > files in /build/reproducible-path/linux-6.12.22/debian/build/build_sh4_none_sh7751r
> > and manually set CONFIG_KERNEL_GZIP=y and # CONFIG_KERNEL_XZ is not set which
> > makes the kernel build succeed when just running "make".
> >
> > Thus, could you modify the configuration on sh4 such that the kernel is
> > compressed with GZIP instead of XZ (and ZSTD) by default so that the
> > kernel package builds again on sh4?
> >
> > Using XZ doesn't make sense on sh4 with its small image sizes anyway.
>
> Well, speaking of that, you have not yet reported back on whether my
> fix-sh7785lcr branch works. I just rebased this and uploaded fresh
> packages to <https://people.debian.org/~benh/packages/linux-sh4/>.
>
> If we apply this config change on top of that, the kernel image size for
> sh7785lcr will again go over the 4 MiB limit. So we would need to
> either (1) trim the config further or (2) drop the sh7785lcr flavour. I
> do not intend to spend more time on (1) so this is really up to you (or
> other sh4 porters) now.
Yes, this is still on my TODO list and I have not forgotten it. I will eventually
come back to this. Currently, the main priority is maintaining the kernel upstream
as well as getting the SH backend in GCC converted to LRA which is coordinated with
people from the Dreamcast community.
Adrian
--
.''`. John Paul Adrian Glaubitz
: :' : Debian Developer
`. `' Physicist
`- GPG: 62FF 8A75 84E0 2956 9546 0006 7426 3B37 F5B5 F913
Acknowledgement sent
to Ben Hutchings <[email protected]>:
Extra info received and forwarded to list. Copy sent to Debian Kernel Team <[email protected]>.
(Fri, 02 May 2025 18:12:02 GMT) (full text, mbox, link).
Control: tag -1 - moreinfo
On Fri, 2025-05-02 at 19:59 +0200, John Paul Adrian Glaubitz wrote:
> Hi,
>
> On Fri, 2025-05-02 at 18:54 +0200, Ben Hutchings wrote:
[...]
> >
> > > Using XZ doesn't make sense on sh4 with its small image sizes anyway.
> >
> > Well, speaking of that, you have not yet reported back on whether my
> > fix-sh7785lcr branch works. I just rebased this and uploaded fresh
> > packages to <https://people.debian.org/~benh/packages/linux-sh4/>.
> >
> > If we apply this config change on top of that, the kernel image size for
> > sh7785lcr will again go over the 4 MiB limit. So we would need to
> > either (1) trim the config further or (2) drop the sh7785lcr flavour. I
> > do not intend to spend more time on (1) so this is really up to you (or
> > other sh4 porters) now.
>
> Yes, this is still on my TODO list and I have not forgotten it. I will eventually
> come back to this. Currently, the main priority is maintaining the kernel upstream
> as well as getting the SH backend in GCC converted to LRA which is coordinated with
> people from the Dreamcast community.
Then I will drop that flavour, and you can re-add it when you are ready
to do so.
Ben.
--
Ben Hutchings
Absolutum obsoletum. (If it works, it's out of date.) - Stafford Beer
Acknowledgement sent
to John Paul Adrian Glaubitz <[email protected]>:
Extra info received and forwarded to list. Copy sent to Debian Kernel Team <[email protected]>.
(Fri, 02 May 2025 18:12:02 GMT) (full text, mbox, link).
Subject: Re: linux: Please build with CONFIG_KERNEL_GZIP=y instead of
CONFIG_KERNEL_XZ=y on sh4
Date: Fri, 02 May 2025 20:10:02 +0200
On Fri, 2025-05-02 at 20:08 +0200, Ben Hutchings wrote:
> > Yes, this is still on my TODO list and I have not forgotten it. I will eventually
> > come back to this. Currently, the main priority is maintaining the kernel upstream
> > as well as getting the SH backend in GCC converted to LRA which is coordinated with
> > people from the Dreamcast community.
>
> Then I will drop that flavour, and you can re-add it when you are ready
> to do so.
Why do you need to drop it? I don't understand the reasoning behind it.
Does it hurt in any way when that flavor is being built?
Adrian
--
.''`. John Paul Adrian Glaubitz
: :' : Debian Developer
`. `' Physicist
`- GPG: 62FF 8A75 84E0 2956 9546 0006 7426 3B37 F5B5 F913
Acknowledgement sent
to Ben Hutchings <[email protected]>:
Extra info received and forwarded to list. Copy sent to Debian Kernel Team <[email protected]>.
(Fri, 02 May 2025 18:15:02 GMT) (full text, mbox, link).
On Fri, 2025-05-02 at 20:10 +0200, John Paul Adrian Glaubitz wrote:
> On Fri, 2025-05-02 at 20:08 +0200, Ben Hutchings wrote:
> > > Yes, this is still on my TODO list and I have not forgotten it. I will eventually
> > > come back to this. Currently, the main priority is maintaining the kernel upstream
> > > as well as getting the SH backend in GCC converted to LRA which is coordinated with
> > > people from the Dreamcast community.
> >
> > Then I will drop that flavour, and you can re-add it when you are ready
> > to do so.
>
> Why do you need to drop it? I don't understand the reasoning behind it.
>
> Does it hurt in any way when that flavor is being built?
We know that it currently can't work. So it is wasting the time of the
builders and of anyone who tries to use it.
Ben.
--
Ben Hutchings
Absolutum obsoletum. (If it works, it's out of date.) - Stafford Beer
Acknowledgement sent
to John Paul Adrian Glaubitz <[email protected]>:
Extra info received and forwarded to list. Copy sent to Debian Kernel Team <[email protected]>.
(Fri, 02 May 2025 18:15:03 GMT) (full text, mbox, link).
Subject: Re: linux: Please build with CONFIG_KERNEL_GZIP=y instead of
CONFIG_KERNEL_XZ=y on sh4
Date: Fri, 02 May 2025 20:13:51 +0200
On Fri, 2025-05-02 at 20:12 +0200, Ben Hutchings wrote:
> > Why do you need to drop it? I don't understand the reasoning behind it.
> >
> > Does it hurt in any way when that flavor is being built?
>
> We know that it currently can't work. So it is wasting the time of the
> builders and of anyone who tries to use it.
I'm maintaining those builders and I'm fine with that. It allows me to catch
regressions when looking at build logs.
Adrian
--
.''`. John Paul Adrian Glaubitz
: :' : Debian Developer
`. `' Physicist
`- GPG: 62FF 8A75 84E0 2956 9546 0006 7426 3B37 F5B5 F913
Acknowledgement sent
to Ben Hutchings <[email protected]>:
Extra info received and forwarded to list. Copy sent to Debian Kernel Team <[email protected]>.
(Fri, 02 May 2025 18:27:01 GMT) (full text, mbox, link).
On Fri, 2025-05-02 at 20:13 +0200, John Paul Adrian Glaubitz wrote:
> On Fri, 2025-05-02 at 20:12 +0200, Ben Hutchings wrote:
> > > Why do you need to drop it? I don't understand the reasoning behind it.
> > >
> > > Does it hurt in any way when that flavor is being built?
> >
> > We know that it currently can't work. So it is wasting the time of the
> > builders and of anyone who tries to use it.
>
> I'm maintaining those builders and I'm fine with that. It allows me to catch
> regressions when looking at build logs.
There is nothing stopping you from doing your own kernel builds to test
whatever configuration and drivers you want.
Meanwhile in src:linux I think we only want to provide configurations
that are actually useful.
Ben.
--
Ben Hutchings
Absolutum obsoletum. (If it works, it's out of date.) - Stafford Beer
Acknowledgement sent
to Ben Hutchings <[email protected]>:
Extra info received and forwarded to list. Copy sent to Debian Kernel Team <[email protected]>.
(Fri, 02 May 2025 18:57:03 GMT) (full text, mbox, link).
On Fri, 2025-05-02 at 18:54 +0200, Ben Hutchings wrote:
> Control: tag -1 moreinfo
>
> On Fri, 25 Apr 2025 11:38:14 +0200 John Paul Adrian Glaubitz <[email protected]> wrote:
> > Source: linux
> > Version: 6.12.22-1
> > Severity: normal
> > User: [email protected]
> > Usertags: sh4
> > X-Debbugs-Cc: [email protected]
> >
> > Hello,
> >
> > src:linux currently fails to build from source on sh4 due to the kernel
> > image compression set to XZ (CONFIG_KERNEL_XZ=y).
>
> You didn't say exactly why xz is a problem, but looking at the logs I
> see xz sometimes failing with an out-of-memory error.
[...]
By the way, this seems to be due to:
commit 8653c909922743bceb4800e5cc26087208c9e0e6
Author: Lasse Collin <[email protected]>
Date: Sun Jul 21 16:36:28 2024 +0300
xz: use 128 MiB dictionary and force single-threaded mode
which causes xz to allocate 1346 MiB (!) at build time.
If you have the time, it might be worth trying to add an option to use a
smaller dictionary size again.
Ben.
--
Ben Hutchings
Absolutum obsoletum. (If it works, it's out of date.) - Stafford Beer
Reply sent
to Salvatore Bonaccorso <[email protected]>:
You have taken responsibility.
(Fri, 09 May 2025 20:45:05 GMT) (full text, mbox, link).
Notification sent
to John Paul Adrian Glaubitz <[email protected]>:
Bug acknowledged by developer.
(Fri, 09 May 2025 20:45:05 GMT) (full text, mbox, link).
Source: linux
Source-Version: 6.14.6-1~exp1
Done: Salvatore Bonaccorso <[email protected]>
We believe that the bug you reported is fixed in the latest version of
linux, which is due to be installed in the Debian FTP archive.
A summary of the changes between this version and the previous one is
attached.
Thank you for reporting the bug, which will now be closed. If you
have further comments please address them to [email protected],
and the maintainer will reopen the bug report if appropriate.
Debian distribution maintenance software
pp.
Salvatore Bonaccorso <[email protected]> (supplier of updated linux package)
(This message was generated automatically at their request; if you
believe that there is a problem with it please contact the archive
administrators by mailing [email protected])
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA512
Format: 1.8
Date: Fri, 09 May 2025 21:32:33 +0200
Source: linux
Architecture: source
Version: 6.14.6-1~exp1
Distribution: experimental
Urgency: medium
Maintainer: Debian Kernel Team <[email protected]>
Changed-By: Salvatore Bonaccorso <[email protected]>
Closes: 9487829891531027861103666610418911104080
Changes:
linux (6.14.6-1~exp1) experimental; urgency=medium
.
* New upstream stable update:
https://www.kernel.org/pub/linux/kernel/v6.x/ChangeLog-6.14.6
.
[ Alper Nebi Yasak ]
* [arm64] udeb: Add mtk-cmdq-mailbox to kernel-image
.
[ Ben Hutchings ]
* lintian: Override some false positives:
- linux-headers: Override another error and warning for vmlinux
- [riscv64] linux-image-dbg: Override shared-library-lacks-stack-section
for vdso.so
- [arm64] linux-perf: Override statically-linked-binary for asm_pure_loop
* [ppc64*] linux-image: Fix version in NEWS entry
* linux-source: Suggest pkgconf, not the obsolete pkg-config
* linux-image-dbg: lintian: Drop mismatched override for
wrong-section-according-to-package-name
* [amd64] linux-image-cloud-amd64-dbg: lintian: Drop overrides for vdsox32.so
* d/copyright: Replace old FSF addresses with current GNU license URL
* d/rules.real: Exclude vDSOs from processing by dh_makeshlibs
* linux-doc: Use dh_sphinxdoc to replace embedded Javascript
* [sh4] Disable sh7785lcr flavour which is broken due to size limits
* [sh4] Enable KERNEL_GZIP instead of KERNEL_XZ (Closes: #1104080)
.
[ Salvatore Bonaccorso ]
* net/ipv6: Enable IPV6_RPL_LWTUNNEL (Closes: #1027861)
* init: Enable UCLAMP_TASK and UCLAMP_TASK_GROUP (Utilization clamping)
(Closes: #1036666)
* drivers/md: Enable DM_CLONE as module (Closes: #948782)
.
[ Ross Vandegrift ]
* drivers/char: set VIRTIO_CONSOLE=y (Closes: #989153, #1041891)
Checksums-Sha1:
8da7a783ae0b14568ad3e61893b25de74b444df4 192327 linux_6.14.6-1~exp1.dsc
4316a08e986ff651072d0b34462b7c44f0ed562c 152432644 linux_6.14.6.orig.tar.xz
915126ac95387d6dd9ef0bdcdcf71fc6a564a5e3 1528148 linux_6.14.6-1~exp1.debian.tar.xz
ac4b0333c2ea6a2ba79c7ec12c48c982894c75d7 6639 linux_6.14.6-1~exp1_source.buildinfo
Checksums-Sha256:
77a50e69e8873484277e48742394f6f907b704740c0692ffe4d9250ceb86531b 192327 linux_6.14.6-1~exp1.dsc
5f130a97b863919b3ab5ddfe6463616dee0e3ecec7b120df5d39abf78a8c4780 152432644 linux_6.14.6.orig.tar.xz
65a767846582e41adf24041bc3301f4fb44f2c56f5697be9ec62f2ed14ed77a1 1528148 linux_6.14.6-1~exp1.debian.tar.xz
64f31a31f53d55841bf4faab2b62fd36153385b5814bc6fdcf83bd1cb149f607 6639 linux_6.14.6-1~exp1_source.buildinfo
Files:
6b7901d326abd3f6a5a44ce1147110aa 192327 kernel optional linux_6.14.6-1~exp1.dsc
2bf0d885626fdd5aaedd814ea04d580e 152432644 kernel optional linux_6.14.6.orig.tar.xz
93ddf649911052999f26c5e7b3dddea4 1528148 kernel optional linux_6.14.6-1~exp1.debian.tar.xz
2b4ef27c092622ecbb561f2fa095f10d 6639 kernel optional linux_6.14.6-1~exp1_source.buildinfo
-----BEGIN PGP SIGNATURE-----
iQKmBAEBCgCQFiEERkRAmAjBceBVMd3uBUy48xNDz0QFAmgeW+JfFIAAAAAALgAo
aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDQ2
NDQ0MDk4MDhDMTcxRTA1NTMxRERFRTA1NENCOEYzMTM0M0NGNDQSHGNhcm5pbEBk
ZWJpYW4ub3JnAAoJEAVMuPMTQ89EyNAQAIC3Dr9Uocpiapz5+t2/IeSrPrMvYOx4
zTNGTTmHY6rJIqR6LhAN+jgyP80xPWlesKRKpVB5AqbCkXYM73Va6papE65Xw8so
Q8fdEdHbecgDfjJsrIBBd4Xg+sqRSQoJL+k5IxOyKlcoOxPNIY6/wLdUOgClFN5f
w5N9/wyL0VUyCiAcJfSNTmFDa2LI4xVajAR46JX+33smVgB0kmkFpCvRpl/avSDC
hmORj8xyf47s1K0wDGXquYMTF1msLaX7FIzVXwqAo65dKCTP5R+A1p3GIbgejYXi
zqjPieA4wUKye4StCadi/+dCx0XUffE3uLrOZ8nKr83vi7E9Y/w9e8qw1AyeZNLm
+s2RUU3RpSxJtlR8qMsHU8VqSWbDUdy+Ce64SciGTrB0LqThH2FB3YFM1wEhYyOV
BakehmPFRetdWTNtPlgEaUKPPCAaJ5pljZ//MG3IpnEg55QxkZhv9GJO5CRojmAX
tgUG54le48w+k8L+3XGhjEocLi7zOQeFw/2OMC+q4lkeGgvu77LhacaOx+tRkHot
9Vm7+J6MmhbmVjeTomn6c86BDVW9YUXzoVj0fd8LaQkM7X98jNMiWW2aHQZOvzgv
VWLVFSgiaYfFbAh6sb4f4TKAD9uWHV5hyciJl02X5ekzYdk7S4Y8463eImHkKgpS
J85R86LpnYDF
=qFwi
-----END PGP SIGNATURE-----
Debbugs is free software and licensed under the terms of the GNU General
Public License version 2. The current version can be obtained
from https://bugs.debian.org/debbugs-source/.