#688303 - Please support concatenated bz2 files in zlib-functions

Debian Bug report logs - #688303
Please support concatenated bz2 files in zlib-functions

Reported by: Thijs Kinkhorst <[email protected]>

Date: Fri, 21 Sep 2012 09:30:02 UTC

Severity: wishlist

Merged with 710520

Found in version bzip2/1.0.6-4

Received: (at control) by bugs.debian.org; 26 Sep 2012 14:09:46 +0000
From [email protected] Wed Sep 26 14:09:46 2012
X-Spam-Checker-Version: SpamAssassin 3.3.1-bugs.debian.org_2005_01_02
	(2010-03-16) on buxtehude.debian.org
X-Spam-Level: 
X-Spam-Status: No, score=-8.9 required=4.0 tests=BAYES_00,DKIM_SIGNED,
	DKIM_VALID,DKIM_VALID_AU,FREEMAIL_FROM,HAS_BUG_NUMBER,RCVD_IN_DNSWL_LOW,
	SPF_PASS,VALID_BTS_CONTROL autolearn=ham
	version=3.3.1-bugs.debian.org_2005_01_02
X-Spam-Bayes: score:0.0000 Tokens: new, 15; hammy, 134; neutral, 77; spammy,
	1. spammytokens:0.953-+--(unknown) hammytokens:0.000-+--(unknown),
	0.000-+--(unknown), 0.000-+--(unknown), 0.000-+--(unknown), 0.000-+--(unknown)
Return-path: <[email protected]>
Received: from mail-lb0-f180.google.com ([209.85.217.180])
	by buxtehude.debian.org with esmtps (TLS1.0:RSA_ARCFOUR_SHA1:16)
	(Exim 4.72)
	(envelope-from <[email protected]>)
	id 1TGsJ7-0000Hz-LV
	for [email protected]; Wed, 26 Sep 2012 14:09:46 +0000
Received: by lbbge1 with SMTP id ge1so1632876lbb.11
        for <[email protected]>; Wed, 26 Sep 2012 07:09:38 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20120113;
        h=mime-version:sender:in-reply-to:references:from:date
         :x-google-sender-auth:message-id:subject:to:cc:content-type;
        bh=lyUZ6I/NFBkXC8SRa/hEIgvhMw77yxpv7g4JqY2DA2o=;
        b=rHcTD5VsN9mlA3wJaorseFu3W8Q1IUFojCi1J+O1vVxO8R3z2Wwg53lwRt3XpRpnZQ
         e7I8nD+M1DczlTx7eb0GeUFZbojtCuoHHanipcepPmxfk0DKmMF0G2zAA3feTV/8m1Js
         AxrKYMcKfaQ+L3Dm6VwrG2lkvk8J36rdlIlxsioP1aXP8DIjdymNfFU2XaAxmVhySlOt
         rVrkL0Ccn7AGWNin17Yqc6O/rJnu75+Dkrb8YwLSldsxFHfDyQY0JNnEY5MnFT2U1QV2
         gYTwuz1Yjpxn7IvCj8VxrroNLrWl7rShnzJ2z9yvD+Gck7z53GU1rox0L9ZiSP09mIl2
         4QIA==
Received: by 10.152.131.68 with SMTP id ok4mr583336lab.47.1348668577891; Wed,
 26 Sep 2012 07:09:37 -0700 (PDT)
MIME-Version: 1.0
Sender: [email protected]
Received: by 10.112.9.198 with HTTP; Wed, 26 Sep 2012 07:09:16 -0700 (PDT)
In-Reply-To: <[email protected]>
References: <[email protected]>
From: David Kalnischkies <[email protected]>
Date: Wed, 26 Sep 2012 16:09:16 +0200
X-Google-Sender-Auth: AMvrqDvqhG4vysXuFWc4XhGN8fk
Message-ID: <CAAZ6_fAQSWZO=0D1Q7OoV22_D7fVtGXgW6hhKo8Q9+xZ5JFC1w@mail.gmail.com>
Subject: Re: Bug#688303: fails on concatenated bzip2 compressed Packages files (regression)
To: Thijs Kinkhorst <[email protected]>, [email protected]
Cc: [email protected]
Content-Type: text/plain; charset=ISO-8859-1
Bcc: [email protected]
Delivered-To: [email protected]

reassign 688303 bzip2 1.0.6-4 severity 688303 wishlist retitle 688303 Please support concatenated bz2 files in zlib-functions thanks On Fri, Sep 21, 2012 at 11:28 AM, Thijs Kinkhorst <[email protected]> wrote: > The problem is that our APT archive contains a Packages.bz2 which is a > concatenation of other bz2 files (of sub-archives). Two concatenated > bzip2 files again form a valid bzip2 file. The b(un)zip2 command line > utils support this and it's a documented feature. It may be a documented feature of bzip2, but not of APT as you have noticed. It is also not part of any documentation for a repository format, which all say that the Packages.bz2 file is a compressed Packages file. Nowhere is said that this could be a concatenation of different streams a compression algorithm knows by accident how to combine into one file. (It speaks volumes that the documentation of the higher level API mentions indeed the method you point to, but in the example code showing writing and reading a file on the very same page it is not used, nor even mentioned - maybe because they also see a difference between file and stream) Anyway, we don't even use the higher level functions, we use the zlib- compatibility functions which do not expose this "detail", so I am reassigning this to libbz2 for them to consider implementing support for this one way or another. Either way, it's a bug in your archive to assume that such bz2-files would be supported by APT or anything else working with these indexes without it ever be documented as supported. The reference implementation for an archive are the ones operated by ftp-masters - it is reasonable to assume everything they don't use is not safe to use in yours. Best regards David Kalnischkies

Debian bug tracking system administrator <[email protected]>. Last modified: Tue May 13 12:04:59 2025; Machine Name: buxtehude

Debian Bug tracking system

Debbugs is free software and licensed under the terms of the GNU General Public License version 2. The current version can be obtained from https://bugs.debian.org/debbugs-source/.

Debian Bug report logs - #688303 Please support concatenated bz2 files in zlib-functions

Debian Bug report logs - #688303
Please support concatenated bz2 files in zlib-functions