Debian Bug report logs - #893037
Add support for diffing docker-format containers

Package: src:diffoscope; Maintainer for src:diffoscope is Reproducible builds folks <[email protected]>;

Reported by: Jonathan Dowland <[email protected]>

Date: Thu, 15 Mar 2018 20:27:01 UTC

Severity: wishlist

Tags: moreinfo

Forwarded to https://salsa.debian.org/reproducible-builds/diffoscope/issues/39

Reply or subscribe to this bug.

View this report as an mbox folder, status mbox, maintainer mbox


Report forwarded to [email protected], Reproducible builds folks <[email protected]>:
Bug#893037; Package src:diffoscope. (Thu, 15 Mar 2018 20:27:05 GMT) (full text, mbox, link).


Acknowledgement sent to Jonathan Dowland <[email protected]>:
New Bug report received and forwarded. Copy sent to Reproducible builds folks <[email protected]>. (Thu, 15 Mar 2018 20:27:05 GMT) (full text, mbox, link).


Message #5 received at [email protected] (full text, mbox, reply):

From: Jonathan Dowland <[email protected]>
To: Debian Bug Tracking System <[email protected]>
Subject: Add support for diffing docker-format containers
Date: Thu, 15 Mar 2018 20:24:10 +0000
Package: src:diffoscope
Severity: wishlist


It would be nice if diffoscope could diff against docker containers available
on the local system.


-- System Information:
Debian Release: 9.3
 APT prefers stable
 APT policy: (990, 'stable'), (600, 'unstable'), (500, 'oldstable')
Architecture: amd64 (x86_64)

Kernel: Linux 4.14.12-x86_64-linode92 (SMP w/2 CPU cores)
Locale: LANG=en_GB.UTF-8, LC_CTYPE=en_GB.UTF-8 (charmap=UTF-8), LANGUAGE=en_GB.UTF-8 (charmap=UTF-8)
Shell: /bin/sh linked to /bin/dash
Init: systemd (via /run/systemd/system)

-- 

⢀⣴⠾⠻⢶⣦⠀
⣾⠁⢠⠒⠀⣿⡁ Jonathan Dowland
⢿⡄⠘⠷⠚⠋⠀ https://jmtd.net
⠈⠳⣄⠀⠀⠀⠀ Please do not CC me, I am subscribed to the list.



Information forwarded to [email protected], Reproducible builds folks <[email protected]>:
Bug#893037; Package src:diffoscope. (Thu, 15 Mar 2018 22:57:04 GMT) (full text, mbox, link).


Acknowledgement sent to Chris Lamb <[email protected]>:
Extra info received and forwarded to list. Copy sent to Reproducible builds folks <[email protected]>. (Thu, 15 Mar 2018 22:57:04 GMT) (full text, mbox, link).


Message #10 received at [email protected] (full text, mbox, reply):

From: Chris Lamb <[email protected]>
To: Jonathan Dowland <[email protected]>, [email protected]
Subject: Re: Bug#893037: Add support for diffing docker-format containers
Date: Thu, 15 Mar 2018 22:52:40 +0000
tags 893037 + moreinfo
thanks

Hi Jonathan,

Thank you very much for the idea and wishlist bug.

> It would be nice if diffoscope could diff against docker containers available
> on the local system.

Could you briefly elaborate on what you mean here? I have a bunch of
directories under /var/lib/docker/containers -- are you wanting to
diffoscope two of these, or...? diffoscope basically works on "paths",
you see.


Best wishes,

-- 
      ,''`.
     : :'  :     Chris Lamb
     `. `'`      [email protected] / chris-lamb.co.uk
       `-



Added tag(s) moreinfo. Request was from Chris Lamb <[email protected]> to [email protected]. (Thu, 15 Mar 2018 22:57:06 GMT) (full text, mbox, link).


Information forwarded to [email protected], Reproducible builds folks <[email protected]>:
Bug#893037; Package src:diffoscope. (Thu, 22 Mar 2018 17:21:04 GMT) (full text, mbox, link).


Acknowledgement sent to Juliana Oliveira <[email protected]>:
Extra info received and forwarded to list. Copy sent to Reproducible builds folks <[email protected]>. (Thu, 22 Mar 2018 17:21:05 GMT) (full text, mbox, link).


Message #17 received at [email protected] (full text, mbox, reply):

From: Juliana Oliveira <[email protected]>
To: [email protected]
Subject: Re: Bug#893037: Add support for diffing docker-format containers
Date: Thu, 22 Mar 2018 14:19:31 -0300
Hi Jonathan and Lamby,

AFAIK, docker /images/ can be exported to tarballs. Not sure how human
readable they are, but diffoscope can definitely work. (:

On Thu, 15 Mar 2018 22:52:40 +0000 Chris Lamb <[email protected]> wrote:
> tags 893037 + moreinfo
> thanks
>
> Hi Jonathan,
>
> Thank you very much for the idea and wishlist bug.
>
> > It would be nice if diffoscope could diff against docker containers
available
> > on the local system.
>
> Could you briefly elaborate on what you mean here? I have a bunch of
> directories under /var/lib/docker/containers -- are you wanting to
> diffoscope two of these, or...? diffoscope basically works on "paths",
> you see.
>
>
> Best wishes,
>
> --
> ,''`.
> : :' : Chris Lamb
> `. `'` [email protected] / chris-lamb.co.uk
> `-
>
>

-- 

Juliana





Information forwarded to [email protected], Reproducible builds folks <[email protected]>:
Bug#893037; Package src:diffoscope. (Wed, 28 Mar 2018 16:27:03 GMT) (full text, mbox, link).


Acknowledgement sent to Chris Lamb <[email protected]>:
Extra info received and forwarded to list. Copy sent to Reproducible builds folks <[email protected]>. (Wed, 28 Mar 2018 16:27:03 GMT) (full text, mbox, link).


Message #22 received at [email protected] (full text, mbox, reply):

From: Chris Lamb <[email protected]>
To: [email protected]
Cc: Jonathan Dowland <[email protected]>, Juliana Oliveira <[email protected]>
Subject: Re: Add support for diffing docker-format containers
Date: Wed, 28 Mar 2018 17:25:08 +0100
Juliana wrote:

> AFAIK, docker /images/ can be exported to tarballs. Not sure how human
> readable they are, but diffoscope can definitely work. (:> 

Indeed that would definitely work. However, the "REPL" for someone
doing this would inevitably involve someone scripting the export of
two images and then runnning diffoscope against them, instead of
simply knowing how to carve them out of, say, Docker to begin with.

This seems a little at odds with diffoscope's idea of making the
whole process of diffing two things much more usable.

Whilst my gut was initially against it, perhaps some kind of "magic"
paths (or URI scheme) would work here.

(Inspired by IRC conversation with Jon right now)


Best wishes,

-- 
      ,''`.
     : :'  :     Chris Lamb
     `. `'`      [email protected] / chris-lamb.co.uk
       `-



Information forwarded to [email protected], Reproducible builds folks <[email protected]>:
Bug#893037; Package src:diffoscope. (Thu, 29 Mar 2018 19:18:03 GMT) (full text, mbox, link).


Acknowledgement sent to Jonathan Dowland <[email protected]>:
Extra info received and forwarded to list. Copy sent to Reproducible builds folks <[email protected]>. (Thu, 29 Mar 2018 19:18:03 GMT) (full text, mbox, link).


Message #27 received at [email protected] (full text, mbox, reply):

From: Jonathan Dowland <[email protected]>
To: [email protected]
Subject: Re: Bug#893037: Add support for diffing docker-format containers
Date: Thu, 29 Mar 2018 20:15:58 +0100
I poked a bit at how docker's overlay2 driver stores the layers and came
up with this temporary hack script

> #!/bin/sh
> set -u
> set -e
> 
> if [ $# -lt 2 ]; then
>     echo usage: $0 before after
>     exit 1
> fi
> 
> before="$1"
> after="$2"
> 
> bfs=$(docker inspect -f '{{ .GraphDriver.Data.UpperDir }}' "$before")
> afs=$(docker inspect -f '{{ .GraphDriver.Data.UpperDir }}' "$after")
> 
> diff -ruN "$bfs" "$afs"

-- 

⢀⣴⠾⠻⢶⣦⠀
⣾⠁⢠⠒⠀⣿⡁ Jonathan Dowland
⢿⡄⠘⠷⠚⠋⠀ https://jmtd.net
⠈⠳⣄⠀⠀⠀⠀



Information forwarded to [email protected], Reproducible builds folks <[email protected]>:
Bug#893037; Package src:diffoscope. (Sun, 02 Dec 2018 16:39:06 GMT) (full text, mbox, link).


Acknowledgement sent to Chris Lamb <[email protected]>:
Extra info received and forwarded to list. Copy sent to Reproducible builds folks <[email protected]>. (Sun, 02 Dec 2018 16:39:06 GMT) (full text, mbox, link).


Message #32 received at [email protected] (full text, mbox, reply):

From: Chris Lamb <[email protected]>
To: Jonathan Dowland <[email protected]>, [email protected]
Subject: Re: Bug#893037: Add support for diffing docker-format containers
Date: Sun, 02 Dec 2018 11:30:14 -0500
Jonathan Dowland wrote:

> It would be nice if diffoscope could diff against docker containers available
> on the local system.

This might be useful:

  https://github.com/wagoodman/dive


Regards,

-- 
      ,''`.
     : :'  :     Chris Lamb
     `. `'`      [email protected] / chris-lamb.co.uk
       `-



Information forwarded to [email protected], Reproducible builds folks <[email protected]>:
Bug#893037; Package src:diffoscope. (Sat, 15 Dec 2018 15:03:29 GMT) (full text, mbox, link).


Acknowledgement sent to Chris Lamb <[email protected]>:
Extra info received and forwarded to list. Copy sent to Reproducible builds folks <[email protected]>. (Sat, 15 Dec 2018 15:03:29 GMT) (full text, mbox, link).


Message #37 received at [email protected] (full text, mbox, reply):

From: Chris Lamb <[email protected]>
To: [email protected]
Cc: Jonathan Dowland <[email protected]>
Subject: Re: Add support for diffing docker-format containers
Date: Sat, 15 Dec 2018 16:00:45 +0100
forwarded 893037 https://salsa.debian.org/reproducible-builds/diffoscope/issues/39
thanks

I've forwarded this upstream here:

  https://salsa.debian.org/reproducible-builds/diffoscope/issues/39


Regards,

-- 
      ,''`.
     : :'  :     Chris Lamb
     `. `'`      [email protected] / chris-lamb.co.uk
       `-



Set Bug forwarded-to-address to 'https://salsa.debian.org/reproducible-builds/diffoscope/issues/39'. Request was from Chris Lamb <[email protected]> to [email protected]. (Sat, 15 Dec 2018 15:03:48 GMT) (full text, mbox, link).


Send a report that this bug log contains spam.


Debian bug tracking system administrator <[email protected]>. Last modified: Tue May 13 05:09:30 2025; Machine Name: bembo

Debian Bug tracking system

Debbugs is free software and licensed under the terms of the GNU General Public License version 2. The current version can be obtained from https://bugs.debian.org/debbugs-source/.

Copyright © 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson, 2005-2017 Don Armstrong, and many other contributors.