Debian Bug report logs - #629247
lintian: Please use a decent shell script parser

Reply or subscribe to this bug.

Display info messages

Message #5 received at [email protected] (full text, mbox, reply):

From: Niels Thykier <[email protected]>

To: Debian Bug Tracking System <[email protected]>

Subject: lintian: Lacks a decent shell script parser

Date: Sat, 04 Jun 2011 22:19:23 +0200

Package: lintian
Version: 2.5.0
Severity: wishlist

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256

Hey,

Tracker bug for stuff like #398658.

~Niels


- -- System Information:
Debian Release: wheezy/sid
  APT prefers testing
  APT policy: (990, 'testing'), (500, 'unstable'), (1, 'experimental')
Architecture: i386 (i686)

Kernel: Linux 2.6.38-2-686 (SMP w/2 CPU cores)
Locale: LANG=en_DK.UTF-8, LC_CTYPE=en_DK.UTF-8 (charmap=UTF-8)
Shell: /bin/sh linked to /bin/dash

Versions of packages lintian depends on:
ii  binutils              2.21.51.20110523-1 The GNU assembler, linker and bina
ii  diffstat              1.54-1             produces graph of changes introduc
ii  dpkg-dev              1.16.0.3           Debian package development tools
ii  file                  5.04-5+b1          Determines file type using "magic"
ii  gettext               0.18.1.1-3         GNU Internationalization utilities
ii  intltool-debian       0.35.0+20060710.1  Help i18n of RFC822 compliant conf
ii  libapt-pkg-perl       0.1.24+b2          Perl interface to libapt-pkg
ii  libclass-accessor-per 0.34-1             Perl module that automatically gen
ii  libemail-valid-perl   0.184-1            Perl module for checking the valid
ii  libipc-run-perl       0.89-1             Perl module for running processes
ii  libparse-debianchange 1.2.0-1            parse Debian changelogs and output
ii  libtimedate-perl      1.2000-1           collection of modules to manipulat
ii  liburi-perl           1.58-1             module to manipulate and access UR
ii  locales               2.13-4             Embedded GNU C Library: National L
ii  man-db                2.6.0.2-1          on-line manual pager
ii  perl [libdigest-sha-p 5.12.3-7           Larry Wall's Practical Extraction 
ii  unzip                 6.0-4              De-archiver for .zip files

lintian recommends no packages.

Versions of packages lintian suggests:
pn  binutils-multiarch            <none>     (no description available)
ii  libhtml-parser-perl           3.68-1+b1  collection of modules that parse H
ii  libtext-template-perl         1.45-2     Text::Template perl module
ii  man-db                        2.6.0.2-1  on-line manual pager

- -- no debconf information

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.11 (GNU/Linux)

iQIcBAEBCAAGBQJN6pNGAAoJEAVLu599gGRCiGEP/18QkCAM10h3SX9Ls8MqaDBl
WnLcml9gc56BKxaySN0V8ajhbxtZwsLXr7xbJl7qRdB6fokQqRG9EzdK7bVx/70c
rXs3DKBKA0I42HaM90+/sRS8iif+ljm1VS3U2t49a2bEu6ITF87qK+tD1TC3aWkt
oAswPExvYGF5UTeCEdOk0i8dQt1CciAJrYB12OQWYIlVPCNAvHOxO/HxHPiDkobL
GuS3xdoezL8/+Vz3Dp9Oyf5BZ0fWM+H5Y2AjsvB06hZ4gLpvBINl4OCrsZ0YB/D3
AGqq1bC2NnoBWLWJ5QP5R7AtCZryw/Cifmyn/AQgXP9CZISFZrvpd3ETDw5cipx9
U8minpFkNo/fIVwjEnVDBQm3I3hq00wGND7wA9CBenfNxx62NBDQtZWvCrzSM3+4
H4B8lGBLEI4Z6WQz0Kfu/r5Paqiz6Zo8mNrTk4V09mtaA8tO14foucpGFbaOULgD
NYV9Z4rdUCTRfxTF6GaaSLCPF4jge4bDN9ne4K5kDrYVf7zPfeQAXDPBcIazy+ge
5AdBanLI8ISsDjeMpGZDDIGSMo8rkW1dqXad+IHZeXP7Whq0W5SDZOQewE/Iklmt
r/N+4p1kAs0yS5wOyU+zsbmJ0Z5EZusyZhHdaky3m9cHSgUkeXvEE0N0Mv+VcXNq
PTLZj0RTevY6DNZaFMjl
=1Kac
-----END PGP SIGNATURE-----

Message #44 received at [email protected] (full text, mbox, reply):

From: "Niels Thykier" <[email protected]>

To: [email protected]

Subject: Re: Bug#629247: lintian: Lacks a decent shell script parser

Date: Sun, 03 Jun 2012 19:25:29 +0200

[Message part 1 (text/plain, inline)]

On Jun 4, 2011 22:19 "Niels Thykier" <[email protected]> wrote:
> [...]
> Hey,
> 
> Tracker bug for stuff like #398658.
> 
> ~Niels
>  
> [...]
> 

As far as I can tell, writing a full (and correct) parser for bash
is not going to be trivial.  But we may be able improve the accuracy
of our current ad-hoc parser by adding some "Text::ParseWords" to the
mix.

A fair simple perl snippet (attached) seems to be fairly accurate in
its tokenization of private/refresh-debhelper-data.  I have noticed
two issues so far:
 * Contents of heredocs (<<EOF ... EOF) are tokenized and probably
   shouldn't be.
 * ";" are not split into a separate token if there is no space between
   it and the previous token. (e.g. "if [ ... ]; then")

~Niels

[test.pl (application/x-perl, attachment)]

[refresh-debhelper-data.tok (application/octet-stream, attachment)]

Send a report that this bug log contains spam.