* Alexandre Detiste: " missing pkg_resources dependencies" (Sun, 16 Feb 2025
01:29:59 +0100):

Hi,

I'm worried that a lot of undeclared dependencies on
python3-pkg-resources will creep up in Trixie
and none of us will notice because we all have python3-setuptools
installed somehow.

AFAIS no package should depend on python3-pkg-resources any more, there was an MBF with user tag pkg-resources-deprecation like the following one:

"""
From: Matthias Klose <doko@debian.org>
To: maintonly@bugs.debian.org
Subject: tryton-modules-web-user: (build-)depends on deprecated module python3-pkg-resources Date: Fri, 04 Oct 2024 09:52:15 +0000

Package: src:tryton-modules-web-user
Version: 6.0.1-1
Severity: normal
Tags: sid trixie
User: debian-python@lists.debian.org
Usertags: pkg-resources-deprecation
"""

So it seems that the solution of the problem won't be to declare dependencies to python3-pkg-resources, if that was your intention.

Cheers
Mathias

By scrapping UDD & ci.debian.net I can find a lot of failing CI jobs
that needs this one-line fix in d-control.

Of course it would be more effecient to zgrep ModuleNotFoundError
inside https://ci.debian.net,
like what was done for SyntaxWarning inside piuparts architecture.

Another orthogonal worry: the (over-)use of @builddeps@ in
d/test/control let packages
pass CI as Green while they will fail for end-users because of some
missing deps.

Greetings,

Alexandre
-----

tchet@quieter:~/udd/ci$ ./ci.py https://ci.debian.net/data/autopkgtest/unstable/ppc64el/a/afew/57418208/log.gz
66s E ModuleNotFoundError: No module named 'pkg_resources' https://ci.debian.net/data/autopkgtest/unstable/ppc64el/a/afew/57418208/log.gz
66s E ModuleNotFoundError: No module named 'pkg_resources' https://ci.debian.net/data/autopkgtest/unstable/ppc64el/a/afew/57418208/log.gz
66s E ModuleNotFoundError: No module named 'pkg_resources'

https://ci.debian.net/data/autopkgtest/unstable/ppc64el/a/astroquery/57415625/log.gz
100s E ModuleNotFoundError: No module named 'pkg_resources' https://ci.debian.net/data/autopkgtest/unstable/ppc64el/a/astroquery/57415625/log.gz
100s E ModuleNotFoundError: No module named 'pkg_resources' https://ci.debian.net/data/autopkgtest/unstable/ppc64el/a/astroquery/57415625/log.gz
100s E ModuleNotFoundError: No module named 'pkg_resources' https://ci.debian.net/data/autopkgtest/unstable/ppc64el/a/astroquery/57415625/log.gz
100s E ModuleNotFoundError: No module named 'pkg_resources' https://ci.debian.net/data/autopkgtest/unstable/ppc64el/a/astroquery/57415625/log.gz
100s E ModuleNotFoundError: No module named 'pkg_resources'

https://ci.debian.net/data/autopkgtest/unstable/ppc64el/b/bernhard/57413994/log.gz
26s ModuleNotFoundError: No module named 'pkg_resources'

https://ci.debian.net/data/autopkgtest/unstable/ppc64el/b/biomaj3/57408831/log.gz
57s ModuleNotFoundError: No module named 'pkg_resources' https://ci.debian.net/data/autopkgtest/unstable/ppc64el/b/biomaj3-core/57401997/log.gz
35s E ModuleNotFoundError: No module named 'pkg_resources'

https://ci.debian.net/data/autopkgtest/unstable/ppc64el/c/circlator/57409170/log.gz
66s E ModuleNotFoundError: No module named 'pkg_resources' https://ci.debian.net/data/autopkgtest/unstable/ppc64el/c/circlator/57409170/log.gz
66s E ModuleNotFoundError: No module named 'pkg_resources' https://ci.debian.net/data/autopkgtest/unstable/ppc64el/c/circlator/57409170/log.gz
66s E ModuleNotFoundError: No module named 'pkg_resources' https://ci.debian.net/data/autopkgtest/unstable/ppc64el/c/circlator/57409170/log.gz
66s E ModuleNotFoundError: No module named 'pkg_resources' https://ci.debian.net/data/autopkgtest/unstable/ppc64el/c/circlator/57409170/log.gz
66s E ModuleNotFoundError: No module named 'pkg_resources' https://ci.debian.net/data/autopkgtest/unstable/ppc64el/c/circlator/57409170/log.gz
66s E ModuleNotFoundError: No module named 'pkg_resources'

https://ci.debian.net/data/autopkgtest/unstable/ppc64el/g/geoalchemy2/57402616/log.gz
106s E ModuleNotFoundError: No module named 'pkg_resources' https://ci.debian.net/data/autopkgtest/unstable/ppc64el/g/geoalchemy2/57402616/log.gz
106s E ModuleNotFoundError: No module named 'pkg_resources' https://ci.debian.net/data/autopkgtest/unstable/ppc64el/g/geoalchemy2/57402616/log.gz
106s E ModuleNotFoundError: No module named 'pkg_resources' https://ci.debian.net/data/autopkgtest/unstable/ppc64el/g/geoalchemy2/57402616/log.gz
106s E ModuleNotFoundError: No module named 'pkg_resources' https://ci.debian.net/data/autopkgtest/unstable/ppc64el/g/geoalchemy2/57402616/log.gz
106s E ModuleNotFoundError: No module named 'pkg_resources'

https://ci.debian.net/data/autopkgtest/unstable/ppc64el/g/git-review/57422016/log.gz
42s ModuleNotFoundError: No module named 'pkg_resources'

------

#!/usr/bin/python3

# https://udd.debian.org/schema/udd.html
# https://ci.debian.net/data/autopkgtest/unstable/amd64/p/python-debian/57324755/log.gz

import time

import requests
import psycopg2

conn = psycopg2.connect("postgresql://udd-mirror:udd-mirror@udd-mirror.debian.net/udd")
cursor = conn.cursor()

# maybe it's Python, maybe it's Maybelline
SQL = """
select source, arch, run_id
from ci
where suite='unstable'
and status='fail'
and date > TIMESTAMP '%TS% 00:01:01'
and not source like 'cl-%'
and not source like 'golang-%'
and not source like 'haskell-%'
and not source like 'lib%perl'
and not source like 'lua-%'
and not source like 'node-%'
and not source like 'openjdk-%'
and not source like 'php%'
and not source like 'postgresql-%'
and not source like 'ruby-%'
and not source like 'rust-%'
and not source like 'r-bioc-%'
and not source like 'r-cran-%'
order by source, arch
"""

cursor.execute(SQL.replace('%TS%', '2025-01-01'))

counts = dict()
urls = dict()

for row in cursor.fetchall():
source, arch, run_id = row
if source not in counts:
counts[source] = 0
counts[source] += 1
url = 'https://ci.debian.net/data/autopkgtest/unstable/%s/%s/%s/%s/log.gz' % (
arch,
source[0],
source,
run_id,
)
urls[source] = url

conn.close()

for source, count in counts.items():
if count < 3:
continue
url = urls[source]

time.sleep(0.3)

r = requests.get(url)
for line in r.text.splitlines():
if 'ModuleNotFoundError' in line:
print(url, line)

--

Mathias Behrle
PGP/GnuPG key availabable from any keyserver, ID: 0xD6D09BE48405BBF6
AC29 7E5C 46B9 D0B6 1C71 7681 D6D0 9BE4 8405 BBF6

--- SoupGate-Win32 v1.05
* Origin: fsxNet Usenet Gateway (21:1/5)

On Sun, Feb 16, 2025 at 06:35:04PM +0100, Mathias Behrle wrote:

I'm worried that a lot of undeclared dependencies on
python3-pkg-resources will creep up in Trixie
and none of us will notice because we all have python3-setuptools
installed somehow.

AFAIS no package should depend on python3-pkg-resources any more, there was an
MBF with user tag pkg-resources-deprecation like the following one:

It's not about removing the dependency, it's about removing the module
*usage*, and these packages, I assume, use the module without depending on
it, so they didn't get those bugs filed (I mean, I haven't checked if they don't have those bugs, maybe some of them do).

So it seems that the solution of the problem won't be to declare dependencies to python3-pkg-resources, if that was your intention.

Yes, the solution is removing the module usage, but if that's not possible
a dependency needs to be declared, as usual.

--
WBR, wRAR

-----BEGIN PGP SIGNATURE-----

iQJhBAABCgBLFiEEolIP6gqGcKZh3YxVM2L3AxpJkuEFAmeyLMktFIAAAAAAFQAP cGthLWFkZHJlc3NAZ251cGcub3Jnd3JhckBkZWJpYW4ub3JnAAoJEDNi9wMaSZLh STUQAJ5p1V1g6w7oUBMtiOVInQNkd8tyl4qdLGmeabQGR/5JKgsyGrKc/9/H1/nb q09YubAXPHpeQquFrSP0e5B3qszQfwX7JsHFuV0/wK/C0LpYDFp2EqLC/D6AN1jv MvTp2zPTcS/cqbTBwMrJ06lfICoZjxdstcvN/kwjoRwYDrIPaBJzzqxVOf7I0P0R TyAF7/BOT4T6+fvLT/fiNPdfWYGQaSDS/ncOl+8qVqmugZpLvNDRd+CDaEAZZWn0 6RpSDdz2vA/c59ByU+ypX0yCo2IH7e7VGCaGikye6Kkw6bcxBEBxLRR6ydsXmB2u mIbvv2vnl+NZHzRWpXsuQM9UmBfMwdYiIu0X2P35YjrTuYH8gmd6cPdu6GK7FZ5w SooZNqWfp0vFhFRhKrWHN0gS9Eqn0EhL3+E7WqFOYoYJRTMmh95w4oLMWfvn8c6q tUvmhPpoHjH17N4w0hEIii8Mxo3zYyeu2J4ZIf4k2QCIKCHhs1gHBORVL0UwX+tK /D2EUKU1OUZRByrF1Xat31SiIZjyQ0o2Kh8niXLxTlgeoNzC0sPYvTLYSDXtrRze zD2pxPNz/LYxIeHs5VgGFIk8SxFT2k9AbFvyFDOlfx4+pQZW7Vcah5ViPHETB+5t 1Vt+/vdNy4AZbAU7Wp9g1KHRnULBy3cAHbNUFDCtHFi/PiR4
=jG2m
-----END PGP SIGNATURE-----

--- SoupGate-Win32 v1.05
* Origin: fsxNet Usenet Gateway (21:1/5)