pkgbase pkg cache lacks cleaning

[bdrewery]

From Mark Millard:

My poudriere jail updates are not cleaning out prior:

/usr/local/poudriere/jails/*/var/cache/pkg/FreeBSD-*

files after updates. For example my "official-aarch64" poudriere jail
now shows over 1600 files:

# ls -dC1
/usr/local/poudriere/jails/official-aarch64/var/cache/pkg/FreeBSD-* | wc -l
    1682

and spans a history of 6 snapshots:

# ls -dC1t \
/usr/local/poudriere/jails/official-aarch64/var/cache/pkg/FreeBSD-*~* \
| sed -e 's@^.*\(/FreeBSD-.*\)-15\.snap.*~.*$@\1@' \
| sort \
| uniq -c \
| sort -rn \
| head
   6 /FreeBSD-utilities-lib32
   6 /FreeBSD-utilities
   6 /FreeBSD-toolchain
   6 /FreeBSD-src-sys
   6 /FreeBSD-runtime-lib32
   6 /FreeBSD-runtime
   6 /FreeBSD-kernel-man
   6 /FreeBSD-geom
   6 /FreeBSD-clibs-dev
   6 /FreeBSD-bsnmp

[markmi]

Just for reference in the central place, copied from a list submittal I made:

I found a way based on disabling FreeBSD-ports and FreeBSD-ports-kmods
(and redundantly FreeBSD-base) and have just poudriere-devel's pkgbase
enabled in a way that avoids /usr/local/* use. An example follows:

/usr/local/poudriere/jails/release15p1-aarch64/etc/pkg/FreeBSD.conf left
as it normally is.

# cat \
/usr/local/poudriere/jails/release15p1-aarch64/etc/pkg/pkgbase.conf
pkgbase: {
  url: ["https://pkg.freebsd.org/FreeBSD:15:aarch64/base_release_1"](https://pkg.freebsd.org/FreeBSD:15:aarch64/base_release_1)
  mirror_type: "none"
  enabled: yes
}

(That is an example of a normal pkgbase.conf file for poudriere jails.)

I controlled the enables for the purpose separately:

# cat \
/usr/local/poudriere/jails/release15p1-aarch64/etc/pkg/pkgbase9999.conf
FreeBSD-ports: {
  enabled: no
}
FreeBSD-ports-kmods: {
  enabled: no
}
FreeBSD-base: {
  enabled: no
}
pkgbase: {
  enabled: yes
}

With that as context:

# pkg-static -c /usr/local/poudriere/jails/release15p1-aarch64/ clean
. . .
Proceed with cleaning the cache? [y/N]:y
Deleting files: 100%

does work.

Then remove the:

/usr/local/poudriere/jails/release15p1-aarch64/etc/pkg/pkgbase9999.conf

file to avoid overriding poudiere-devel in normal operation.

(These notes ignore FreeBSD 14's pkgbase and its older style repo naming.)

The above does presume that the jail is not otherwise in use during the
activity. pkg v2.7.5 was used for testing.


It looks to me like a somewhat analogus activity could be done by
poudriere-devel at the end of a pkgbase-based jail upgrade.

So I now expect that this is a poudriere-devel issue.

[markmi]

One of the points involved is that having a repo name that is enabled but has no packages in the database leads to not being able to clean at all via pkg clean. In this type of poudreire jail context, FreeBSD-ports and FreeBSD-ports-kmods are not in use but are by default enabled, thereby blocking doing a pkg clean. (This is a pkg behavior, not poudriere, but has consequences for configuring poudriere jails for specific operations to be possible.)

[markmi]

FYI: Across my various poudriere-devel jails, my doing my workaround style of cleaning got me back many GiBytes of disk space.

[grahamperrin]

• poudriere-jail(8) and pkgbase: FreeBSD-base package cache accumulation #1276

– related?

Thanks

[markmi]

Mostly the distinction between your report and mine here is that mine identifies the likes of:

# poudriere jail -u
and:
# poudriere jail -c

as the commands that should leave the jail's var/cache/pkg/FreeBSD-* clean (not the port-package repository's directory tree from a bulk build). Those commands should leave the jail's var/cache/pkg/FreeBSD-* clean even if no bulk build has ever been done by the jail, so there is no repository (yet). (I have a bunch of such jails that I normally use just for testing the 2 types of commands above, not doing bulk builds with those jails.)

Note also, that the same jail can be responsible for building multiple repositories, such as for:

# poudriere bulk -jJAILNAME . . .
vs.
# poudriere bulk -jJAILNAME -pALTERNATEPORTSTREENAME . . .

There is only 1 jail var/cache/pkg/ involved in such but there are separeate JAILNAME-default vs. JAILNAME-ALTERNATEPORTSTREENAME port-package repositories. pkgclean cleans a port-package repository.

Note that those 2 poudriere jail commands do not support specifying a ports-tree or a set: no repository is involved.