Thanks Raul,

OK! So the error (shown below) is related to libiconv, but we now build libunistring right after tar. So probably it was busy building libiconv at the same time it was building libunistring.

Can you try adding libiconv as a dependency of libunistring and trying again? The rule for libiconv is just above the rule for libunistring.

Now that we are building in parallel on macOS, we are encountering such dependency problems for the first time, but they will be fixed soon ;-).


P.S.
Just for the record, this is the main error message:

Undefined symbols for architecture x86_64:
  "_iconv", referenced from:
      _mem_cd_iconveh_internal in striconveh.o
     (maybe you meant: _libunistring_mem_iconveha, _libunistring_mem_iconveh , _libunistring_iconveh_close , _libunistring_iconveh_open , _libunistring_str_cd_iconveh , _libunistring_str_iconveh , _libunistring_mem_cd_iconveh , _libunistring_str_iconveha )
  "_iconv_close", referenced from:
      _libunistring_iconveh_open in striconveh.o
      _libunistring_iconveh_close in striconveh.o
  "_iconv_open", referenced from:
      _libunistring_iconveh_open in striconveh.o
install ./include/openssl/evp.h -> /BDIR/software/installed/include/openssl/evp.h
ld: symbol(s) not found for architecture x86_64
clang: error: linker command failed with exit code 1 (use -v to see invocation)
make[4]: *** [Makefile:4215: libunistring.la] Error 1

Thanks a lot Boud ;-). Indeed, if the PDF is built, it means that all the outputs have been successfully checked with their checksums (you can see it 'verfify.mk').

I hope it builds cleanly on macOS is well.

I need a little more time for completing a clean build on FreeBSD (as described in bug #58465), but it is certainly do-able (they are all minor).

But FreeBSD is unrelated to this task directly, so we can safely merge after confirming on macOS and we'll fix that bug soon afterwards.

Thanks Raul and Boud. Indeed, on some Tar implementations, Lzip isn't supported by default. I just implemented the fix in the default 'gbuild' and 'cbuild' rules that we use to build programs. It won't be a problem in other programs that have custom calls of tar, because by that point we have our own GNU Tar installed and ready to use.

So Raul, can you please pull this branch and build its most recent commit? I just finished a clean build (including download of tarballs) on my system and it worked.

It is strange that it worked in your system. In my system it crashed because it tried to use `tar' on `.lz' files. When installing `lzip' it is fine because it is not compressed (`lzip.tar'). But then, when it goes to next program and try to use `tar' with `make.tar.lz' it crashed, because it is lziped!

Here I paste a couple of modifications I did in order to correct this problem, I could commit them but I prefer to post here and let you know.

diff --git a/reproduce/software/shell/pre-make-build.sh b/reproduce/software/shell/pre-make-build.sh
index 25d7d6b..5fdb7cc 100755
--- a/reproduce/software/shell/pre-make-build.sh
+++ b/reproduce/software/shell/pre-make-build.sh
@@ -123,7 +123,14 @@ download_tarball() {
 build_program() {
   if ! [ -f $ibidir/$progname ]; then
     cd $tmpblddir
-    tar -xf $tardir/$tarball
+    if [ x$progname = xlzip ]; then
+      tar -xf $tardir/$tarball
+    else
+      tarball_tar=$(echo $tarball | sed -e's/.lz//')
+      lzip -k -f -d $tardir/$tarball
+      mv $tardir/$tarball_tar $tmpblddir/
+      tar -xf $tmpblddir/$tarball_tar
+    fi
     unpackdir="$progname"-"$version"
     cd $unpackdir
     ./configure --prefix=$instdir
@@ -131,6 +138,7 @@ build_program() {
     make install
     cd $topdir
     rm -rf "$tmpblddir"/$unpackdir
+    rm -rf $tmpblddir/$tarball_tar
     echo "$progname_tex $version" > $ibidir/$progname
   fi
 }

Basically, it is necessary to use `lzip' with `.lz' tarballs (-k for keeping the original tarball, -f for force to overwrite and -d to decompress). But I am not able to specify a proper output (with the `-o' option), and because of that, I moved the decompressed tarball. Then use it to install the program.

This fixes that problem. But then, it crashes complaining about:

Downloading http://akhlaghi.org/src/gzip-1.10.tar.lz
./reproduce/analysis/bash/download-multi-try: full input URL (third argument) not given.

Make the basis of Maneage and currently we use the hosts's Make implementation for 'basic.mk' which builds make pretty early on: just after installing the compressing libraries. This has the following problems:

• On macOS, for some reason, the parallel building of its default Make fails (we have seen this in more than one macOS). So macOS users have to build their full 'basic.mk' on a single thread! Which is very slow :-(.

• As described in bug #58465, on FreeBSD, the host 'make' doesn't recognize the conditionals we have put.

Fortunately GNU Make is a relatively small program itself, and its creators have even included a 'build.sh' script to use to build itself (instead of calling 'make' to build 'make'!) So the system can even not have Make at all!

I am thus proposing to build GNU Make in 'configure.sh', just like the way we currently build 'flock' now and use our own GNU Make even for 'basic.mk' on any host. Doing this will make 'basic.mk' much more similar to 'high-level.mk' or 'python.mk' (allowing us to use GNU Make conventions!), while fixing the issues above.

Fortunately Make is also released with Lzip compression and Lzip is arguably the most elegant simple little program I have seen (uncompressed it is only 436 KB)! So we can also install Lzip before Make in 'configure.sh'.

We can then install 'flock' after Lzip and Make in 'configure.sh'. For Flock, we can make an Lzip tarball and download/use that instead of its standard Gzip-based tarball.

Finally, in 'basic.mk', we can also make an Lzip-based tarball for Gzip and use that to build Gzip before any package that has a 'tar.gz' tarball.

Generally, 'tar.lz' has a much higher compression ratio for source code (almost double!), so it may not be bad to later only use 'tar.lz' for our source-code archive. But this is just a brainstorm now!