Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Adopt Java/Gradle options for umask differences

...

See below for any ecosystem-specific notes that could be helpful for other projects to make their builds reproducible. If you have additional input to share, feel free to edit this wiki page. If you have questions or want to discuss approaches, you can use the security-discuss mailinglist or Slack channel.

Archive/artifact contents

Including information about the system or environment running the build as well as current-date/time information in Jars breaks reproducibility (1) (2). This includes attributes like:

  • Current/build user
  • Current/build timestamp
  • Hostnames and IP addresses
  • Absolute file system paths
  • Full build tool versions (like Java's java.version or java.vm.version system properties)
  • CI build number
  • ...

Java / Maven

If you have a project that is built with Apache Maven, refer to the Configuring for Reproducible Builds guide.

...

Gradle builds may require setting some options in the build to ensure reproducible artifacts. Using the file-system permissions can be fine, but consider that different users (and OS's) may have different umask settings/defaults.

// This is applied to all Jar, Zip and Tar tasks.
tasks.withType<AbstractArchiveTask>().configureEach {
isPreserveFileTimestamps = false
isReproducibleFileOrder = true
// consistent directory permissions, ignoring system's umask
  dirPermissions { unix("755") }
// consistent file permissions, ignoring system's umask, retaining the executable permission (either 644 or 755)
  filePermissions {
    user.read = true
    user.write = true
    group.read = true
    group.write = false
    other.read = true
    other.write = false
  }
}

Java / .properties files

All Java properties generated using java.util.Properties.store() contain a comment line with the generation timestamp. This varying content breaks reproducible builds.

Consider setting the Java system property java.properties.date to some fixed value in your build scripts.

For Gradle, consider adding a line like the following to gradle.properties.

systemProp.java.properties.date=Your project's comment

Java / character set + locales

When building with Java 17 or older, consider setting file.encoding=UTF-8. UTF-8 is the default since Java 18.

Other system properties to consider depending on your build requirements: user.language=en, user.country=US, user.variant= (empty)

Python

Modern Python tooling (such as Flit and Hatch) support reproducible builds for pure-Python projects. You can read more about reproducible build support in Flit reproducible build docs and Hatch reproducible build docs. It's a bit more complex if your assets require native compilation, but if you can assure that your native compilation produces reproducible libraries on its own the packaging tool will produce reproducible builds..

...

You can read more about reproducible build support in Flit reproducible build docs and Hatch reproducible build docs.

Helm package

The helm package command from Helm versions before 4.0.0 cannot produce non-reproducible archives.

Since Helm version 4.0.0, it is possible to produce reproducible archives, even with the --sign option. The package archive entries get a constant uid/gid and fixed POSIX permissions. The file modification time is set to the source files' modification time.
Consider setting a constant file modification time, for example using find $PACKAGE_CONTENTS_DIRECTORY -exec touch -d "2000-01-01 00:00:00" {} +

Preparing reproducible .tar.gz packages

If you prepare source-tarball, or another .tar.gz packae package you can use scripts similar to to this one - which takes the same source_date_epoch and repacks the .tar.gz file to be reproducible. There are however few gotchas:

1) Make sure to remove permissions for "group" and "other" for all files that you add to the repository. This is needed because group/other permissions have different deault default settings (based on umask) and clearing them is the most certain way of reproducibility. This can be done in a few ways:

  • if you use git archive  - "-c tar.umask=0077" removes all permissions for group/others
  • Just run chmod -R og= <directory>  for the directory to compress - before running the reproducible script

2) if you usse use git archive , you can exclude some of the directories with .gitattributes  eport-ignore  specification

3) Consider using a fixed mtime and not using git-archive's gzip. For example:  git archive --mtime="1980-02-01 00:00:00" --format=tar HEAD | gzip -6 --no-name > my-archive.tar.gz

4) Gzip can also contain non-reproducible information. Consider using the strip-nondeterminism tool, which is available for many systems. When using the gzip tool alone, consider adding the --no-name with a fixed compression level, for example gzip --no-name -6.

5) ZIP files are not reproducible by default and the zip tool does not offer an easy way to generate reproducible zip archives. Consider using the strip-nondeterminism tool, which is available for many distributions/package managers (Ubuntu, Debian, brew and more).