Versions Compared

Old Version 42

changes.mady.by.user Enrico Olivelli

Saved on

compared with

New Version Current

changes.mady.by.user Andor Molnar

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Code Block
languagexml
title.m2 settings
<settings xmlns="http://maven.apache.org/SETTINGS/1.0.0"
  xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
  xsi:schemaLocation="http://maven.apache.org/SETTINGS/1.0.0
                      http://maven.apache.org/xsd/settings-1.0.0.xsd">
  <servers>
    <!-- To publish a snapshot -->
    <server>
      <id>apache.snapshots.https</id>
      <username>YOUR_APACHE_ID</username>
      <password>YOUR_APACHE_PASSWORD</password>
    </server>

    <!-- To stage a release -->
    <server>
      <id>apache.staging.https</id>
      <username>YOUR_APACHE_ID</username>
      <password>YOUR_APACHE_PASSWORD</password>
    </server>
  </servers>

  <server>
   	<id>apache.releases.https</id>
    <username>YOUR_APACHE_ID</username>
    <password>YOUR_APACHE_PASSWORD</password>
  </server>

 </servers> 
 <profiles>
    <profile>
      <id>apache-release</id>
      <properties>
	    <!-- gpg --list-keys will show you your keyname ( something like 00A5F21E) -->
    	<gpg.keyname>YOUR_KEYNAME</gpg.keyname>
  		<gpg.passphrase>YOUR_KEY_PASSWORD</gpg.passphrase>
      </properties>
    </profile>
  </profiles>
</settings>

...

Code Block
export GPG_TTY=$(tty)

mvn clean install dependency-check:check -Pfull-build -Papache-release -DskipTests 
mvn dependency-check:check


Manage JiRA issues

  • In Jira, move open issues to next version. Disable mail notifications for this bulk change. If you are in doubt as on dev@zookeeper.apache.org mailing list before proceedig

...

Update zookeeper-docs/src/main/resources/markdown/releasenotes.md with release notes for this release. You can get the HTML by following the "Release Notes" link for the relevant release on thehttps://issues.apache.org/jira/projects/ZOOKEEPER?selectedItem=com.atlassian.jira.jira-projects-plugin%3Arelease-page&status=unreleased  tab in Jira. Note that you need to exclude the won't fix or invalid tickets.
Hints for editing releasenotes.md (using vim) - you can skip 'c' parameter, it tells vim to ask for all replacement:

Code Block
languagexml
:%s/<h2>\s\+/## /gc
:%s/<\/h2>//gc
:%s/<[\/]*ul>\n//gc
:%s/<li>\[<a href='\(.*\)'>\(ZOOKEEPER-[0-9]\+\)<\/a>\] - \+/* [\2](\1) - /gc
:%s/<\/li>\n//gc

...

In case you have to run more than one RC you have to update the release notes every time and push them to those two branches.

...

Please make sure that the entire history of the actual release

...

linue is present in the release notes. For example in case of release 3.6.3, the notes from 3.6.0 to 3.6.3 are included.

Build and check that the release branch is in good shape in good shape

Run spotBugs, checkstyle, rat and OWASP checks:

Code Block
git checkout $WORK_BRANCH
git clean -xdf
# perform quality checks
mvn clean apache-rat:check -DskipTests -Pfull-build -Papache-release
mvn clean install checkstyle:check spotbugs:check dependency-check:check -DskipTests -Pfull-build -Papache-release 
mvn dependency-check:check

Perform a release on branch (for major and minor release)  (remove SNAPSHOT and create tag)

...

  • removes -SNAPSHOT in all of the pom.xml files (the version is RELEASE_VERSION)
  • build the project (even the C client and contrib packages)
  • ensures the correct version in C client files (configure.ac, CMakelink.txt, zookeeper_version.h)
  • created a signed tag
  • !! The command will not update the version in zookeeper_version.h, it has to be manually updated !!
  • created a signed tag
  • bump the branch to the next minor version bump the branch to the next minor version (RELEASE_DEVELOPMENT_VERSION)

Preparing the release candidate (prepare stage artifacts for VOTE)

  • Using dUsing the same directory in which you run "release:prepare" perform these are steps

    • Maven Release Plugin uses release.properties files prepared by release:prepare

    • It checks out a new copy of the repository at gitsha pointed by $TAG (like release-3.6.0-0) inside zookeeper/target/checkout

  • There is no need to build the C client or "contrib" packages

    Code Block
    mvn release:perform -Darguments='-DskipTests=true -PfullPapache-build,apache-release' -Papache-release,full-build


  • You should have the SIGNED jar files and also the tarballs built. The two tarball is available at:
    • target/checkout/zookeeper-assembly/target/apache-zookeeper-X.Y.Z-bin.tar.gz
    • target/checkout/target/apache-zookeeper-X.Y.Z-source-release.tar.gz
  • This command also staged all of the maven artifacts to repository.apache.org

...

  • validate the contents of the staging Maven repository
  • test the staged binaries with a JDK8 runtime

Close the Maven Repository

Push branches and release tag to upstream

Push the following:

  • Work branch
  • Release branch
  • Release tag
Code Block
git push
git push origin $WORK_BRANCH:$BRANCH_NAME
git push origin $TAG

Close the Maven Repository

  • Enter Apache Nexus and do the following:

    1. Click on Log In in the upper right corner.

    Enter Apache Nexus and do the following:

    1. Click on Log In in the upper right corner. Log in using your apache user name and password.  

    2. In the left navigation pane, select Staging Repositories.  

    3. Identify the release candidate you just pushed, by your user name (in parentheses as part of the "Repository" name) and the "Created On" date. Click on the check box to the left of your Repository name to select it. (If you accidentally click on the Repository name itself, another tab will pop open. If so, just close it.)  

    4. Click the Close button above the Repository names. This makes your release candidate available at the Staging level.  

    5. If you have previously staged an older release candidate with the same version number, and it is still showing in the Repository list, you must select and Drop the old one now.  

    6. Confirm that your new release candidate is visible at https://repository.apache.org/content/groups/staging/org/apache/zookeeper/zookeeper/ with correct file modification dates.

...

Copy release files to a public place and ensure they are readable. Note that home.apache.org only supports SFTP, so this may be easier with a graphical SFTP client like Nautilus, Konqueror, etc.


Stage source and binaries to Apache dev repo

Copy release files to a public place and ensure they are readable. 

Code Block
# Staged artifacts built by "release:perform" are in target/checkout

cd target/checkout/zookeeper-assembly/target

sftp home.apache.org
cd public_htmlZKHOME=where you have your work directory "zookeeper"
svn co https://dist.apache.org/repos/dist/dev/zookeeper/ zookeeper_dev
cd zookeeper_dev
mkdir zookeeper-$VERSION$RELEASE_VERSION-candidate-0$RC_NUM
cd zookeeper-$VERSION$RELEASE_VERSION-candidate-0$RC_NUM
put *-bincp $ZKHOME/target/checkout/target/*.tar.gz
put *-bin.tar.gz.asc
put * .
cp $ZKHOME/target/checkout/zookeeper-assembly/target/*-bin.tar.gz* .sha512
lcdrm *.asc./../targetsha512

#mkdir pwd should be website
cp -r $ZKHOME/target/checkout/zookeeper-docs/target
put *.tar.gz
put *.tar.gz.asc
put *.tar.gz.sha512

# uplading website (sftp needs directory tree to be pre-created?)
lcd ../zookeeper-docs/target/html
mkdir website
mkdir website/images
mkdir website/skin
cd website
put -r *

Stage source and binaries to Apache dev repo

Copy release files to a public place and ensure they are readable. 

Code Block
# Staged artifacts built by "release:perform" are in target/checkout

ZKHOME=where you have your work directory "zookeeper"
svn co https://dist.apache.org/repos/dist/dev/zookeeper/ zookeeper_dev
cd zookeeper_dev
mkdir zookeeper-$VERSION-candidate-0
cd zookeeper-$VERSION-candidate-0
cp $ZKHOME/target/checkout/target/*.tar.gz* .
cp $ZKHOME/target/checkout/zookeeper-assembly/target/*-bin.tar.gz* .
rm *.asc.sha512

mkdir website
cp -r $ZKHOME/target/checkout/zookeeper-docs/target/html/* website/
cd ..
svn add zookeeper-$VERSION-candidate-0
svn ci -m "Add ZooKeeper X.Y.Z release candidate 0"

Call for VOTE

/html/* website/
cd ..
svn add zookeeper-$RELEASE_VERSION-candidate-$RC_NUM
svn ci -m "Add ZooKeeper $RELEASE_VERSION release candidate $RC_NUM"

Call for VOTE

  • Call for a release vote on dev (note dev@ and not user@, the user list is for discussion of released software only) at zookeeper.apache.org. Here is a sample email (from 3.4.6 release):

    Subject: [VOTE] Apache ZooKeeper release 3.8.0 candidate 0
     

    This is a release candidate for 3.8.0.

    It is a major release and it introduces a lot of new features, most notably:
    - Migration of the logging framework from Apache Log4j1 to LogBack
    - Read Key/trust store password from file (and other security related
    improvements)
    - Restored support for OSGI
    - Reduced the performance impact of Prometheus metrics
    - Official support for JDK17 (all tests are passing)
    - Updates to all the third party dependencies to get rid of every known CVE.

    Call for a release vote on dev (note dev@ and not user@, the user list is for discussion of released software only) at zookeeper.apache.org. Here is a sample email (from 3.4.6 release):

    Subject: [VOTE] Apache ZooKeeper release 3.6.0 candidate 0
     

    This is a release candidate for 3.6.0.

    It is a major release and it introduces a lot of new features, most notably:
    - Built-in data consistency check inside ZooKeeper
    - Allow Followers to host Observers
    - A new feature proposal to ZooKeeper: authentication enforcement
    - Pluggable metrics system for ZooKeeper (and Prometheus.io integration)
    - TLS Port unification
    - Audit logging in ZooKeeper servers
    - Improve resilience to network (advertise multiple addresses for members of a Zookeeper cluster)
    - Persistent Recursive Watch
    - add an API and the corresponding CLI to get total count of recursive sub nodes under a specific path
     

    The full release notes is available at:

     
    https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310801&version=1234661712349587 

    *** Please download, test and vote by January 19th 2020February 28th 2022, 23:59 UTC+0. ***
     

    Source files:
    https://peopledist.apache.org/~eolivellirepos/dist/dev/zookeeper/zookeeper-3.68.0-candidate-01/

     
    Maven staging repo:
    https://repository.apache.org/content/repositories/orgapachezookeeper-10451073/
     

    The release candidate tag in git to be voted upon: release-3.68.0-01
    https://github.com/apache/zookeeper/tree/release-3.68.0-0
     1

    ZooKeeper's KEYS file containing PGP keys we use to sign the release:
    https://www.apache.org/dist/zookeeper/KEYS

    Please note that this new major release introduces these change in the staging area:
    - the source artifacts package is in zip format
    - we are releasing a new binary package with the C client (with OpenSSL support)
    - website preview
    We are also adding a new JAR: zookeeper-metrics-providers
    The staging version of the website is:
    https://people.apache.org/~eolivelli/zookeeper-3.6.0-candidate-0/website/

    Should we release this candidate?

    Release Manager Signature

Cancelling a Release Candidate

In case you get a -1 you have to work together with the community in order to see if that vote is a real blocker for the release or not.

In case it is a real blocker we have to fix the problem and cherry-pick the fix to $BRANCH_NAME and to $WORK_BRANCH

Send an explicit email in answer to the VOTE thread and state that current RC VOTE is cancelled.

"Drop" the Maven Staging Repository at repository.apache.org

...

Cancelling a Release Candidate

In case you get a -1 you have to work together with the community in order to see if that vote is a real blocker for the release or not.

In case it is a real blocker we have to fix the problem and cherry-pick the fix to $BRANCH_NAME and to $WORK_BRANCH.

Send an explicit email in answer to the VOTE thread and state that current RC VOTE is cancelled.

"Drop" the Maven Staging Repository at repository.apache.org.

Then when you are okay restart from "Perform a release on branch" step.

In order to create another release candidate, you need to revert the latest two commits on the work and the release branch.

Code Block
git revert <commit id for "Prepared $RELEASE_DEVELOPMENT_VERSION-SNAPSHOT">
git revert <commit id for "Prepared $RELEASE_VERSION">

This must be done before  cherry-picking the required commits from the master branch. It's also possible to hard reset the latest commit (the SNAPSHOT one), but keep the other intact, because you don't want to delete the previous RC tag.

Rollback

If you messed up something before publishing a release candidate, feel free to reset the branches to the commit before those "Prepared" commits. You can also delete the RC tag locally and remotely if needed.

Once your work branch is in a good shape, you can force push it.

Code Block
git tag -d $TAG                      # delete locally
git push --delete origin $TAG        # delete remotely
git push --force

Publishing

  • Once three PMC members have voted for a release, it may be published.

    1. Answer to the VOTE email thread with a final RESULT email like this one:


    2. Code Block
      Subject: [RESULT] [VOTE] Apache ZooKeeper release 3.6.0 candidate 0

I'm happy to announce that we have unanimously approved this release.

There are 7 approving votes, 5 of which are binding:

- approver 1...
- approver 2...(binding)
- approver 3...

There are no disapproving votes.

I will promote the artifacts and complete the release procedure.

Thanks to every one who contributed to this great release !

Release Manager Signature


    3. Compare and sync the WORK_BRANCH with the RELEASE_BRANCH, check RELEASE NOTES and Maven Version in pom.xml and in the C client:

    4. Update the version in $BRANCH_NAME (like branch-3.6), the Maven Release plugin pushed it to the WORK_BRANCH, you can should cherry pick it(actually they are 2 commits, one to remove SNAPSHOT and one to bump the version) but in case of conflict (if the branch diverged) you can do it with this commandcommand but you will have to manually update the C client files

      Code Block
      git checkout $BRANCH_NAME
git pull
mvn release:update-versions -DdevelopmentVersion=$RELEASE_DEVELOPMENT_VERSION -Pfull-build
# verify that we are committing only pom.xml files
git status
git diff
git add .
git commit -m "Start ZooKeeper $RELEASE_DEVELOPMENT_VERSION"
git push


    5. Tag the release. Do it from the release branch and push the created tag to the remote repository, drop the $WORK_BRANCH:

      Code Block
      git checkout $TAG
# create a signed tag
RELEASE_TAG=release-$RELEASE_VERSION
git tag -s $RELEASE_TAG -m "ZooKeeper $RELEASE_VERSION release."
git branch -D $WORK_BRANCH
git push -d origin $WORK_BRANCH
# push the newly created release tag to the remote repo (it should be "origin" if you cloned a frash new copy of apache repo).
git push origin $RELEASE_TAG
    6. Check in release files to the distribution server
    7.  "ZooKeeper $RELEASE_VERSION release."
git branch -D $WORK_BRANCH
git push -d origin $WORK_BRANCH
# push the newly created release tag to the remote repo (it should be "origin" if you cloned a frash new copy of apache repo).
git push origin $RELEASE_TAG


    8. Check in release files to the distribution server


    9. Code Block
      # copy locally the staged artifacts and the website
svn co https://dist.apache.org/repos/dist/dev/zookeeper/ zookeeper_dev
cd zookeeper_dev
svn rm https://dist.apache.org/repos/dist/dev/zookeeper/zookeeper-$RELEASE_VERSION-candidate-$RC_NUM/website -m "Remove staged website for ZooKeeper ${RELEASE_VERSION}rc${RC_NUM}"

svn move
      Code Block
      svn co https://dist.apache.org/repos/dist/releasedev/zookeeper/ zookeeper_dist
cd zookeeper_dist
mkdir zookeeper-$RELEASE_VERSION
# copy tgz/asc/checksum files from your public_html to zookeeper-X.Y.Z
svn add zookeeper-X.Y.Z
svn ci -m "Add ZooKeeper X.Y.Z release"
-candidate-$RC_NUM https://dist.apache.org/repos/dist/release/zookeeper/zookeeper-$RELEASE_VERSION -m "Release Apache ZooKeeper $RELEASE_VERSION"
      1. After checking in the release, you'll receive an automated email from reporter.apache.org with a link requesting additional details about the release.  This form must be completed by a PMC member.  If you are a PMC members, follow the link and complete the form.  If you are not a PMC member, forward the email to dev@zookeeper.apache.org and ask for assistance from a PMC member.

    10. The release directory usually contains just two releases, the most recent from two branches, with a link named 'stable' to the most recent recommended version.

      Code Block
      svn co https://dist.apache.org/repos/dist/release/zookeeper zookeeper_dist
      Code Block
      cd zookeeper_dist
svn rm zookeeper-A.B.C # apache folks don't like old releases hanging around - they are available in the archive if people need access
rm stable; rm current
ln -s zookeeper-A.B.D stable
ln -s zookeeper-A.B.D current
svn ci -m 'Updating links'


    11. Release the Maven artifacts on Apache Nexus:
      1. Click on 'Staging repositories'.
      2. Select the repository corresponding to the release candidate.
      3. Click on the 'Release' button and follow instructions.

    12. Wait 24 hours for release to propagate to mirrors.

    13. Prepare to edit the website. ZooKeeper uses Jekyll/Markdown with gitpubsub. See WebSiteSetup for general instructions and tool setup/prerequisites.

      Code Block
      git clone -b website https://gitbox.apache.org/repos/asf/zookeeper.git


    14. Copy the new release documentation into the _released_docs directory

      Code Block
      cd _released_docs
mkdir rX.Y.Zr$RELEASE_VERSION
cd rX.Y.Zr$RELEASE_VERSION
tar xvf $ZKHOME/target/checkout/zookeeper-assembly/target/apache-zookeeper-X.Y.Z$RELEASE_VERSION-bin.tar.gz --strip-components 2 '"apache-zookeeper-X.Y.Z$RELEASE_VERSION-bin/docs'"
rm apache-zookeeper-X.Y.Z$RELEASE_VERSION-bin.tar.gz
# Update the "current" doc pointer if necessary (next 2 lines)
cd ..
rm current
ln -s rX.Y.Zr$RELEASE_VERSION current
git add rX.Y.Zr$RELEASE_VERSION current
cd ..


    15. Change directory to src/main/resources/markdown
    16. Update the release news in releases.md
    17. Update the nav panel in html/header.html and documentation.md to include X.Y.Z

    18. Stage changes to git

      Code Block
      git add releases.md documentation.md html/header.html


    19. Regenerate the site, review it, then commit it. (install Jekyll/pygments if you haven't already - see the README.md in website branch)

      Code Block
      mvn clean install
cp -RP _released_docs target/html/doc
# at this point verify that the site is working properly - open _site/index.html
# once you are happy move on to the next step...
git commit -m "Updated website content for release X.Y.Z."

git push origin website


    20. Deploy: you are now ready to deploy the changes to the public website using gitpubsub. Using the same repo as the previous step:

      Code Block
      git checkout asf-site
rm -fr content
mv target/html content
git add content
# verify that the content of "content" looks proper. open content/index.html in a browser and verify, etc...
# verify git staging looks proper - remember, we added the release docs to content/doc/rX.Y.Z and that will also be added here
git commit -m "Website update for release X.Y.Z"

git push origin asf-site

      If the apache zookeeper website does not update, check if the commit is mirrored into github.com/apache/zookeeper asf-site branch

    21. Send announcements to the user and developer lists once the site changes are visible. Here is a sample email:

      No Format
      Subject: [ANNOUNCE] Apache ZooKeeper X.Y.Z

The Apache ZooKeeper team is proud to announce Apache ZooKeeper version X.Y.Z

ZooKeeper is a high-performance coordination service for distributed
applications. It exposes common services - such as naming,
configuration management, synchronization, and group services - in a
simple interface so you don't have to write them from scratch. You can
use it off-the-shelf to implement consensus, group management, leader
election, and presence protocols. And you can build on it for your
own, specific needs.

For ZooKeeper release details and downloads, visit:
https://zookeeper.apache.org/releases.html

ZooKeeper X.Y.Z Release Notes are at:
https://zookeeper.apache.org/doc/rX.Y.Z/releasenotes.html

We would like to thank the contributors that made the release possible.

Regards,

The ZooKeeper Team


    22. In Jira, ensure that only issues in the "Fixed" state have a "Fix Version" set to release X.Y.Z.
    23. In Jira, "release" the version. Visit the "Administer Project" page, then the "Manage versions" page. You need to have the "Admin" role in ZooKeeper's Jira for this step and the next.
    24. In Jira, close issues resolved in the release. Disable mail notifications for this bulk change.

...