Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Source releases

Publishing to PyPi:
  • Create a ~/.pypirc file:

    Code Block
    languagebash
    $ cat ~/.pypirc 
    [distutils]
    index-servers =
      pypi
      pypitest
    
    [pypi]
    username=your-username
    password=*********
    
    [pypitest]
    repository=https://test.pypi.org/legacy/
    username=your-username
    password=*********

    (more details here.)

  • Set proper permissions for the pypirc file:

    Code Block
    languagebash
    $ chmod 600 ~/.pypirc
  • Confirm that airflow/version.py is set properly.
  • Install the package in PyPi's test environment:

    Code Block
    languagebash
    $ python setup.py sdist upload -r pypitest
  • Verify that the test package looks good by downloading it and installing it into a virtual environment. The package download link is available at:
    https://test.pypi.org/project/apache-airflow/#files
  • Install the package in PyPi's production environment:

    Code Block
    languagebash
    $ python setup.py sdist upload -r pypi
  • Again, confirm that the package is available here:
    https://pypi.python.org/pypi/apache-airflow

Updating CHANGELOG.md:

  • Get a diff between the last version and the current version:

    Code Block
    languagebash
    $ git log 1.8.0..1.9.0 --pretty=oneline



  • Update CHANGELOG.md with the details, and commit it.

Publishing documentation:

Old stuff that doesn't apply anymore:

Expand
titleView legacy instructions

Committers should use the following commands and steps to create an Apache Airflow release:

  1. Run dev/airflow-jira on the test branch
    dev/airflow-jira compare 1.8.1

  2. Commit RCs here
    svn

...

...

  1. sure CHANGELOG and UPDATING.md

...

  1.  have been updated.

  2. Remove previous versions from  https://dist.apache.org/repos/dist/dev/incubator/airflow (`svn rm` -> `svn commit`)

  3. Run a travis build, confirm it passes (duh.)
  4. Build airflow
    python setup.py sdist

  5. Generate MD5
    gpg --print-md MD5 apache-airflow-1.8.1rc0+apache.incubating.tar.gz > apache-airflow-1.8.1rc0+apache.incubating.tar.gz.md5

  6. Generate the SHA512
    gpg --print-md SHA512 apache-airflow-1.8.1rc0+apache.incubating.tar.gz > apache-airflow-1.8.1rc0+apache.incubating.tar.gz.sha

  7. Upload your GPG public key

...

  1. to https://pgp.mit.edu

  2. Add your GPG pub key to https://dist.apache.org/repos/dist/release/incubator/airflow/KEYS , follow the instructions at the top of the file

  3. Sign Airflow tar.gz
    gpg --armor --output apache-airflow-1.8.1rc0+apache.incubating.tar.gz.asc --detach-sig apache-airflow-1.8.1rc0+apache.incubating.tar.gz

  4. Do votes

...

...

...

  1. co https://dist.apache.org/repos/dist/release/incubator/airflow

  2. Merge the test branch into the stable branch
    git pull apache v1-8-test
    git pull apache v1-8-stable
    git co v1-8-stable
    git merge v1-8-test
    git tag 1.8.1
    git push apache v1-8-stable
    git push apache 1.8.1

...

  1. Follow these

...

  1.  instructions to publish to PyPi
    Note: You must remove the +incubating from the airflow/version.py file.

 

Source releases

...

set your version to 1.8.2 in airflow/version.py

...

tag your release `git tag 1.8.2rc3`
`git clean -f`

...

:

...

...

  • .

...

  • .

...

  • .

...

  • Generate MD5s
    gpg --print-md MD5 apache-airflow-1.8.1rc0+apache.incubating.tar.gz > apache-airflow-1.8.1rc0+apache.incubating.tar.gz.md5

  • Generate the SHA512
    gpg --print-md SHA512 apache-airflow-1.8.1rc0+apache.incubating.tar.gz > apache-airflow-1.8.1rc0+apache.incubating.tar.gz.sha

  • Upload your GPG public key to https://pgp.mit.edu

  • Add your GPG pub key to https://dist.apache.org/repos/dist/release/incubator/airflow/KEYS , follow the instructions at the top of the file

  • Sign Airflow tar.gz
    gpg --armor --output apache-airflow-1.8.1rc0+apache.incubating.tar.gz.asc --detach-sig apache-airflow-1.8.1rc0+apache.incubating.tar.gz

...

Publishing to PyPi:
  • Create a ~/.pypirc file:

    Code Block
    languagebash
    $ cat ~/.pypirc 
    [distutils]
    index-servers =
      pypi
      pypitest
    
    [pypi]
    username=your-username
    password=*********
    
    [pypitest]
    repository=https://test.pypi.org/legacy/
    username=your-username
    password=*********

    (more details here.)

  • Set proper permissions for the pypirc file:

    Code Block
    languagebash
    $ chmod 600 ~/.pypirc
  • Confirm that airflow/version.py is set properly.
  • Install the package in PyPi's test environment:

    Code Block
    languagebash
    $ python setup.py sdist upload -r pypitest
  • Verify that the test package looks good by downloading it and installing it into a virtual environment. The package download link is available at:
    https://test.pypi.org/project/apache-airflow/#files
  • Install the package in PyPi's production environment:

    Code Block
    languagebash
    $ python setup.py sdist upload -r pypi
  • Again, confirm that the package is available here:
    https://pypi.python.org/pypi/apache-airflow

Updating CHANGELOG.md:

Get a diff between the last version and the current version:

Code Block
languagebash
$ git log 1.8.0..1.9.0 --pretty=oneline
  • Update CHANGELOG.md with the details, and commit it.
  • Publishing documentation:

    Follow instructions on Building and deploying the docs