Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • Once the RC is built (both source and binary), put them in the dev SVN repository:
    https://dist.apache.org/repos/dist/dev/incubator/airflow/

  • Use the dev/airflow-jira script to generate a list of Airflow JIRAs that were closed in the release.

  • Send out a vote to the dev@airflow.incubator.apache.org mailing list:

    Code Block
    (Subject: [VOTE] Airflow 1.9.0rc7)
     
    Hey all,
    
    I have cut Airflow 1.9.0 RC7. This email is calling a vote on the release, which will last for 72 hours. Consider this my (binding) +1.
    
    Airflow 1.9.0 RC7 is available at:
    
    https://dist.apache.org/repos/dist/dev/incubator/airflow/1.9.0rc7/
    
    apache-airflow-1.9.0rc7+incubating-source.tar.gz is a source release that comes with INSTALL instructions.
    apache-airflow-1.9.0rc7+incubating-bin.tar.gz is the binary Python "sdist" release.
    
    Public keys are available at:
    
    https://dist.apache.org/repos/dist/release/incubator/airflow/
    
    The release contains the following JIRAs:
    
    https://issues.apache.org/jira/browse/AIRFLOW-1
    https://issues.apache.org/jira/browse/AIRFLOW-2
    https://issues.apache.org/jira/browse/AIRFLOW-3
    https://issues.apache.org/jira/browse/AIRFLOW-4
    ...
    
    Cheers,
    <your name>
  • Once the vote has been passed, you will need to send a result vote to dev@airflow.incubator.apache.org:

    Code Block
    (Subject: [RESULT][VOTE] Airflow 1.9.0rc8)
     
    Hello,
    
    Apache Airflow (incubating) 1.9.0 (based on RC8) has been accepted.
    
    5 “+1” binding votes received:
    
    - Maxime Beauchemin (binding)
    - Chris Riccomini (binding)
    - Bolke de Bruin (binding)
    - Joy Gao (binding)
    - Fokko Driesprong (binding)
    
    My next step is to open a thread with the IPMC.
    
    Cheers,
    <your name>
  • And you will also need to send a vote request to general@incubator.apache.org:

    Code Block
    (Subject: [VOTE] Release Airflow 1.9.0)
     
    Hello Incubator PMC’ers,
    
    The Apache Airflow community has voted and approved the proposal to release
    Apache Airflow 1.9.0 (incubating) based on 1.9.0 Release Candidate 8. We
    now kindly request the Incubator PMC members to review and vote on this
    incubator release.
    
    Airflow is a platform to programmatically author, schedule, and monitor
    workflows. Use Airflow to author workflows as directed acyclic graphs
    (DAGs) of tasks. The airflow scheduler executes your tasks on an array of
    workers while following the specified dependencies. Rich command line
    utilities make performing complex surgeries on DAGs a snap. The rich user
    interface makes it easy to visualize pipelines running in production,
    monitor progress, and troubleshoot issues when needed. When workflows are
    defined as code, they become more maintainable, versionable, testable, and
    collaborative.
    
    Artifacts are available at:
    
    https://dist.apache.org/repos/dist/dev/incubator/airflow
    
    Public keys are available at:
    
    https://dist.apache.org/repos/dist/release/incubator/airflow
    
    apache-airflow-1.9.0rc8+incubating-source.tar.gz
    <https://dist.apache.org/repos/dist/dev/incubator/airflow/1.9.0rc8/apache-airflow-1.9.0rc8+incubating-source.tar.gz>
    is a source release that comes with INSTALL instructions. Along with it, for
    convenience, find the binary Python "sdist" as apache-airflow-1.9.0rc8+incubating-bin.tar.gz
    <https://dist.apache.org/repos/dist/dev/incubator/airflow/1.9.0rc8/apache-airflow-1.9.0rc8+incubating-bin.tar.gz>
    
    Vote thread:
    https://mail-archives.apache.org/mod_mbox/incubator-airflow-dev/201712.mbox/%3CCABYbY7ecu8F8sp%3DgvZrvW3knj%3DQpdCUZu-Jh02KngjGOezhBKA%40mail.gmail.com%3E
    
    Git tag:
    https://github.com/apache/incubator-airflow/releases/tag/1.9.0rc8
    
    The vote will be open for at least 72 hours and until the necessary
    number of votes are reached.
    
    Members please be sure to indicate "(Binding)" with your vote which will
    help in tallying the vote(s).
    
    * Here is my +1 (non-binding) *
    
    Cheers,
    <your name>
  • Lastly, you'll need to send the general@ vote result to both general@incubator.apache.org and dev@airflow.incubator.apache.org:

    Code Block
    (Subject: [RESULT][VOTE] Release Airflow 1.9.0)
     
    The vote to release Airflow 1.9.0-incubating, having been open for 11
    days is now closed.
    
    There were three binding +1s and no -1 votes.
    
    +1 (binding):
    Chris Douglas
    Justin Mclean
    Jakob Homan
    
    The release is approved.
    
    Thanks to all those who voted.
    
    Cheers,
    <your name>

Publishing to PyPi

  • Create a ~/.pypirc file:

    Code Block
    languagebash
    $ cat ~/.pypirc 
    [distutils]
    index-servers =
      pypi
      pypitest
    
    [pypi]
    username=your-username
    password=*********
    
    [pypitest]
    repository=https://test.pypi.org/legacy/
    username=your-username
    password=*********

    (more details here.)

  • Set proper permissions for the pypirc file:

    Code Block
    languagebash
    $ chmod 600 ~/.pypirc
  • Confirm that airflow/version.py is set properly.
  • Install the package in PyPi's test environment:

    Code Block
    languagebash
    $ python setup.py sdist upload -r pypitest
  • Verify that the test package looks good by downloading it and installing it into a virtual environment. The package download link is available at:
    https://test.pypi.org/project/apache-airflow/#files
  • Install the package in PyPi's production environment:

    Code Block
    languagebash
    $ python setup.py sdist upload -r pypi
  • Again, confirm that the package is available here:
    https://pypi.python.org/pypi/apache-airflow

...