Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Add extended meeting notes

...

TopicSpeakerNotes
Travis migrations updateTravis Migrations - Preference is to move jobs to Github Actions
Github Runners updateGavin McDonald Increased concurrency to 900
Github to Azure public runners projectGavin McDonald Gavin to get with Github and get this started.
Jenkins Ephermeral Ephemeral nodes updateGavin to get with Cesar re AWS access and roles

Meeting Notes (Summary)

Travis

Drew gave an update of the exodus from Travis , with a preference to use either Github Actions, or our Jenkins instances.
Drew will follow up directly with affected projects to give a timeline and a plan, builds@ mailing list will also be updated.

Github

Concurrency

After a recent meeting, Github very kindly increased our overall concurrency of runner jobs to 900! Mac runners were also increased as part 
of this to 70 from 50.

We have already seen a huge impact in our workflow queues, as can be seen from the snapshot image below:

The number of quued queued workflows dropped after increased parallelism:


Workflow Queues decreasedImage Modified

Self hosted public runners at Azure

Another item discussed with Github was that of being able to host our own public runners, using our Azure account.
This would give us even more concurrency and also the opportunity to increase the instance flavours and specs.
We hope to be working on this soon; and will give an update at next months builds meeting.

Higher spec runners from Githubs pool

Jarek asked the possibility of Github providing higher spec runners in their public runners pool, I said I would ask.
(32GB/64GB mem etc)

Caching in Github Actions

Jacob from Arrow notes that caching is not really working properly for Github Actions - Gavin notes that there is
a new tab in the Admin area of the Org account on Github dedicated to Caches , this displays usage but offers 
no actions to reset or anything - Arrow for example are currently using 85GB of a 10GB cache allowance - at 
least 30 projects are above this 10GB limit. Jacob will email Gavin with more details so that he may reach out
to Github and get more information about this.

M1 / Arm64 runners

Zach from Trafficcontrol project asks about availability of M1 chip runners, and ARM64 platform. 
Needs further investigation.

Jenkins and ephemeral nodes hosted in AWS

At the previous meeting, folks from Tomitribe have kindly offered to help set up on demand Jenkins nodes and connect
them to our Jenkins instances. Gavin and Cesar to get together and get access sorted. Gavin to install the EC2 plugin 
for this.

Action Items

  •  Gavin McDonald To inform and thank Github of the success of the increased concurrency - link them to this page.
  •  dfoulks Foulks Email affected projects and builds mailing lists with Travis exit status
  •  @jacob from Arrow to email caching details to Gavin
  •  Gavin McDonald Speak with Github re higher spec runners
  •  Gavin McDonald To meet with Github re Azure runners setup
  •  Gavin McDonald Liaise with Cesar Hernandez re AWS access


Next Meeting


at 1630 UTC