(Using Case Studies to Strengthen Oversight Practices)

Intended audience: IPMC members, Incubator mentors, and ASF participants involved in evaluating or supporting podling communities.

Introduction
This guide was developed within the Apache Incubator as an internal learning resource to help the Incubator Project Management Committee (IPMC) and mentors reflect on patterns observed across past podlings.
It is not an audit or assessment of individual projects but a tool to strengthen future oversight and mentoring through shared lessons.

By analysing where the IPMC acted early, responded late, or could have recognised signals sooner, the Incubator aims to continuously improve its role in supporting healthy communities and upholding ASF governance standards.


Purpose

The guide supports the IPMC’s continuous improvement by identifying patterns of oversight that have influenced podling outcomes. It draws on verified public information to help mentors and reviewers recognise early signs of strength or risk in community development.

The examples and patterns below are drawn from the Incubator Case Studies collection, which summarises public ASF information across a range of historical podlings. Not every successful or retired podling is included; the cases presented reflect those documented in the collection and were chosen for their illustrative value, rather than to provide a comprehensive list of outcomes.

The goal is to reinforce timely, transparent, and practical support across all stages of incubation.


How to Use This Guide

Use these patterns as reference points when reviewing reports, mentoring podlings, or participating in graduation discussions. They are not checklists or rules but conversation starters for recognising early signals, supporting timely engagement, and maintaining ASF’s governance standards.


1. Acting Early

Projects in this group benefited from early mentor engagement and active guidance from the IPMC. They demonstrate that incubation is often most effective when ASF processes and communication norms are established from the outset.

Examples: Flink, NiFi, Kylin, Airflow, Storm, APISIX.

Early positive indicators:

Lesson: Early and consistent mentoring strengthens ASF culture, accelerates graduation, and builds durable community habits.


2. Recognised but Delayed Action

In these examples, the IPMC or mentors identified issues but responded or sustained intervention more slowly than ideal. Delays allowed stagnation or weak engagement to persist beyond the point of easy recovery.

Examples: Wave, Superset, Blur.

Observed patterns:

Lesson: Awareness must lead to visible and timely engagement. Prompt, supportive action prevents repeated cycles of low activity or uncertainty.


3. Missing Early Signals

These cases illustrate instances where cultural or governance misalignment was not addressed early in the incubation process. Strong technical output sometimes masked deeper structural challenges that limited long-term sustainability.
These examples describe past stages of incubation and do not reflect the current state of the projects. They illustrate common patterns rather than project-specific causes.

Examples: MXNet, Zipkin, Trafodion.

MXNet

Originally developed at the University of Washington and later supported heavily by AWS.
The IPMC noted the concentration of contributors within one organisation and encouraged broader participation.
Although the project achieved technical success and multiple releases, diversity remained limited throughout graduation, and activity later declined, ultimately leading to its retirement.

IPMC reflection: Sustained concentration within a single organisation can appear stable in the short-term but signals long-term fragility. Diversification and cross-company participation are most effective when reinforced from an early stage.

Zipkin

Entered the Incubator with an existing ecosystem under the OpenZipkin GitHub organisation.
While the community produced releases, most development and discussion continued on external infrastructure and instant messaging channels rather than ASF mailing lists.

The IPMC discussed alignment repeatedly, but differing communication practices persisted, and the community eventually voted to withdraw and continue development outside the ASF.

IPMC reflection: When communication and infrastructure remain outside ASF norms, it indicates limited governance alignment. Early evaluation of cultural fit helps prevent prolonged incubation without integration.

Trafodion

Donated by HP as an SQL on HBase database. The project met the release and process requirements and graduated successfully; however, contributor diversity remained limited, and activity later declined, ultimately leading to retirement.

IPMC reflection: Graduation criteria should include signs of ongoing contributor renewal and independence, not only procedural completion.


4. Outcome

By turning historical cases into structured learning, the IPMC develops institutional awareness of the characteristics of effective oversight. This strengthens mentoring, improves the quality of graduation, and ensures the consistent application of ASF values: transparency, collaboration, and self-governance. In doing so, the Incubator not only supports individual podlings but also contributes to the ASF’s broader ability to sustain healthy, self-directed communities across generations of projects.


5. Mentor Actions and Early Signals

(Practical Application for Mentors)

While this guide focuses on IPMC oversight, the same patterns apply to day-to-day mentoring. Mentors are often the first to notice early signals, and their responses can determine whether a podling strengthens or stalls.

The following practices translate oversight lessons into everyday mentoring habits.

Acting Early: Positive Mentor Habits

Recognising but Delaying Action: Correcting the Pattern

Missing Early Signals: Avoiding Oversight Gaps

Takeaway for mentors:
Timely communication, visible documentation, and early, transparent discussion are the most effective ways to prevent small issues from becoming long-term risks.
Proactive mentoring helps podlings internalise ASF culture and reduces the need for later IPMC intervention.


7. Reflecting on Oversight Challenges

Occasionally, the IPMC or mentors have faced situations where issues were detected too late or not fully understood during the incubation process.
These examples highlight how trust, communication, and verification must work in tandem for effective oversight.

Typical scenarios (generalised for focus on lessons):

Common factors:

Additional observation:
Several past podlings and projects declined when a primary corporate sponsor redirected staff or resources to other initiatives. While such changes are outside ASF's control, they highlight the importance of nurturing independent contributors and ensuring no single organisation is essential to a project's continuity.

IPMC reflection:
Trust is essential, but it must be complemented by periodic verification. Cross-checking mailing list participation, release activity, and contributor diversity helps identify gaps early. When signals are unclear, discussion should begin openly on the podling’s dev@ list, and if issues persist or require broader input, they should be raised transparently on incubator-general for wider guidance.

Lesson:
Reflecting on these challenges helps the IPMC strengthen its oversight and mentor support practices. By treating occasional missteps as opportunities for improvement, the Incubator reinforces transparency, accountability, and trust throughout the ASF.


8. Graduation Deferrals and Lessons

While most podlings graduate on their first proposal, several have had their graduation discussions deferred or repeated. These cases illustrate how the IPMC balances encouragement with due diligence and help define what "readiness" truly means within the ASF culture.

Examples include:

Common reasons for delay:

IPMC reflection:
Deferring graduation is not a failure; it is a safeguard. Handled transparently and constructively, a delay provides podlings the time to mature governance, diversify participation, and address unresolved issues. By asking difficult questions and encouraging measured progress, the IPMC protects both the project’s future and the ASF’s long-term reputation.

Lesson:
Graduation should confirm a community’s independence and resilience, not just procedural completion.
Many of the ASF’s most stable and successful TLPs initially benefited from constructive graduation delays, which allowed for stronger governance and community development.

Thoughtful deferrals demonstrate that oversight is working as intended, ensuring that new TLPs embody the transparency and self-governance at the heart of the Apache Way.


9. Graduation Handoff and Transition

Graduation marks a transition to full project autonomy. Once a podling becomes a TLP, IPMC oversight ends. In many cases, one or more former mentors also join the new PMC and continue helping as PMC participants. This ensures a smooth transition while clearly indicating that responsibility rests entirely with the new PMC.

New PMCs should remain mindful that turnover can affect continuity and alignment with ASF culture. When active members step back, consciously reinforcing transparency, collaboration, and shared responsibility helps preserve the values established during incubation and sustain long-term community health.


Note: This guide draws on ASF public information for shared learning. Through reflection on experience, the IPMC helps sustain ASF culture and the long-term health of its communities.