The Apache Software Foundation
Apache Incubator

Status of the clutch currently in incubation

Clutch is a tool which gathers details about the projects currently in incubation and re-generates the table below. It aims to encourage and nurture, to provide an overview of the state of establishment of various resources, and to provide quick access to those resources. See more notes below regarding purpose and interpretation.

  • The orange items indicate where more care and attention is needed. Anything vermilion is an issue that should be addressed ASAP. The bluish-green items indicate success and the yellow items are okay.
  • A: startDate
  • B: elapsedDays - <3 <12 <18 <24 >24 months
  • C: reportingMonthly (current report: October2014 )
  • D: reportingGroup - in which set of months do they report:
    group-1=Jan,Apr,Jul,Oct group-2=Feb,May,Aug,Nov group-3=Mar,Jun,Sep,Dec
  • E: hasReportingGroup - did podling remember to choose a group
  • F: hasStatusEntry in the main "Currently in incubation" table (i.e. i.a.o/projects generated from content/podlings.xml)
  • G: statusUpdateDate - the status page was last updated
  • H: statusAge - days since the SVN status page was last updated - <2 <4 <9 >9 months
  • I: statusUpdateCounts - number of commits to status file in the previous 2,4,9 months (cumulative)
  • J: numberCommitters - accounts have been established, total number to date
  • K: numberCommittersNew - new committers added since establishment (gathered from each project's Status page "News" section)
  • L: hasSvn - Subversion repository is created
  • M: hasTracker - has an Issue Tracker
  • N: hasMailListDev - has dev mail list and archives
  • O: hasMailListCommits - has commits mail list and archives
  • P: hasWebSite
  • Q: hasDistributionArea - has w.a.o/dist/incubator/... area (not necessarily yet a release)
  • R: hasKeys - has a PGP "KEYS" file in their distribution area
  • S: hasRelease - has a release in their distribution area
  • other persistent data files
  • other issues listed below for: amber celix easyant helix phoenix storm

Clutch last gathered: Mon Oct 20 00:22:54 2014 UTC.
Number of podlings in incubation: 32

Project Sponsor A B C D E F G H I J K L M N O P Q R S
Argus Incubator 2014-07-24 False group-3 True True 2014-10-01 1,6,- 12 0 True True True True True True True False
Aurora Incubator 2013-10-01 False group-1 True True 2014-09-29 1,1,3 12 3 True True True True True True True True
BatchEE Incubator 2013-10-03 False group-2 True True 2013-12-29 0,0,0 - 0 True True True True True False False False
Blur Incubator 2012-07-24 False group-2 True True 2013-10-03 0,0,0 8 0 True True True True True True True True
Brooklyn Incubator 2014-05-01 False group-3 True True 2014-07-02 0,3,5 - 0 True True True True True False False False
Calcite Incubator 2014-05-19 False group-1 True True 2014-10-01 2,3,5 - 0 True False True True False True True True
DataFu Incubator 2014-01-05 False group-1 True True 2014-01-13 0,0,0 14 0 True True True True True False False False
DeviceMap Incubator 2012-01-03 False group-1 True True 2014-09-29 1,1,1 14 2 True True True True True True True True
Drill Incubator 2012-08-11 False group-3 True True 2014-09-27 1,1,1 21 0 True True True True True True True True
Droids HttpComponents, Lucene 2008-10-09 False group-2 True True 2012-03-02 0,0,0 9 0 True True True True True True True True
Falcon Incubator 2013-03-27 False group-3 True True 2014-10-10 2,2,5 15 0 True True True True True True True True
Hadoop Development Tools Incubator 2012-11-09 False group-2 True True 2014-05-15 0,0,1 6 0 True True True True True True True True
Ignite Incubator 2014-10-01 True group-3 True True 2014-10-19 4,-,- 5 0 True False False False False False False False
Johnzon Incubator 2014-06-09 False group-3 True True 2014-10-05 5,5,6 10 1 True True True True True True True True
Project Sponsor A B C D E F G H I J K L M N O P Q R S
Kalumet Incubator 2011-09-20 False group-3 True True 2014-01-17 0,0,0 - 0 True True True True True True False False
log4cxx2 Logging Services 2013-12-09 False group-3 True True 2013-12-16 0,0,0 - 0 True True True False True False False False
MetaModel Incubator 2013-06-12 False group-1 True True 2014-10-03 2,3,3 9 1 True True True True True True True True
MRQL Incubator 2013-03-13 False group-3 True True 2014-06-14 0,0,1 12 0 True True True True True True True True
NPanday Incubator 2010-08-13 False group-2 True True 2014-08-04 0,7,7 9 0 True True True True True True True True
ODF Toolkit Incubator 2011-08-01 True group-1 True True 2014-01-17 0,0,0 - 1 True True True True True True True True
Parquet Incubator 2014-05-20 False group-1 True True 2014-09-29 1,1,5 15 0 True True True True True False False False
REEF Incubator 2014-08-12 True group-2 True True 2014-10-07 4,5,- 24 0 True True True False False True True False
Ripple Incubator 2012-10-16 True group-1 True True 2013-03-21 0,0,0 10 0 True True True True True False False False
Samza Incubator 2013-07-30 False group-1 True True 2014-04-18 0,0,1 12 0 True True True True True True True True
Sentry Incubator 2013-08-08 False group-3 True True 2014-06-04 0,0,1 25 0 True True True True True True True True
Sirona Incubator 2013-10-15 False group-2 True True 2013-12-10 0,0,0 - 0 True True True True True True True True
Slider Incubator 2014-04-29 False group-2 True True 2014-09-24 1,1,9 12 1 True True True True True True True True
Streams Incubator 2012-11-20 False group-3 True True 2014-01-13 0,0,0 13 2 True True True True True True True False
Twill Incubator 2013-11-14 False group-2 True True 2014-01-31 0,0,1 7 0 True True True True True True True True
Usergrid Incubator 2013-10-03 False group-1 True True 2014-09-13 2,2,2 10 7 True True True True True True True True
Wave Incubator 2010-12-04 False group-3 True True 2013-08-03 0,0,0 27 0 True True True True True True False False
Project Sponsor A B C D E F G H I J K L M N O P Q R S

Other issues

Occasionally there are other issues, usually regarding podlings not cleaning up after their "graduation".

  • amber: Has graduated, but still has remains on Incubator distribution mirrors. See help.
  • celix: Has graduated, but still has remains on Incubator distribution mirrors. See help.
  • easyant: Has graduated, but still has remains on Incubator distribution mirrors. See help.
  • helix: Has graduated, but still has remains on Incubator distribution mirrors. See help.
  • phoenix: Has graduated, but still has remains on Incubator distribution mirrors. See help.
  • storm: Has graduated, but still has remains on Incubator distribution mirrors. See help.

Notes

Any Incubator committer can run 'clutch'. In the top-level of the "incubator/public/trunk" SVN, do: 'python3 clutch.py' which will re-generate some xml entities for the data. The normal site build process will automatically combine these with the "content/clutch.xml" source. Do 'svn diff' to see what changed. Then build and deploy the site as normal.

Clutch reads the source file for the "projects currently in incubation" table (i.e. content/podlings.xml), ensures that each new project has an entry, adds some more attributes. Clutch then gathers some data from each project's Status page, makes other guesses, and validates that certain facilities are established and steps are achieved.

The clutch is the set of eggs which have been laid. The mother hen (our Incubator PMC) needs to continually gather them, to ensure that none have rolled from the nest or moved to the outside, being forgotten or becoming cold. Clutch also means to grasp eagerly.

So please interpret this table from the point-of-view of encouragement and nurture.

Assist with Incubation Steps

Essentially Clutch is helping us all to follow the process from the "Acceptance" phase onwards (explained in Process Description and Incubation Policy and Mentor Guide and Other Guides and summarised at Podling Bootstrap). Any committer on a podling can help with these steps. Don't leave it to your mentors, although there are some steps that only they can do.

The first steps are the "Acceptance" phase. See doc and doc and doc.

The orange and vermilion items indicate where more care and attention is needed. The following notes for each column, expand on the column definitions above and attempt to link directly to the relevant process documentation:

  • Project - If your project is in incubation, but is missing from the Clutch table, then you have forgotten to add it to the podlings.xml file. (See doc and notes for "hasStatusEntry" below.)
  • Project - If this cell is highlighted with a border, then this project is in the process of graduating or retiring, and not yet finished their move. Hence resources (e.g. mail lists, svn) seem to disappear as they migrate. See Other issues below.
  • Sponsor - This information is gathered from the list of Projects in incubation summary table. The "not known" is because it is missing from that table. See notes for "hasStatusEntry" below.
  • A: startDate - This information is gathered from the list of Projects in incubation summary table. The "not known" is because it is missing from that table. See notes for "hasStatusEntry" below.
  • B: elapsedDays - Calculated from startDate.
  • C: reportingMonthly - Your project PPMC should manage your entry in the podlings.xml file
  • D: reportingGroup - in which set of months do they report.
  • E: hasReportingGroup - did podling remember to choose a group. See notes for "Project" above.
  • F: hasStatusEntry in the Currently in incubation table (i.e. generated from content/podlings.xml) and has an associated project Status page. (doc and doc and doc and doc and doc)
  • G: statusUpdateDate - the status page was last updated. Clutch does an 'svn log' query for the project's Status page.
  • H: statusAge - days since the SVN status page was last updated
  • I: statusUpdateCounts - number of commits to status file in the previous 2,4,9 months (cumulative). Clutch does an 'svn log' query for the project's Status page, and counts the edits for those time ranges.
  • J: numberCommitters - accounts have been established, total number to date. Clutch parses the relevant section of the ASF Committers by Project Modules page and counts the total, including mentors.
  • K: numberCommittersNew - new committers added since establishment (gathered from each project's Status page "News" section). Clutch parses the News section and detects the string "new committer", counting each matched line. See notes for "hasStatusEntry" above. (doc and doc and doc)
  • L: hasSvn - Subversion repository is created. (doc and doc)
  • M: hasTracker - has an Issue Tracker
  • N: hasMailListDev - Hints about mail list names are gathered from their Status page, then tries standard convention, then verifies that the mailing lists are established, then ensures that the mail archives are now available.
  • O: hasMailListCommits - see above.
  • P: hasWebSite -
  • Q: hasDistributionArea - has w.a.o/dist/incubator/... area (not necessarily yet a release)
  • R: hasKeys - has a PGP "KEYS" file in their distribution area. This utilises Henk's md5 checker which gathers the list of all KEYS files.
  • S: hasRelease - has a release in their distribution area. The test is whether they have a signature file (*.asc or *.sig ) associated with a source release artifact (*.tar.gz or *.tgz or *.bz2 or *zip) and the filename includes the word "incubating". (doc and doc)
  • otherIssues - When projects graduate or become retired, then they need to clean up.
  • Graduating: Update your project metadata in the content/podlings.xml file as you progress through the graduation phases. Do various other tasks listed in the docs, such as final tidy of Status page, tidy your old release distribution area, etc. (doc and doc and doc)
  • Retiring: In the Projects in incubation table, mark its status as "retired". (doc)

Mentors projects

This list is gathered from the Projects in incubation summary table. The Mentors are ASF members who have chosen to assist these projects. The best way to find mentors for a new project, is during your Discuss and Proposal phases on the general@ mail list.

  • Alan Cabrera: MRQL
  • Alan Gates: Argus, Falcon, Calcite
  • Alex Karasulu: Brooklyn, MRQL
  • Andrei Savu: Brooklyn, Twill
  • Andrew Savory: DeviceMap, Ripple
  • Anthony Elder: MRQL
  • Arun C Murthy: Slider, Twill
  • Arun Murthy: Samza
  • Arvind Prabhakar: MetaModel, Sentry
  • Ashutosh Chauhan: DataFu, Flink
  • Ate Douma: Streams
  • Benjamin Hindman: Aurora
  • Bertrand Delacretaz: DeviceMap
  • Branko Čibej: Ignite
  • Chip Childers: Brooklyn
  • Chris Douglas: Falcon, REEF, Samza
  • Chris Mattmann: Aurora, Hadoop Development Tools, Parquet, REEF
  • Christian Grobmeier: log4cxx2, Ripple, Wave
  • Craig McClanahan: Streams
  • Daniel Gruno: Argus
  • Daniel Kulp: Johnzon
  • Dave Johnson: Usergrid
  • David Nalley: Brooklyn, Sentry
  • Devaraj Das: Argus, Falcon, Slider
  • Doug Cutting: Blur
  • Grant Ingersoll: Drill
  • Henri Gomez: Kalumet, Sirona
  • Henry Saputra: Aurora, Flink, Ignite, MetaModel
  • Isabel Drost: Drill
  • Jake Farrell: Aurora, Parquet, Usergrid
  • Jakob Homan: Argus
  • Jean-Baptiste Onofre: Kalumet, Sirona
  • Jean-Baptiste Onofré: BatchEE, Brooklyn, Slider
  • Jim Jagielski: Brooklyn, Kalumet, Usergrid
  • Joe Brockmeier: Brooklyn, Sentry
  • Jukka Zitting: Ripple
  • Justin Mclean: Johnzon
  • Kevan Miller: DeviceMap
  • Konstantin Boudnik: Ignite, NPanday
  • Lewis John Mcgibbney: Usergrid
  • Luciano Resende: Usergrid
  • Mahadev Konar: Slider
  • Marcel Offermans: Brooklyn
  • Mark Struberg: BatchEE, Sirona
  • Matt Franklin: MetaModel, Streams
  • Matt Hogstrom: Brooklyn
  • Michael Stack: Ignite
  • Mohammad Nour El-Din: MRQL
  • Nick Burch: ODF Toolkit
  • Noah Slater: MetaModel
  • Olivier Lamy: BatchEE, Brooklyn, Kalumet, Sentry, Sirona
  • Owen O'Malley: Argus, Falcon, Flink, REEF
  • Patrick Hunt: Blur, Sentry, Twill
  • Raphael Bircher: NPanday
  • Richard Frovarp: Droids
  • Roman Shaposhnik: DataFu, Hadoop Development Tools, Ignite, Parquet, Samza
  • Ross Gardler: REEF
  • Sam Ruby: ODF Toolkit
  • Scott Deboy: log4cxx2
  • Sean Owen: Flink
  • Steven Noels: Calcite
  • Suresh Marru: Hadoop Development Tools
  • Tammo van Lessen: Sirona
  • Ted Dunning: DataFu, Drill, Flink, Calcite
  • Thomas White: Sentry
  • Thorsten Scherler: Droids
  • Tim Williams: Blur
  • Tom White: Parquet, Twill
  • Upayavira: Wave
  • Yegor Kozlov: ODF Toolkit

Data files

Data files are also generated so that other tools can easily re-use the metadata for the set of projects currently in incubation:

  • clutch.txt - list of projects, one per line. Comma-separated values (CSV).
  • clutch.pkl - a Python "pickle" file with various attributes (it is in the top-level of SVN incubator/public/trunk).
  • report-groups.txt - list of current projects showing their report groups.
  • One text file for each Reporting group listing the dev mail address of the group of projects due to report. (See report_due_[1-3].txt) This is used by other systems to send monthly marvin mail alert reminders.
  • Structured list of various details. Not yet happening - need to decide which format (e.g. RDFa, etc.) and which attributes to be stored.

Other Notes

Origin

The nest was becoming full, some podlings were forgotten, rolled into dark corners: new tool "clutch" assist oversight of all podlings 2008-10-19 (http://s.apache.org/clutch_start). There was prior list discussion. Also see INCUBATOR-78

Colour Scheme

The colours for the table were specifically chosen to assist with colour-blindness and general accessibility. See the email discussion that led to this: Re: Clutch color coding 2008-12-04 (http://s.apache.org/clutch_colour). and see some testing notes and demonstrations.

Thanks again to: "Color Universal Design (CUD) - How to make figures and presentations that are friendly to Colorblind people." Masataka Okabe and Kei Ito. (http://jfly.iam.u-tokyo.ac.jp/color/)

Other Summaries

A time-plot of Apache Incubator history.