The Apache Software Foundation
The Apache Software Foundation Incubator

Incubator Clutch Status

Clutch is a tool which gathers details about the projects (podlings) currently in incubation and re-generates the table below. A clutch analysis page is generated for each podling along with several data files. Its aim is to encourage and nurture, to provide an overview of the state of establishment of various resources, and to provide quick access to those resources. See definitions and notes below regarding purpose, interpretation, and how to.

Clutch

Clutch last gathered: Wed Jul 17 01:24:27 2019 UTC.

Number of podlings in incubation: 48

Current Board Report: July2019

Quick Notes

  • The orange items indicate where more care and attention is needed.

  • Anything vermilion is an issue that should be addressed ASAP. Admittedly nothing can be done about elapsed time.

  • The bluish-green items indicate success.

  • The yellow items are okay.

  • Click on the column header link for definitions.

  • Click on cells to go to available related resources.

  • Click on the podling name in the first column to go to the podling’s clutch analysis page with deeper and more detailed information.

Podling Sponsor A B C D E F G H I J K L M N O P Q R

Amaterasu

Incubator

2017-09-07

678

False

1

True

2017-09-25

660

0,0,0

7

0

True

True

True

True

True

True

True

True

Annotator

Incubator

2016-08-30

1051

False

1

True

2017-02-13

884

0,0,0

8

0

True

True

True

True

True

False

False

False

BatchEE

Incubator

2013-10-03

2113

False

1

True

2015-01-06

1653

0,0,0

9

0

True

True

True

True

True

True

True

True

BRPC

Incubator

2018-11-13

246

True

3

True

2018-11-23

236

0,0,1

9

0

True

False

True

False

False

False

False

False

Crail

Incubator

2017-11-01

623

False

3

True

2018-01-03

560

0,0,0

10

0

True

True

True

True

True

True

True

True

Daffodil

Incubator

2017-08-27

689

False

3

True

2018-08-28

323

0,0,0

9

0

True

True

True

True

True

True

True

True

DataSketches

Incubator

2019-03-30

109

True

2

True

2019-07-12

5

3,4,-

10

0

True

True

True

True

True

True

True

False

DLab

Incubator

2018-08-20

331

True

3

True

2019-05-21

57

2,2,2

18

0

True

False

True

True

True

True

True

True

Doris

Incubator

2018-07-18

364

False

2

True

2018-08-23

328

0,0,0

13

0

True

True

True

True

True

True

True

True

Druid

Incubator

2018-02-28

504

False

3

True

2019-06-20

27

1,1,1

29

10

True

True

True

True

True

True

True

True

ECharts

Incubator

2018-01-18

545

False

2

True

2018-02-22

510

0,0,0

15

0

True

False

True

True

True

True

True

True

Edgent

Incubator

2016-02-29

1234

False

2

True

2017-05-22

786

0,0,0

11

0

True

True

True

True

True

True

True

True

Flagon

Incubator

2016-07-13

1099

False

1

True

2019-06-13

34

1,3,3

11

0

True

True

True

True

True

True

True

True

Gobblin

Incubator

2017-02-23

874

False

1

True

2017-07-28

719

0,0,0

11

0

True

True

True

True

True

True

True

True

Heron

Incubator

2017-06-23

754

False

2

True

2018-09-21

299

0,0,0

22

0

True

False

True

True

True

True

True

True

Hivemall

Incubator

2016-09-13

1037

False

3

True

2017-02-03

894

0,0,0

10

0

True

True

True

True

True

True

True

True

Hudi

incubator

2019-01-17

181

False

1

True

2019-03-13

126

0,0,10

10

0

True

True

True

True

True

False

False

False

Iceberg

Incubator

2018-11-16

243

True

3

True

2018-11-19

240

0,0,3

7

0

True

True

True

True

True

False

False

False

IoTDB

Incubator

2018-11-18

241

False

3

True

2019-03-07

132

0,0,2

21

0

True

False

True

True

True

False

False

False

Livy

Incubator

2017-06-05

772

False

1

True

2017-06-23

754

0,0,0

10

0

True

False

True

True

True

True

True

True

Marvin-AI

Incubator

2018-08-21

330

False

3

True

2018-11-08

251

0,0,1

13

0

True

True

True

True

True

False

False

False

Milagro

Incubator

2015-12-21

1304

False

1

True

2019-06-02

45

3,3,3

13

0

True

False

True

True

True

False

False

False

MXNet

Incubator

2017-01-23

905

False

1

True

2019-04-14

94

0,3,4

69

0

True

True

True

True

True

True

True

True

Myriad

Incubator

2015-03-01

1599

False

3

True

2019-04-13

95

0,2,5

11

3

True

True

True

True

True

True

True

True

Nemo

Incubator

2018-02-04

528

False

3

True

2018-03-01

503

0,0,0

17

0

True

True

True

True

True

True

True

True

Omid

Incubator

2016-03-28

1206

False

3

True

2018-09-19

301

0,0,0

5

0

True

True

True

True

True

True

True

True

OpenWhisk

Incubator

2016-11-23

966

False

3

True

2019-03-14

125

0,0,2

41

0

True

False

True

True

True

True

True

True

PageSpeed

Incubator

2017-09-30

655

False

2

True

2017-10-02

653

0,0,0

11

0

True

False

True

True

True

False

False

False

Pinot

Incubator

2018-10-17

273

False

2

True

2018-10-25

265

0,0,1

23

0

True

True

True

True

True

True

True

True

Pony Mail

Incubator

2016-05-27

1146

False

3

True

2017-08-01

715

0,0,0

11

0

True

True

True

True

True

True

True

True

Ratis

Incubator

2017-01-03

925

False

2

True

2017-02-02

895

0,0,0

25

0

True

True

True

True

True

True

True

True

Rya

Incubator

2015-09-18

1398

False

1

True

2018-11-25

234

0,0,2

12

2

True

True

True

True

True

True

True

True

S2Graph

Incubator

2015-11-29

1326

False

2

True

2016-05-10

1163

0,0,0

13

0

True

True

True

True

True

True

True

True

SAMOA

Incubator

2014-12-15

1675

False

3

True

2015-01-06

1653

0,0,0

11

0

True

True

True

True

True

True

False

False

SDAP

Incubator

2017-10-22

633

False

2

True

2017-10-26

629

0,0,0

16

0

True

True

True

True

True

False

False

False

ShardingSphere

Incubator

2018-11-10

249

False

3

True

2019-05-07

71

0,1,11

17

0

True

False

True

False

True

True

True

True

SINGA

Incubator

2015-03-17

1583

False

3

True

2019-02-21

146

0,0,1

16

0

True

True

True

True

True

True

True

True

Spot

Incubator

2016-09-23

1027

False

3

True

2016-10-28

992

0,0,0

25

0

True

True

True

True

True

True

True

True

Superset

Incubator

2017-05-21

787

False

3

True

2017-06-26

751

0,0,0

22

0

True

True

True

True

True

True

True

False

Tamaya

Incubator

2014-11-14

1706

False

2

True

2015-08-31

1416

0,0,0

11

1

True

True

True

True

True

True

True

True

Taverna

Incubator

2014-10-20

1731

False

3

True

2018-12-05

224

0,0,1

15

4

True

True

True

True

True

True

True

True

Tephra

Incubator

2016-03-07

1227

False

3

True

2016-11-17

972

0,0,0

8

0

True

True

True

True

True

True

True

True

Toree

Incubator

2015-12-02

1323

False

2

True

2018-09-18

302

0,0,0

9

0

True

True

True

True

True

True

True

True

Training

Incubator

2019-02-21

146

False

2

True

2019-02-28

139

0,0,5

14

0

True

True

True

True

True

True

True

True

Tuweni

Incubator

2019-03-25

114

True

2

True

2019-05-01

77

0,1,-

16

0

True

True

True

True

True

True

True

True

TVM

Incubator

2019-03-06

133

False

1

True

2019-03-11

128

0,0,4

20

0

False

True

True

False

False

False

False

False

Warble

Incubator

2018-06-11

401

False

3

True

2018-09-19

301

0,0,0

6

0

True

False

True

True

True

False

False

False

Weex

Incubator

2016-11-30

959

False

1

True

2019-02-21

146

0,0,2

22

9

True

True

True

True

True

True

True

True

Podling

Sponsor

A

B

C

D

E

F

G

H

I

J

K

L

M

N

O

P

Q

R

Definitions, Notes, and References

The orange and vermilion items indicate where more care and attention is needed. The following notes for each column provide definitions and attempt to link directly to the relevant process documentation:

Podling

The name of each podling is linked to a podling clutch analysis page. If your podling is in incubation, but is missing from the Clutch table, then it still needs to be added to the content/podlings.xml file. See the mentor’s guide. The Projects page is also generated from content/podlings.xml.

Sponsor

Usually podlings are sponsored by the Incubator. Ocassionally podlings are sponsored by other Apache projects. The sponsor is chosen on the proposal. The value is set within the content/podlings.xml entry for the podling.

A: Start Date

This is the date the podling started. Usually this is the date the podling proposal vote passed on the Incubator mailing list. This is set within the content/podlings.xml entry for the podling.

B: Elapsed Days

This is the number of days since the start date. This is color coded according to the normal timeline of a podling. <3, <12, <18, <24, >24 months. We may adjust these levels to better fit currently observed cycles.

C: Reporting Monthly

For the first three months podlings report monthly. If the podling misses reports then they are moved to monthly until they report again.

D: Reporting Group

Which months the podling reports: 1 = January, April, July, October; 2 = February, May, August, November; 3 = March, June, September, December. Note that the report process for a month begins at the end of the prior month. The IPMC chair will send out the reporting schedule on a monthly basis along with reminders to each podling’s dev list.

E: Has Status File

Each podling maintains a status file in content/projects/(podling).xml which is converted to a status page. Your mentor will setup the file and then the podling should maintain it. The key part to maintain is the "News" section where New Committers, PPMC Members, and Releases should be announced. For greater detail, please see:

Click on the link in the cell to view the current status page.

F: Status Update Date

The date status page was last updated. Keep the Status Page up to date with frequent news about:

  • New Committers

  • New PPMC Members

  • New Releases

  • New Repositories

  • New Resources

G: Status Age

Days since the status page was last updated. The text is colored to warn when status is not being kept up to date. <2, <4, <9, >9 months.

H: Status Update Counts

Cumulative number of commits to the podling status file in the previous 2, 4, and 9 months

I: Number of Committers

The total number of committers that have been established to date. Taken from Whimsy via public project ldap. Maintained in Whimsy through the roster pages. Click on the cell to view the public phone book.

J: Number of New Committers

The number of new committers added since establishment. This count is gathered from the Status page "News" section. See guides on voting in new committers and new ppmc members.

K: Has a Code Repository

A Gitbox or Subversion code repository has been created. Projects may have multiple Gitbox repositories. Click on the podling name in the first column to view all of the podling’s repositories. A podling coming to the ASF may need to request a migration or a new repository. The list of Gitbox repositories is retrieved from Gitbox json.

L: Has Issue Tracker

The podling has an Issue Tracker. If the status file has been updated to have an issue tracker link and the link is valid then there will be a link to the tracker in the cell.

M: Has a Dev Mailing List

The podling has established a dev mail list and archives. This is picked up from the status page and then confirmed for the usual naming pattern. If the list is available the cell will link to the mailbox archive podling dev list.

N: Has a Commits Mailing List

The podling has established a commits mail list and archives. This is picked up from the status page and then confirmed for the usual naming pattern. If available he cell will link to the mailbox archive podling commits list. Sometime a podling will start by directing code repository and issue tracker notification emails to their dev list. This will often obscur meaningful conversation.

O: Has a Web Site

Podlings should maintain a website so that their users can find out information about the podling and The Apache Software Foundation. Here is the incubator’s website guide. If the website is not provided in the status file then the usual naming patterns are tried. Assuming that the website exists the cell will provide a link to it. Whimsy provides a periodic scan of podling websites which you can view here. The clutch process uses json data to add notes about website issues to the podling’s clutch analysis page under "Errata".

P: Has a Distribution Area

The podling has a directory in the incubator’s release distribution directory. If this is present the cell provides a link.

Q: Has Release Signing Keys

The podling has a PGP "Signing KEYS" file in their distribution area. If this is present then the cell provides a link. There is a facility that performs periodic checks on Apache releases and signatures - "release checker".

R: Has a Release in the Distribution Area

The podling has a release in their distribution area. Podlings are expected to comply with release and release distribution policies as modified by the Incubator.

If there is a podling release then the cell will provide a link to the podling’s clutch analysis page’s release section.

Graduating

Once the Board has approved the podling’s graduation resolution, update your podling metadata in the content/podlings.xml file as you progress through graduation. Do various tasks as listed in the documentation, such as a final tidy of the status page. See Infrastructure steps for graduation.

Retirement

Once the Incubator PMC has agreed to retirement, update the podling metadata and tidy the status page. If the podling is continuing development elsewhere then make sure that the new location is provided. When this occurs chances are someone on the IPMC will handle these duties ad hoc.

Other Issues

Sometimes other issues are found which are listed below for:

  • dubbo

  • flagon

  • joshua

  • netbeans

  • plc4x

  • samoa

  • skywalking

  • toree

  • unomi

  • zipkin

Assist with Incubation Steps

Essentially Clutch is helping us all to follow the process from the "Acceptance" phase onwards. Any committer on a podling can help with these steps. Don’t leave it to your mentors, although there are some steps that only they can do.

Mentors

This list is gathered from the Projects in incubation summary table. The Mentors are ASF members or individuals recognized by the IPMC who have chosen to assist these projects. The best way to find mentors for a new project, is during your Discuss and Proposal phases on the general@ mail list.

  1. Alan Gates (gates): Omid, SAMOA, SINGA, Superset, Tephra

  2. Ashutosh Chauhan (hashutosh): SAMOA, Superset

  3. Atri Sharma (atri): Flagon

  4. Benjamin Hindman (benh): Myriad, ShardingSphere

  5. Bertrand Delacretaz (bdelacretaz): OpenWhisk

  6. Bikas Saha (bikas): Livy

  7. Billie Rinaldi (billie): Rya

  8. Bob Paulin (bob): MXNet

  9. Brock Noland (brock): Livy

  10. Byung-Gon Chun (bgchun): Nemo, TVM

  11. Carl Steinbach (cws): Iceberg

  12. Chris Lambertus (cml): Warble

  13. Christofer Dutz (cdutz): Daffodil, Edgent, IoTDB, Training

  14. Craig Russell (clr): ShardingSphere, Training

  15. Daniel Dai (daijy): Hivemall

  16. Daniel Takamori (pono): Warble

  17. Dave Fisher (wave): Daffodil, Doris, ECharts, Heron, Tuweni

  18. David Blevins (dblevins): Tamaya

  19. David Meikle (dmeikle): Flagon

  20. Davor Bonaci (davor): Amaterasu, Nemo

  21. Devaraj Das (ddas): Ratis

  22. Felix Cheung (felixcheung): Crail, Pinot

  23. Furkan Kamaci (kamaci): DataSketches, Tuweni, TVM

  24. Henri Yandell (bayard): MXNet

  25. Henry Saputra (hsaputra): DLab, TVM

  26. Hyunsik Choi (hyunsik): Nemo

  27. Jake Farrell (jfarrell): Heron

  28. Jakob Homan (jghoman): Ratis, Superset

  29. James Taylor (jamestaylor): Iceberg, Omid, Tephra

  30. Jan Piotrowski (janpio): Weex

  31. Jason Dai (jasondai): MXNet

  32. Jean-Baptiste Onofré (jbonofre): Amaterasu, BatchEE, BRPC, Gobblin, Livy, Nemo, Tuweni

  33. Jean-Frederic Clere (jfclere): Milagro

  34. Jim Jagielski (jim): Gobblin, Pinot, Tuweni

  35. John D. Ament (johndament): ECharts, Pony Mail, Tamaya

  36. Josh Elser (elserj): Rya

  37. Jukka Zitting (jukka): PageSpeed

  38. Julian Hyde (jhyde): Crail, Druid

  39. Julien Le Dem (julien): Heron, Iceberg, Toree

  40. Jun Rao (junrao): Druid

  41. Justin Mclean (jmclean): Edgent, IoTDB, Training

  42. Jörn Rottmann (joern): SDAP

  43. Kanchana Pradeepika Welagedara (kanchana): Tamaya

  44. Kenneth Knowles (kenn): DataSketches, Tuweni

  45. Kevin A. McGrail (kmcgrail): BRPC, ECharts, IoTDB

  46. Kishore Gopalakrishna (kishoreg): Hudi, Pinot

  47. Koji Sekiguchi (koji): Hivemall

  48. Konstantin I Boudnik (cos): DLab

  49. Krzysztof Sobkowiak (ksobkowiak): OpenWhisk

  50. Lars Francke (larsfrancke): Training

  51. Lars Hofhansl (larsh): Omid

  52. Leif Hedstrom (zwoop): PageSpeed

  53. Lewis John McGibbney (lewismc): Flagon

  54. Liang Chen (chenliang613): DataSketches

  55. Luciano Resende (lresende): Crail, Edgent, Hudi, Livy, Marvin-AI, Toree

  56. Mark Struberg (struberg): BatchEE

  57. Markus Weimer (weimer): MXNet, Nemo

  58. Matt Sicker (mattsicker): OpenWhisk

  59. Michael Wall (mjwall): MXNet, Tuweni

  60. Myrle Krantz (myrle): Weex

  61. Nick Kew (niq): Annotator, Milagro, PageSpeed

  62. Olivier Lamy (olamy): Amaterasu, BatchEE, Gobblin, Pinot

  63. Owen O’Malley (omalley): Iceberg

  64. P. Taylor Goetz (ptgoetz): DLab, Druid, Heron

  65. Phil Sorber (sorber): PageSpeed

  66. Roman Shaposhnik (rvs): Pinot

  67. Ryan Blue (blue): Iceberg, Toree

  68. Sebastian Schelter (ssc): TVM

  69. Sergio Fernández (wikier): S2Graph

  70. Shao Feng Shi (shaofengshi): Doris

  71. Sharan Foga (sharan): Pony Mail

  72. Steve Blackmon (sblackmon): Annotator

  73. Stian Soiland-Reyes (stain): Taverna

  74. Suneel Marthi (smarthi): Hudi

  75. Ted Dunning (tdunning): Myriad, SINGA

  76. Ted Liu (tedliu): ECharts

  77. Thejas Nair (thejas): SINGA

  78. Thomas Weise (thw): Hudi

  79. Tianqi Chen (tqchen): TVM

  80. Tim Allison (tallison): Flagon

  81. Timothy Chen (tnachen): TVM

  82. Tommaso Teofili (tommaso): Annotator

  83. Trevor Grant (rawkintrevo): SDAP

  84. Uma Maheswara Rao G (umamahesh): Ratis, Spot

  85. Von Gosling (vongosling): BRPC, ShardingSphere

  86. Willem Ning Jiang (ningjiang): Doris, IoTDB, ShardingSphere, Weex

  87. William Colen (colen): Marvin-AI

  88. Woonsan Ko (woonsan): S2Graph

  89. Xiangrui Meng (meng): Hivemall

Notes

Any Incubator committer can run 'clutch'. In the top-level of the SVN repos incubator/public/trunk SVN, do: './clutch2.sh' which will re-generate the data files and Asciidoctor files for the clutch. This is all a part of the normal build in GIT: Incubator Git. See the Readme.

Clutch reads the source file for the projects currently in incubation table (i.e. content/podlings.xml), ensures that each new project has an entry, adds some more attributes. Clutch then gathers some data from each project’s Status page and validates that certain resources are established and steps are achieved.

Clutch output includes data files

Podling Clutch Analysis Page

The clutch analysis both fills the data included on this page and creates an analysis for each podling that can be linked to from the podling name in the clutch table.

Description

  • The podling description from content/podlings.xml

  • The podling start date.

  • The date of the last update of project/status.xml.

  • The reporting cycle.

  • The number of committers and ppmc members. Indication if these are equal.

  • Mentor list including apache ids.

News

  • Copies the news from the podling status page

Resources

Listing of various podling resources

Project Website

Link to podling’s public website

Mailing lists
  • Developer mailing list archive

  • Commits mailing list archive

Issue Tracker

Link to issue tracker

Wiki

Link to wiki

Repositories
  • Detailed list of gitbox repos from infra’s ground truth for the podling.

  • Link to any subversion repository.

  • For each gitbox repos:

    • Gitbox link

    • Github link

    • Description

    • Number of commits

    • Date of last commit

Releases

Information about the podling’s release harvested by reviewing the distribution area’s svn repository.

Current

Current releases:

  • Link to the signing key, if it exists.

  • Link to instructions on how to verify a release.

  • Release list is suppressed if there are no signing keys

  • For each release:

    • Download link using closer.lua

    • Signature link

    • Hash link

    • Size of the download file

    • Date that the release was added to the distribution area.

    • User who moved the release.

    • Revision in the svn repository.

Errata

Issues which may require further work.

  • Errata has a list of potential issues identified for the podling

  • Critical issues are in bold.

  • Links to pages on how to resolve the issue

  • Link to the whimsy podling site scan

Data files

Data files are also generated so that other tools can easily re-use the metadata for the set of projects currently in incubation:

  • clutch.txt - list of projects, one per line. Comma-separated values (CSV).

  • clutch.pkl - a Python "pickle" file with various attributes (it is in the top-level of SVN incubator/public/trunk).

  • One text file for each Reporting group listing the dev mail address of the podlings due to report in that group. (See report_due_1.txt, report_due_2.txt, and report_due_3.txt) These are used by the IPMC to send monthly report alert reminders.

  • podlings_graduated.txt - list of graduated podlings, one per line with start and end dates.

  • podlings_retired.txt - list of retired podlings, one per line with start and end dates.

Other Issues

Occasionally there are other issues, usually regarding podlings not cleaning up after their "graduation".

  • dubbo: Has graduated, but still has remains on Incubator distribution mirrors. See help.

  • flagon: Has a distribution filename missing the word "incubating/incubator". See help.

  • joshua: Has graduated, but still has remains on Incubator distribution mirrors. See help.

  • netbeans: Has a distribution filename missing the word "incubating/incubator". See help.

  • netbeans: Has graduated, but still has remains on Incubator distribution mirrors. See help.

  • plc4x: Has graduated, but still has remains on Incubator distribution mirrors. See help.

  • samoa: Apache Releases cannot be validated without a KEYS file. Please add required KEYS!

  • skywalking: Has graduated, but still has remains on Incubator distribution mirrors. See help.

  • toree: Has a distribution filename missing the word "incubating/incubator". See help.

  • unomi: Has a distribution filename missing the word "incubating/incubator". See help.

  • unomi: Has graduated, but still has remains on Incubator distribution mirrors. See help.

  • zipkin: retired project has remains on Incubator mirrors. See help.

Further Notes

The clutch is the set of eggs which have been laid. The mother hen (our Incubator PMC) needs to continually gather them, to ensure that none have rolled from the nest or moved to the outside, being forgotten or becoming cold. Clutch also means to grasp eagerly.

So please interpret this table and the detailed pages from the point-of-view of encouragement and nurture.

Origin

The nest was becoming full, some podlings were forgotten, rolled into dark corners: a new tool "clutch" was created to assist oversight of all podlings (gmane link is now missing). The clutch was started 2008-10-19. (missing gmane link) There was prior list discussion. Also see INCUBATOR-78

Colour Scheme

The colours for the table were specifically chosen to assist with colour-blindness and general accessibility. See the email discussion that led to this Re: Clutch color coding. 2008-12-04 http://s.apache.org/clutch_colour and see some testing notes and demonstrations.

Thanks again to: "Color Universal Design (CUD) - How to make figures and presentations that are friendly to Colorblind people." Masataka Okabe and Kei Ito. (http://jfly.iam.u-tokyo.ac.jp/color/