Difference between revisions of "Infrastructure Team/Migrating to GitHub"

Revision as of 15:55, 17 May 2016

Sugar Activities Developers: Take 10 Minutes to move to Github Today!

Part of the vision of Sugar Labs is to introduce young people to the software freedom movement. A successful introduction means they are actively participating in Sugar's development, and the wider libre software world. The majority of libre software in 2016 is developed on Github, and it advances our cause to use the same collaboration platform as most other project use.

The Sugar codebase has begun transitioning to Github in www.github.com/sugarlabs. So we now invite all Activity developers to do 2 things to complete this transition.

This should take you no more than 10 minutes:

1. Migrate your project source code and issue tracking to Github (https://help.github.com/articles/create-a-repo)

2. Once your project is set up as a Github Repo, please transfer it to github.com/sugarlabs so it is more discoverable (https://help.github.com/articles/transferring-a-repository/)

After the transfer, we'll update the activity.info file of the activity itself with the new URL We'll also invite your Github username to join the github.com/sugarlabs organization, so you can transfer activities to yourself.

No longer involved? To pass your Activity on to the community to maintain, drop a line to <sugar-devel@lists.sugarlabs.org>. If you read this well after May 2016, we may have already forked your repo into the org to maintain an 'official' copy of it, but transferring is better than forking so that Github shows the sugarlabs repo as the 'upstream' repo on network graph pages (example)

New to Github? Check their excellent documentation at guides.github.com, help.github.com, try.github.io

Details

All our code, bugs and discussions should be in one place.

In 2013 Sugar's core components moved from http://git.sugarlabs.org/sugar-old to https://github.com/sugarlabs/sugar, but all issue tracking stayed at bugs.sugarlabs.org instead of moving to https://github.com/sugarlabs/sugar/issues and some code stayed in git.sugarlabs.org and some moved to personal Github username areas.

This scattering

deters new contributors;
makes existing contributor's lives more painful;
wastes time from our systems team volunteers (as we have a hard time keeping hackers out of trac, and need to spend time upgrading any service we run ourselves)

Two solutions have been proposed:

1. Consolidate on Github: Set trac and gitorious read only, and then making it a static html archive, while moving all issue tracking and git hosting of each sugar repo to Github.

2. Abandon Github: Consolidate on our own systems; I guess this means setting up gogs or gitlab to replace gitorious, and perhaps something else to replace trac, and then removing each sugar repo from Github that we control, and regularly encouraging all sugar activities on github to move to our infrastructure.

The developer community has discussed this (thread) and reached consensus in favour of (1) with the following comments:

Benefits of Github Consolidation

Notification: This is handled due to the way that Github org membership works. Github-users in a 'developers' Github-team within the Github-organization will be emailed all posts to all repos that are added to that team (done here, http://imgur.com/gUTNFfV)

Search: Github provides org-wide search, and this is discoverable when you visit github.com/sugarlabs the search input widget at the top changes to show that the search is scoped to that organization. After entering a search query, a familiar search syntax is used in the query, and in the URL string. Eg, https://github.com/search?q=org%3Afontforge+x11&type=Issues

Discoverability: It will be easier for new developers to find and contribute if Sugar is all on github.

Github allows us to separate issue into separate Sugar and Sugar Activity trackers, trackers are found predictably at github.com/sugarlabs/activity-name/issues
It serves as an issue aggregation tool, as all issue trackers in the github.com can be searched by visiting github.com/sugarlabs and using the search input at the very top of the page (example)
https://github.com/sugarlabs/sugar/issues/ can be used as a default issue tracker, if there is any ambiguity on where to file an issue
Issues on Github can be linked to pull requests that resolve them (and even close them automatically by including "closes #issue_id" in the commit/pr message)
Github automatically places backlinks in issues that are referred to by other issuer or PRs, it is relatively convenient to manage the set of a github organization's per-repo issue trackers. Github makes this easy because it will add backlinks in the destination issue's timeline when that issue is mentioned in the original; and it will automatically create such links if you type user/repo#issueNumber :) As an example of this back-linking, see these 2 links, https://github.com/llaske/sugarizer/issues/49 (link at end of first post) and https://github.com/mattlag/Glyphr-Studio/issues/234 (currently link is at the bottom :)

Focus: SugarLabs should focus on core-competencies. Managing version control servers shouldn't be one of them. Support for "how to use git" would be mostly on github rather than SugarLab's systems

Developer Preference: Getting existing Github users to move their activities out of Github doesn't seem realistic. Developers know that Github is stable and has security and longevity. People new to Github have a wider interest in signing up for it - because almost all other libre software projects that they will interact with are currently on the service.

Viability: There are only 182 open issues on bugs.sugarlabs.org so moving them over can be done in a day

Automation: Github enables easier automation of the release process, and easier tying of Sugar Activity version numbers to moments in git commit histories.

Fully Featured: Github doesn't exclude users from features based on their ability to pay; all features are available to non-paying users. Instead of charging for features, they require non-paying users to have all their repos be public; the only thing that they charge for is how many users can participate in private repos. https://github.com/pricing/plans explains this, and there are no gotchas.

Pseudonymity: Github does not require real names. To maintain pseudonymity, you can sign up using http://mailinator.com or a github-specific disposable email account.

Further Actions For The Sugar Labs Team

Set up a "full notifications" team in the github organization so that all github users that join this team get emailed every issue, pr, and comment for every github project within the organization.

Configure all non-github issue trackers to prominently direct users to the new github url, and disallow new issues, or simply to have their theme templates hide the 'new issue' link, and eventually to be configured read only and then fully archived by conversion to a static HTML site.

Review the wiki and website advising users where to post an issue, and update to point to Github

Write a py/js script that uses the Github API to check issue tags are consistent across all SL repos; this can start with a manual checklist to run through when accepting a repo transfer to the sugarlabs org. Also, ensure each activity's /README.md file (that Github presents on github.com/sugarlabs/activity-name as processed markdown) has explicit information about standard things, like where its issue tracker is.

Once all activities are migrated to Github, set the Gitorious and Trac instances to be read-only.

List of Existing Repos To Transfer

On 2016-05-16 https://github.com/search?l=&q=%22from+sugar3.activity+import+activity%22+language%3APython&ref=advsearch&type=Code&utf8=%E2%9C%93 shows 327 code results, which when scraped and deduplicated lists 202 repos that are python sugar activities, which are listed here alphabetically by repo name (so duplicate repo names are adjacent)

Please confirm that the github repository to be transferred is actually the canonical (original source) repository.

@@ Line 89: / Line 89: @@
 * https://github.com/walterbender/abacus
-* https://github.com/Boquete/activity-labyrinth
+* https://github.com/Boquete/activity-sliderpuzzle   (not canonical repo)
-** Canonical repo?
-** https://github.com/labyrinth-team/labyrinth
-** https://git.sugarlabs.org/labyrinth
-* https://github.com/Boquete/activity-sliderpuzzle
 ** Canonical repo?
 ** https://git.sugarlabs.org/slider-puzzle-branch
 * https://github.com/walterbender/AEIOU
 * https://github.com/cristian99garcia/agubrowser-activity
-* https://github.com/puneetgkaur/backup_sugar_sugartoolkit
+* https://github.com/puneetgkaur/backup_sugar_sugartoolkit (not canonical repo)
 * https://github.com/samdroid-apps/bibliography-activity
 * https://github.com/cristian99garcia/blender-activity
-* https://github.com/richaseh/browse
+* https://github.com/richaseh/browse  (not canonical repo)
-* https://github.com/samdroid-apps/browse
+* https://github.com/samdroid-apps/browse  (not canonical repo)
 * https://github.com/sugarlabs/browse-activity
-* https://github.com/iamutkarshtiwari/Browse-fiddleFeature
+* https://github.com/iamutkarshtiwari/Browse-fiddleFeature  (not canonical repo)
-* https://github.com/cristian99garcia/calculator
+* https://github.com/cristian99garcia/calculator  (not canonical repo)
 * https://github.com/llaske/Canope.activity
 * https://github.com/walterbender/cardsort
@@ Line 118: / Line 114: @@
 * https://github.com/walterbender/clipart
 * https://github.com/godiard/clock-activity
-* https://github.com/cristian99garcia/ClockActivity
+* https://github.com/cristian99garcia/ClockActivity  (not canonical repo)
-* https://github.com/tchx84/ClockActivity
+* https://github.com/tchx84/ClockActivity  (not canonical repo)
 * https://github.com/Grumbel/clockgr
 * https://github.com/cristian99garcia/collabedit
@@ Line 153: / Line 149: @@
 * https://github.com/godiard/get-books-activity
 * https://github.com/tchx84/get-books-activity
-* https://github.com/i5o/getbooks
+* https://github.com/i5o/getbooks  (not canonical repo)
 * https://github.com/jdsimmons/getiabooks
 * https://github.com/ezequielpereira/Gmail
@@ Line 160: / Line 156: @@
 * https://github.com/georgejhunt/HaitiDictionary.activity
 * https://github.com/manuq/hello-world
-* https://github.com/erilyth/Hello-World-Python_Sugar
+* https://github.com/erilyth/Hello-World-Python_Sugar  (not canonical repo)
 * https://github.com/godiard/help-activity
 * https://github.com/fdanesse/Historico
@@ Line 178: / Line 174: @@
 * https://github.com/llaske/KAView.activity
 * https://github.com/ezequielpereira/Kiwix
-* https://github.com/cristian99garcia/laybrinth-activity
+* https://github.com/cristian99garcia/laybrinth-activity  (not canonical repo)
+* https://github.com/Boquete/activity-labyrinth  (not canonical repo)
+** Canonical repo?
+** https://github.com/labyrinth-team/labyrinth
+** https://git.sugarlabs.org/labyrinth
 * https://github.com/ezequielpereira/Lemonade
 * https://github.com/walterbender/lettermatch
@@ Line 214: / Line 214: @@
 * https://github.com/cristian99garcia/pocket-lrad-activity
 * https://github.com/cristian99garcia/PolariActivity
-* https://github.com/Daksh/poll
+* https://github.com/Daksh/poll   (not canonical repo)
-* https://github.com/cristian99garcia/poll-activity
+* https://github.com/cristian99garcia/poll-activity   (not canonical repo)
 * https://github.com/godiard/poll-activity
 * https://github.com/walterbender/portfolio
@@ Line 226: / Line 226: @@
 * https://github.com/jdsimmons/readetexts
 * https://github.com/walterbender/recall
-* https://github.com/i5o/record-gtk3
+* https://github.com/i5o/record-gtk3   (not canonical repo)
 * https://github.com/walterbender/reflect
 * https://github.com/walterbender/reflection
-* https://github.com/ShivamNegi/Reflections_Activity
+* https://github.com/ShivamNegi/Reflections_Activity   (not canonical repo)
 * https://github.com/cristian99garcia/riverhex-activity
 * https://github.com/walterbender/ruler
@@ Line 252: / Line 252: @@
 * https://github.com/curiousguy13/sugar-python3-tests
 * https://github.com/prasoon2211/sugar-social-help
-* https://github.com/ceibal-tatu/sugar-toolkit-gtk3
+* https://github.com/ceibal-tatu/sugar-toolkit-gtk3   (not canonical repo)
-* https://github.com/gusDuarte/sugar-toolkit-gtk3
+* https://github.com/gusDuarte/sugar-toolkit-gtk3   (not canonical repo)
-* https://github.com/manuq/sugar-toolkit-gtk3
+* https://github.com/manuq/sugar-toolkit-gtk3   (not canonical repo)
 * https://github.com/sugarlabs/sugar-toolkit-gtk3
 * https://github.com/tchx84/sugar-toolkit-gtk3-1
-* https://github.com/AbrahmAB/sugar-toolkit-gtk3-proto
+* https://github.com/AbrahmAB/sugar-toolkit-gtk3-proto   (not canonical repo)
 * https://github.com/walterbender/sugarchess
 * https://github.com/cristian99garcia/sugarcity-activity
@@ Line 263: / Line 263: @@
 * https://github.com/ezequielpereira/Sugarizehelp
 * https://github.com/llaske/sugarizer
-* https://github.com/erilyth/Sugarizer-Clone-Sugarlabs-
+* https://github.com/erilyth/Sugarizer-Clone-Sugarlabs-   (not canonical repo)
 * https://github.com/godiard/tamtam
-* https://github.com/sethwoodworth/tamtam
+* https://github.com/sethwoodworth/tamtam   (not canonical repo)
-* https://github.com/shridharmishra4/tamtam
+* https://github.com/shridharmishra4/tamtam   (not canonical repo)
 * https://github.com/fdanesse/TamTamMini
 * https://github.com/cristian99garcia/teachteacher-activity
@@ Line 274: / Line 274: @@
 * https://github.com/erik/translate-activity
 * https://github.com/i5o/triples
-* https://github.com/cristian99garcia/turtleart
+* https://github.com/cristian99garcia/turtleart   (not canonical repo)
 * https://github.com/walterbender/turtlepond
 * https://github.com/cristian99garcia/tuxmath-activity