Difference between revisions of "Platform Team/Server Kit/Architecture"

From Sugar Labs
Jump to navigation Jump to search
Line 1: Line 1:
== Intention ==
+
== The purpose ==
  
This project is an attempt to refocus the School Server paradigm from "only a School Server on a server at school" to "having  tough and localized software components to use for a purpose". The core component, sugar-server, should just work after installing from packages if a school needs only basic functionality in an already set up environment. It works without close maintenance from skilled personal. But if a school or deployment needs more functionality, and they have spare servers, the additional components might be used to fulfill local needs.
+
{{:Sugar_Server_Kit/Architecture/The_purpose}}
  
* Be a community project within Sugar Labs to keep core development processes in one place;
+
== Server functionality models ==
* It is not about configuring and supporting the whole server at school from scratch, but about having a set of tough, local, doing its job well modules that might be included/excluded in downstream solutions;
 
* Friendly support of customization on purpose in downstream products:
 
** Modularizing, when components might be included on purpose to fulfill local needs,
 
** Not patching in downstream, but supplementing the upstream, e.g., install upstream packages and just add new packages with local customization or overrides (but not overriding installed files to let PMS work smoothly) of upstream,
 
** Provide useful API for components;
 
* Be GNU/Linux distribution agnostic, different deployments might decide to use different GNU/Linux distributions.
 
* It is not only about supporting XO laptops, but about any Sugar based environments;
 
* Support up to 1000 students per server.
 
  
== Functionality model ==
+
Sugar Server Kit components are being designed to accomplish different functionality models, when the particular model might include only limited number of ingredients. The following models might describe Sugar Server Kit design, the final model might be an intermediate variant of them.
  
This is all about how improved functionality of servers at schools might look, at least, Sugar Server Kit is being designed and implemented in this direction. Sugar Server Kit is not intended to cover all the components described here. It is just the global picture from a Sugar Server Kit point of view.
+
=== Only sugar-server ===
  
Two pure models might describe Sugar Server Kit design, the final model might be an intermediate variant of them.
+
The model with minimal Sugar Server Kit design influence.
  
=== Black box model ===
+
The key points:
 +
 
 +
* Existing and configured out of Sugar Server Kit servers at schools.
 +
* School admins need to take care about setting up sugar-server specific [[Sugar_Server_Kit/sugar-server#Services|requirement configuration]] for external environment.
 +
* School admins install the sugar-server package from upstream binary repository, and just launch it.
 +
* sugar-server starts to serve all sugar boxes around, providing only [[#sugar-server|basic sugar specific]] functionality.
 +
* sugar-server doesn't break the system configuration (it touches nothing).
 +
 
 +
=== Dumb school servers ===
  
 
The model where the server at school is entirely dependent on Sugar Server Kit design decisions. There are two types of machines:
 
The model where the server at school is entirely dependent on Sugar Server Kit design decisions. There are two types of machines:
  
* servers at schools under Sugar Server Kit control
+
* Dumb servers at schools under Sugar Server Kit control. The explicit intention is to minimize maintaining intervention as much as possible.
* optional mothership(s) to control school servers
+
* The Mothership to minimal control of school servers and handling the rest of functionality that people at schools need.
  
 
The key points:
 
The key points:
  
* Functionality of such servers is simple, only basic services. (Complex, thus not trivial for maintenance, services are on the mothership, where skilled personal can support them effectively.)
+
* Functionality of school servers is simple, only basic services.
* The rest of school server functionality (which is not simple) is configured automatically.
+
* Complex, thus not trivial for maintenance, services are on the mothership and singular, i.e., to minimize maintaining costs and let the minimal number of skilled personal support them effectively.
* Interaction only happens via these flows, via Internet if connectivity is good, and via sneakernet otherwise:
+
* A set of school server's services tends to be constant, at least it doesn't require regular intervention to add/remove services.
*# Incoming system updates flow (also, the way to trigger some configuration changes). This should be rare and a batch process.  
+
* All school serves have exactly the same set of services.
*# Incoming data flow for sugar related stuff like leases, activities, or content.
+
 
*# Outgoing data flow to monitor servers.
+
This functionality model involves Mace and sugar-server-templates components. The entirely content of school servers is:
  
=== One package model ===
+
* a set of packages, including the main one that contains:
 +
** all services as dependencies,
 +
** upstream Mace configuration as sugar-server-templates dependency,
 +
** downstream Mace configuration;
 +
* Mace environment file, e.g., the one from sugar-server-templates [http://git.sugarlabs.org/server/templates/blobs/master/etc/base.env.example examples];
 +
* pure data, like leases and content black lists, to fetch as-is from the Mothership.
  
The model with minimal Sugar Server Kit design influence:
+
After installing the main package, it will provide possibility to fetch Mace environment file and pure data from the Mothersip, and finally running Mace to complete school server setup.
  
* existing and configured out of Sugar Server Kit servers at schools
+
=== Highly maintained school servers ===
* the remaining environment that Sugar Server Kit is not aware of
 
  
The key points:
+
''TODO''
 +
 
 +
== Client functionality models ==
  
* Servers at schools are supported out of Sugar Server Kit.
+
''TODO''
* Admins install the sugar-server package from upstream binary repositories, and just launch it.
 
* sugar-server starts to serve all sugar boxes around, providing only [[#sugar-server|basic sugar specific]] functionality.
 
* sugar-server doesn't break the system configuration (it touches nothing).
 
  
 
== Distribution model ==
 
== Distribution model ==

Revision as of 03:48, 6 November 2011

The purpose

The Sugar Server Kit initiative is an attempt to achieve the following major goals:

  • Provide a split between the community level project (Sugar Server Kit) and any number of downstream solutions based on the community project. This should stimulate the downstream community to contribute to this upstream community project, facilitating reuse of its experience in all other downstreams;
  • Treat the community project as a collection of useful tools, created and supported by community contributors, that might be composed into a final deployment solution on purpose, i.e., Sugar Server Kit is not an OS or a final solution, but rather a bunch of tools that might be launched on any major GNU/Linux distribution at the deployment level. And because some of these tools might be implemented in several ways, it should make the acceptance process of new features by upstream more flexible;
  • The whole system should be as reliable as possible. Thus, the community project will provide a decent testing environment (several levels of automatic and human driven tests at the top level), which might be used not only for Sugar Server Kit itself, but for deployment solutions as well;
  • Be GNU/Linux distribution agnostic, different deployments might decide to use different GNU/Linux distributions;
  • It is not only about supporting XO laptops, but about any Sugar based environments.

Server functionality models

Sugar Server Kit components are being designed to accomplish different functionality models, when the particular model might include only limited number of ingredients. The following models might describe Sugar Server Kit design, the final model might be an intermediate variant of them.

Only sugar-server

The model with minimal Sugar Server Kit design influence.

The key points:

  • Existing and configured out of Sugar Server Kit servers at schools.
  • School admins need to take care about setting up sugar-server specific requirement configuration for external environment.
  • School admins install the sugar-server package from upstream binary repository, and just launch it.
  • sugar-server starts to serve all sugar boxes around, providing only basic sugar specific functionality.
  • sugar-server doesn't break the system configuration (it touches nothing).

Dumb school servers

The model where the server at school is entirely dependent on Sugar Server Kit design decisions. There are two types of machines:

  • Dumb servers at schools under Sugar Server Kit control. The explicit intention is to minimize maintaining intervention as much as possible.
  • The Mothership to minimal control of school servers and handling the rest of functionality that people at schools need.

The key points:

  • Functionality of school servers is simple, only basic services.
  • Complex, thus not trivial for maintenance, services are on the mothership and singular, i.e., to minimize maintaining costs and let the minimal number of skilled personal support them effectively.
  • A set of school server's services tends to be constant, at least it doesn't require regular intervention to add/remove services.
  • All school serves have exactly the same set of services.

This functionality model involves Mace and sugar-server-templates components. The entirely content of school servers is:

  • a set of packages, including the main one that contains:
    • all services as dependencies,
    • upstream Mace configuration as sugar-server-templates dependency,
    • downstream Mace configuration;
  • Mace environment file, e.g., the one from sugar-server-templates examples;
  • pure data, like leases and content black lists, to fetch as-is from the Mothership.

After installing the main package, it will provide possibility to fetch Mace environment file and pure data from the Mothersip, and finally running Mace to complete school server setup.

Highly maintained school servers

TODO

Client functionality models

TODO

Distribution model

How Sugar Server Kit might be reused from downstream, excluding the most obvious way, download its sources.

Core packages

Sugar Server Kit is designed to avoid patching its sources in downstream. Reusing upstream binary packages as-is from repositories on http://download.sugarlabs.org is how Sugar Server Kit is being designed. Downstream might create new packages, that don't have file collisions with upstream packages, to have tweaks for local environment. It is being accomplished by:

  • sugar-server project has services formed as plugins, from downstream packages. Such services might be:
    • enabled/disabled
    • added new services, e.g., variants of existing services that are highly tuned for local needs
  • mace does not create any final configuration level logic and might be used to process any downstream configuration for services that it supports.

Core packages are per-component and might be reused as-is in downstream, in a way that is most practical for them.

Full cycle solution

Besides just having binary packages, it should be possible to build downstream packages and the final OS images on http://packages.sugarlabs.org by using only its web UI. The resulting files will be accessible for download from http://download.sugarlabs.org. It is an Open Build Service based service to build packages and images for rpm and deb based GNU/Linux distributions.

Deployment model

It is an entirely downstream decision as to how to deploy Sugar Server Kit based solutions.

Development model

Having a decent testing infrastructure is the major intention for Sugar Server Kit components. Every component needs to have, at least, unit tests for its internals. Components like sugar-server have also integration tests to cover integration issues for its parts.

Except component specific tests, it is important to have system integration testing when all components are being tested in collaboration. In that case, the sugaroid component, sugar client bot, will help.

The reliable testing environment should help with avoiding regressions while following Sugar Server Kit statement of purpose for releases.

Components

There are several Sugar Server Kit project components:

  • sugar-server provides basic sugar specific services,
  • sugar-server-templates provides configuration templates that might be reused in downstream solution,
  • mace process configuration sources, e.g., from sugar-server-templates,

The only relationship between them are:

  • sugar-server-templates contain basic configuration for sugar-servers.
  • sugar-server-templates makes sense only after processing its content by mace.

These are building blocks for the final solutions in downstream deployments. Components are optional, meaning that

  • sugar-server might be used in the singular manner; it doesn't need any special (outside of sugar-server) configuration, and can be started even from its sources directory;
  • sugar-server-templates might be used in the singular manner (but obviously with the mace) to configure only non Sugar services;
  • mace might be used in the singular manner to configure any services.