Infrastructure Team/Puppet: Difference between revisions

No edit summary
 
(16 intermediate revisions by 2 users not shown)
Line 1: Line 1:
{{TOCright}}
Sugar Labs Puppet infrastructure.
Sugar Labs Puppet infrastructure.


== Modules ==
== Modules ==


Modules are end-usage environment independent blocks to build final configuration. All end-usage configuration happen via class/define/type arguments from out of these modules in the nodes. Modules are stored in vcs.
Puppet modules configure particular services like [[Service/git|git.sugarlabs.org]] or MySQL but not tied to final configurations, they are being configured from [[#Master|puppetmaster]].
 
All modules are collected as repositories in [http://git.sugarlabs.org/puppets puppets] Gitorious project. Modules might be created from scratch or mirrored from upstream, so, all modules that are used within Sugar Labs are stored in one place. Module repository might have followed branches:
 
* ''master'', development version (might be absent if project is mirrorred from upstream),
* ''production'', version is being used in production,
* ''upstream'', if it is mirrorred project.
 
Auto generated [http://api.sugarlabs.org/puppets/ documentation].
 
== Master ==
 
Only puppetmaster keeps final configuration for all Sugar Labs services. It is being started in a private git repository on [[Machine/lightwave]], which is a high security machine.


=== Low-level ===
=== Private repository ===


'''[http://git.sugarlabs.org/projects/puppet-util util]'''<br>
* {{Code|/var/lib/puppet/etc/puppet.git}}
Common infrastructure routines. Module contains only code, not any data.
* {{Code|/var/lib/puppet/etc/puppet}} detached working directory
* {{Code|/etc/puppet}} symlink to detached working directory
* {{Code|/var/lib/puppet/etc/puppet.git/config}}:


'''[http://git.sugarlabs.org/projects/puppet-firewall firewall]'''<br>
[core]
High level setup of iptables.
repositoryformatversion = 0
filemode = true
bare = false
sharedRepository = true
logallrefupdates = true
worktree = /etc/puppet
[receive]
denycurrentbranch = ignore
[hooks]
mailinglist = systems-logs@...
emailprefix = "[PUPPET] "
showrev = "git show -C %s; echo"


'''[http://git.sugarlabs.org/projects/puppet-mysql mysql]'''<br>
* {{Code|/var/lib/puppet/etc/puppet.git/description}}:
MySQL procedures.


'''[http://git.sugarlabs.org/projects/puppet-lighttpd lighttpd]'''<br>
Sugar Labs Puppet configuration
Lighttpd support.


'''[http://github.com/reductivelabs/puppet-vcsrepo vcsrepo]'''<br>
* {{Code|/var/lib/puppet/etc/puppet.git/hooks/post-receive}}
Version control systems procedures.


=== End applications ===
#!/bin/bash
sh /usr/share/doc/git-core/contrib/hooks/post-receive-email
git checkout -f
for i in $(ls /etc/puppet/manifests/nodes/*.pp); do puppet kick $(basename $i .pp); done


'''[http://git.sugarlabs.org/projects/puppet-supybot supybot]'''<br>
=== Repository hierarchy ===
Setup supybot IRC bot.


'''[http://git.sugarlabs.org/projects/puppet-bazaar bazaar]'''<br>
Git repository consists of:
Maintain bazaar.sugarlabs.org infrastructure.
 
* {{Code|manifests/site.pp}}, main recipe which contain common settings and includes nodes.
* {{Code|manifests/services/}}, recipes that describes final configuration for particular services.
* {{Code|manifests/nodes/}}, puppetized nodes, configuration for hosts that ask puppetmaster.
* {{Code|modules/}}, git submodules with Puppet [[#Modules|modules]].


== Nodes ==
== Nodes ==


''In progress''
Hosts that fetch configuration from the [[#Master|puppetmast]] need <code>puppet >= 2.6</code> package.
 
If {{Code|puppet}} was installed from gems, it needs to be initially configured:
 
puppet master --mkusers
 
To complete configuration, execute:


End-usage nodes. Configuration settings are tracked by local git repository only since contain private data.
puppet agent --no-daemonize --onetime --server puppet.sugarlabs.org


=== jita.sugarlabs.org ===
Every puppetized host should have particular node file in {{Code|manifests/nodes/<host-name>.pp}} on [[#Master|puppetmaster]].