...
Hostname | Function | Software | Configs/Location | Resource/URL | SVN Location | |||
incoming.apache.org | Donated by Sonic |
|
|
|
| |||
sa-vm1.apache.org | DNS Hidden Master | PowerDNS | /etc/powerdns/pdns.d/pdns.local.conf | spamassassin.org | dns (webserver API key redacted) | |||
| Rsync Mirrors | rsyncd | /etc/rsyncd.conf | rsync.spamassassin.org | trunk/build/automc/etc-rsyncd.conf | |||
| Web Server | apache2 | /etc/apache2/sites-available/automc.conf | updates.spamassassin.org | trunk/build/automc/automc-apache2.conf | |||
|
| apache2 | /etc/apache2/sites-available/automc.conf | ruleqa.spamassassin.org | trunk/build/automc/ruleqa.cgi | |||
<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="4763f79f5423d4d3-a4d361e8-493b40df-949cab1d-edcf887c742abfdb8122390a"><ac:plain-text-body><![CDATA[ |
| SaUpdateMirrorSetup | svn | rsyncd [updates] for mirrors | spamassassin.apache.org/updates | [site/updates | http://svn.apache.org/repos/asf/spamassassin/site/updates/]/MIRRORED.BY | ]]></ac:plain-text-body></ac:structured-macro> |
| Nightly Masscheck | cron/scripts | /usr/local/spamassassin/automc/rsync/tagged_builds | ruleqa.spamassassin.org | trunk/backend/nitemc/README | |||
| RuleQA web UI | cron/scripts | /usr/local/spamassassin/automc/html | ruleqa.spamassassin.org |
...
Wiki Markup |
---|
*25 2 \* \* \* automc *~/svn/trunk/build/mkupdates/do-stable-update-with-scores* **~/svn/masses/rule-update-score-gen/do-nightly-rescore-example.sh* **~/svn/masses/rule-update-score-gen/generate-new-scores.sh* *uses ~/tmp/generate-new-scores for SVN work area *sorts out the usable corpus from the latest 'SVN revision' at the top of the submitter's log file which should match the latest tagged build of SVN rules *checks the sorted corpus for a minimum number of valid contributors and ham/spam **~/svn/trunk/$\{REVISION\} LINE 123 NEEDS IMPROVEMENT!!! THIS SVN REVISION NEEDS TO BE CLOSELY TIED TO THE REVISION THAT WAS STAGED IN THE MASSCHECK RSYNC DIR. *checks the sorted corpus for a minimum number of valid contributors and ham/spam **~/svn/trunk/build/mkupdates/mkupdate-with-scores* *uses ~/tmp/sa-mkupdate for SVN working area *gets latest SVN $\{REVISION\} from rulesrc/scores/score-set\* *masses \-> perl Makefile.PL && make (complete build of SA and test) *perl hit-frequencies *garescorer - compiles and runs it, requires build/pga *sends email if not enough masscheck submitters or usuable ham/spam for the latest SVN revision *creates $\{REVISION\}.tar.gz $\{REVISION\}.tar.gz.sha1 and $\{REVISION\}.tar.gz.asc in /var/www/automc.spamassassin.org/updates for mirrors to pull *updates DNS TXT entries \[0-3\].3.3.updates.spamassassin.org and 0.4.3.updates.spamassassin.org -- versions >= 3.4.1 have a CNAME to 3.3.3.updates.spamassassin.org *Script rewrite notes: *Make each primary step modular since these steps are commmon in other scripts *Should check for minimum contributors of ham/spam up front and not waste resources if requirements not met *These 3 scripts above all share the same temp working dir. This should be determined from config file or relative path of user's home dir for flexibility. *Should be able to run the ham/spam processing in parallel and merge the results together to cut this time in half *Temp working dir for the corpus should be persistent so the rsync copy will be faster. *Usuable corpus symlink setup could be improved. Invalid stale corpus should be removed into an archive/excluded dir. |
Wiki Markup |
---|
*30 8 \* \* \* automc *~/svn/trunk/build/mkupdates/run_nightly* > /var/www/automc.spamassassin.org/mkupdates/mkupdates.txt *creates new Currently $\{SA_VERSION\} = "3.4.2" *$\{REVISION\} = latest SVN revision THIS NEEDS TO BE ADDRESSED!!! NEED TO PREVENT REVISION FROM MESSING UP THE MASSCHECK PROCESSING. *creates new rules/active.list *commits new rules/active.list *runs spamassassin lint against the updated rules and checks in a tagged version of 'sa-update_$\{SA_VERSION\}_$\{TSTAMP\}' *commits "promotions validated" and emails dev@spamassassin.apache.org *creates $\{REVISION\}.tar.gz $\{REVISION\}.tar.gz.sha1 and $\{REVISION\}.tar.gz.asc in /var/www/automc.spamassassin.org/updates for mirrors to pull *updates DNS TXT entries \[0-3\].3.3.updates.spamassassin.org and 0.4.3.updates.spamassassin.org -- versions >= 3.4.1 have a CNAME to 3.3.3.updates.spamassassin.org *Script rewrite notes: *Uses many of the same primary steps previous section so reuse the code and not have to maintain multiple versions *Should be turned into generic script that can be run on demand via SVN trigger/polling |
...