Rescore Mass-Check Instructions

(see RescoreDetails310 or RescoreDetails320 for historical 3.1.0 mass-check documentation, and RescoreMassCheck for the overall rescoring procedure including server-side bits.)

Here's the procedure you'll need to follow, if you wish to submit data for the rescoring run for 3.23.0 using MassCheck:

Clean up the corpus of mail you intend to MassCheck (see CorpusCleaning). The 'checking for false positives and false negatives' stage of corpus cleaning can be done after mass-checks complete, if you like.

...

It's helpful, but not required, to have some or all of the helper applications installed:

• the Mail::SPF ::Query module
• the Net::DNS module
• Mail::DKIM moduleMail::DomainKeys module, preferably version 0.36_5 or later
• Razor
• Pyzor
  

If you're running nightly mass-checks, please feel free to disable them when running the rescore mass-check runs.

...

  wget http://people.apache.org/~jm/mcsnapshot.tgz
  tar xvfz mcsnapshot.tgz
  cd mcsnapshot
  perl Makefile.PL < /dev/null
  make

  cd masses
  mkdir spamassassin
  rm -f spamassassin/*
  echo "bayes_auto_learn 0" > spamassassin/user_prefs
  echo "lock_method flock" >> spamassassin/user_prefs
  echo "bayes_store_module Mail::SpamAssassin::BayesStore::SDBM" >> spamassassin/user_prefs
  echo "use_auto_whitelist 0" >> spamassassin/user_prefs
  echo "whitelist_bounce_relays example.com" >> spamassassin/user_prefs

  nohup ./mass-check --progress --reuse --bayes --net -j 4 --restart=400 --learn=35 --reuse \
        --after=1072933200 <targets>

...

Do not use --reuse if you have scanned with SA, but have configured that scanner to run with -L, ; or you have disabled common network tests or SPF. This is because it relies on the presence of the X-Spam-Status line to pick up hits on those rules, and currently cannot detect those conditions.

...

The results for this run will need to be in by Tuesday Feb 6th Thursday Sep 17th (tentatively). If you're still running then, submit what you have so far and beg for more time. We may be pushing it out a little further anyway depending on how things go