Bayesian spam filter for comments, feedbacks form ...

Friday 16 April 2010 7:45:54 am

I'm working on an extension to auto filter comments, feedbacks form and other user postings based on a Bayesian spam algorithm.

The filter is getting more accurate as you teach it what is spam and what is ham. So it can be a bit random on first times.

Was wondering if the community finds this interesting. If so I would share it when ready.

Wednesday 21 April 2010 4:18:37 am

I won't be re-inventing the wheel here.

There are several PHP classes that do this. My plan is to use the following library for the extension:

http://www.phpclasses.org/package/4236-PHP-Detect-spam-in-text-using-Bayesian-techniques.html

It is using a DB table to store data from what the script is learning.

My extension would have:

• a module that loads up all comments / feedbacks (should be customizable) and allow you to mark them as SPAM or HAM and send for learning.
• a workflow event that would analyze each post of a comments / feedbacks (customizable) against the base.
• a way to moderate messages marked as spam/ham
• the DB table would be modified to allow a different base for each siteaccess.

Thursday 22 April 2010 6:31:14 am

Excellent. That might save me hours of dev time :-D

Will test it, thanks for sharing