| |
| |
|
Spam Blocker Information |
|
|
|
Spam Filters Explained
What do they do? How do they work? Which one is right for me?By Alan Hearnshaw Spam is a very real problem that many people have to deal with on a daily basis. For those that have decided to do something about it and start to investigate the options available in spam filtering, this article provides a brief introduction to your options and the types of spam filters available. Despite the bewildering array of spam filters available today, all claiming to the best one "of its kind" there are really just five filtering methodologies in general use today and all products rely on one, or a combination of these: Content-Based Filters "In the beginning, there were content-based filters." These filters scan the contents of the and look for tell-tale signs that the message is spam. In the early days of spamming it was quite simple to look out for "Kill Words" such as "Lose Weight" and mark a message as spam if it was found. Very soon though, spammers got wise to this and started resorting to all kinds of tricks to get their message past the filters. The days of "obfuscation" had begun. We started getting messages containing the phrase "L0se Welght" (Notice the zero for "o" and "l" for "i") and even more bizarre - and sometimes quite ingenious - variations. This rendered basic content-based filters somewhat ineffective, although there are one or two on the market now that are clever enough to "see through" theses attempts and still provide good results. Bayesian Based Filters "The Reverend Bayes comes to the rescue" Born in London 1702, the son of a minister, Thomas Bayes developed a formula which allowed him to determine the probability of an event occurring based on the probabilities of two or more independent evidentiary events. Bayesian filters "learn" from studying known good and bad messages. Each message is split into single "word bytes", or tokens and these tokens are placed into a database along with how often they are found in each kind of message. When a new message arrives to be tested by the filter, the new message is also split into tokens and each token is looked up in the database. Extrapolating results from the database and applying a form of the good reverend's formula, know as the a "Naive Bayesian" formula, the message is given a "spamicity" rating and can be dealt with accordingly. Bayesian filters typically are capable of achieving very good accuracy rates (>97% is not uncommon), and require very little on-going maintenance. Whitelist/Blacklist Filters "Who goes there, friend or foe?" This very basic form of filtering is seldom used on its own nowadays, but can be useful as part of a larger filtering strategy. A "whitelist" is nothing more than a list of e-mail addresses from which you wish to accept communications. A whitelist filter would only accept messages from these people and all others would be rejected A "blacklist", conversely, is a list of e-mail addresses - and sometimes IP Addresses (computer identification addresses) - from which communications will not be accepted. While this may seem like a good idea from the outset, a whitelist methodology is too restrictive for most people and, as virtually all spam e-mails carry a forged "from" address, there is little point in collecting this address to ban it in future as it is very unlikely to be the same next time. There are bodies on the internet that maintain a list of known "bad" sources of e-mail. Many filters today have the ability to query these servers to see if the message they are looking at comes from a source identified by this Internet-based blacklist, or RBL. While being quite effective, they do tend to suffer from "false positives" where good messages are incorrectly identified as spam. This happens often with newsletters. Challenge/Response Filters "Open sesame!" Challenge/Response filters are characterised by their ability to automatically send a response to a previously unknown sender asking them to take some further action before their message will be delivered. This is often referred to as a "Turing Test" - named after a test devised by British mathematician Alan Turing to determine if machines could "think". Recent years have seen the appearance of some internet services which automatically perform this Challenge/Response function for the user and require the sender of an e-mail to visit their web site to facilitate the receipt of their message. Critics of this system claim it to be too drastic a measure and that it sends a message that "my time is more important than yours" to the people trying to communicate with you. For some low traffic e-mail users though, this system alone may be a perfectly acceptable method of completely eliminating spam from their inbox - one step above the "Whitelist" system outlined above. Community Filters "A united front" These types of filters work on the principal of "communal knowledge" of spam. When a user receives a spam message, they simply mark it as such in their filter. This information is sent to a central server where a "fingerprint" of the message is stored. After enough people have "voted" this message to be spam, then it is stopped from reaching all the other people in the community. This type of filtering can prove to be quite effective, although it stands to reason that it can never be 100% effective as a few people have to receive the spam for it to be "flagged" in the first place. Just like its similar cousin the Internet black list (RBL), this system also can suffer from "false positives", or messages incorrectly identified as spam. Hopefully you are now armed with a little more information to be able to make an informed decision on the best spam filter for you. For further information, consider reading the reviews and articles found at http://www.whichspamfilter.com Alan Hearnshaw is a computer programmer and the owner of http://www.whichspamfilter.com, a web site which conducts weekly in-depth reviews of current spam filters, provides help and guidance in the fight against spam and provides a useful community forum.alan@whichspamfilter.com
MORE RESOURCES:
WatchGuard Breaks Quarterly Billings, Profit and Units Shipped Records - MarketWatch (press release)
Google News |
|
|
|
RELATED ARTICLES
Demand for Spam? It exists Do you like spam? No, I'm not kidding. Everybody knows what spam is, almost everybody seems to have learned by heart simple advice like "do not click ?" "do not respond?" , "do not buy?" but--On March 23, 2005 Mirapoint and the Radicati Group, a consulting and market research firm, released preliminary results of their end-user survey on email hygiene. The Vanishing Mail Am I Just Being Paranoid Or Are The Robots Out To Get Me?It all started in the early part of the twenty-first century.In the early days of email we were thrilled with its speed and reliability, far superior to "snail mail" but there's always somebody who has to go and spoil things for everyone else. The 4 Ws of Junk E-mail Junk e-mail or spam has become the scourge of the modern computer world. It eats bandwidth. Internet Tip of the Week: Information Overload We receive so much information on the Internet, especially via email, that many times we have difficulty separating the good "stuff" from the junk. Most of us put unsolicited email (spam) in the junk category. Spamicide: Man Spammed to Death While Checking His E-mail Death by spam is now possible with a new device by Microsoft. The device when implanted in the user's skull allows downloading of email directly into the brain. Your Dolphin E-mail Caught In Spam Tuna Net? Let me ask a couple of questions:If (potential) customers sends an e-mail to your company, do they want to receive an answer?If you, in return, e-mail your customer, do you expect that your e-mail is delivered to the customer?Well, in my case, I answered "YES" on both questions. After all, the customer asks for an answer, so it's normal to expect that when you send an e-mail in return, that the customer receives it. Protecting Your Business From Spam Even being as careful as possible with my email address, I still used to receive more than 100 email messages a day, which is no exaggeration. Only about 10% of those emails were from people that I knew and the rest of the messages were unwanted email?"spam". Block Ads, Defeat Pop-Ups, and STOP Page Hijacking You're not alone!Who hasn't surfed the web looking for information only tohave their session interrupted by those annoying pop-upwindows displaying everything from banner ads to newslettersign-up's?Though pop-up windows and other methods of influencing auser's online experiences originally had positiveintentions, they now seem only to annoy and manipulateusers at every turn.For anyone who ever felt extremely irritated by onlineadvertising, the following advice should help. Challenge Response Spam Filters Explained As the flood of spam increases end users are looking for new and more efficient solutions to block spam. In turn software developers are knocking themselves out trying to come up with the killer app that will stop spam forever. Dont Give the Spammers Your Address From Your Page Spammers get email addresses from web pages using programs called spiders which tour the internet capturing letter strings with the "@" character in it.Signing up for extra information at some sites and giving your email address can also get you a flood of unwanted mail, but although it feels like spam, it is, or started as, "Opt-in" email. How To Stop Spam (Especially If You're Already a Victim) Spam. Those annoying, time-consuming emails that clog your Inbox and ruin your day. I Must Be The Luckiest Person Alive! Spam I must be the luckiest person alive! My inbox is just crammed with good news, great advice, and millions in accounts just needing the ok from me. Right now, I've two million euros just waiting to be claimed. Having a Bad e MALE Day? Email, Spam, Spam and More Spam You just sat at your desk, opened your email account and what do you get? First there is some anonymous donkey from an anonymous and anything but respectable mortgage lender telling you that they can arrange your finance at 3% and all you need to do now that your application is approved is to sign along the dotted line and get in touch with them. This is despite the fact that you have never heard of them or even approached them - ever!. Email Spam and Phishing It seems like the volume of email spam has doubled in the last month. Increasingly, we receive daily emails for better mortgage rates, pharmaceutical discounts, and offers to enlarge body parts we don't even have. Stuffing the Spammers! I'm really, truly fed up with spam. Every day when the spam arrives and Norton Security moves it into the Norton Anti-spam folder of my Outlook email client, I wonder how anyone can be so incredibly stupid as to waste their time sending me such garbage. Internet Theft and Fraud My friends in the web hosting business have recently informed me that the big problem this year (2004) is security and fraud. I have read that currently the F. What SPAM Means: Stupid People Annoying Me English, German, Italian - It's All SPAM To MeHas anyone else noticed the sudden blast of unsolicited e-mail (spam) loaded with url's for the unsuspecting and curious Internet surfer to click on?What's even better, the bulk of this SPAM is in a foreign language. I was at a neighborhood party this weekend and you can't imagine the number of people who asked me for assistance with this. Where Did The Word Spam Come From? We've all become familiar with the term spam. It's become so commonplace that even people who never use computers are familiar with the term spam. How To Identify Spam Most of us have opened our email program and found, alongside correspondence from people that we know, offers for products from commercial web sites. Some of these emails we expect. Of Spam and Sandboxes About a month ago I had the privilege of giving a demo of the next version of Sonic Page Blaster to the attendees at Yanik Silver's "Underground Online Marketing Seminar". I fielded a couple questions afterwards that bear a better treatment than I could manage on the spur of the moment and in less than 60 seconds.
|
| home | site map |
| © 2006 |
