|
A Case-Based Technique for Tracking Concept Drift in Spam Filtering |
Delany, Sarah Jane; Cunningham, Padraig; Tsymbal, Alexey; Coyle, Lorcan
|
|
|
|
TCD-CS-2004-30 Clearly, machine learning techiques can play an important role in filtering spam email because ample training data is available to build a robust classifier. However, spam filtering is a particularly challenging task as the data distribution and concept being learned changeds over time. This is a particularly awkward form of concept drift as the change is driven by spammers wishing to circumvent the spam filters. In this paper we show that lazy learning techniques are appropriate for such dynamically changing contexts. We present a case-based system for spam filtering called ECUE that can learn dynamically. We evaluate its performance as the case-base is updated with new cases. We also explore the benefit of periodically redoing the feature selection process to bring new features into play. Our evaluation shows that these two levels of model update are effective in tracking concept drift.
|
|
Keyword(s):
|
Computer Science |
Publication Date:
|
2004 |
|
Type:
|
Report |
|
Peer-Reviewed:
|
Unknown |
|
Language(s):
|
English |
|
Institution:
|
Trinity College Dublin |
|
Citation(s):
|
Delany, Sarah Jane; Cunningham, Padraig; Tsymbal, Alexey; Coyle, Lorcan. 'A Case-Based Technique for Tracking Concept Drift in Spam Filtering'. - Dublin, Trinity College Dublin, Department of Computer Science, TCD-CS-2004-30, 2004, pp14 |
|
Publisher(s):
|
Trinity College Dublin, Department of Computer Science |
|
File Format(s):
|
application/pdf |
|
First Indexed:
2014-05-13 05:31:13 Last Updated:
2015-04-10 05:13:55 |
