Changeset 2145 for swish-e

Show
Ignore:
Timestamp:
06/05/08 22:09:42 (3 months ago)
Author:
karpet
Message:

apply min/max word length settings to query tokenization

Files:

Legend:

Unmodified
Added
Removed
Modified
Copied
Moved

  • swish-e/trunk/src/swish_words.c

    r1815 r2145  
    918918            } 
    919919                     
    920  
     920            /*  
     921                is the token of an ok length to consider?  
     922                treat min/max length like stopwords  
     923            */ 
     924            if (    strlen(cur_token->line) < indexf->header.minwordlimit 
     925                ||  strlen(cur_token->line) > indexf->header.maxwordlimit 
     926            ) { 
     927                db_results->removed_stopwords = addswline( db_results->removed_stopwords, cur_token->line ); 
     928                stop_word_removed++; 
     929                remove = 1; 
     930            } 
    921931 
    922932            /* Finally, is it a stop word? */