Changeset 2148 for libswish3/trunk/src/swish_tokenize.c

Timestamp:

07/21/08 23:51:24 (6 months ago)

Author:

karpet

Message:

change top-level tokenizer functions to use same signature so that we can more easily
swap between them. Change tests to use new iterator style by default (-t option to swish_lint).

Files:

• libswish3/trunk/src/swish_tokenize.c (modified) (2 diffs)

libswish3/trunk/src/swish_tokenize.c

@@ -114 +114 @@
-    for (; i < argc; i++) {
-        ntokens =
-list, (xmlChar *)argv[i],
+(xmlChar *)argv[i], list, 
-                            swish_hash_fetch(s3->config->metanames, meta), meta);
-        printf("parsed %d tokens: %s\n", ntokens, argv[i]);
@@ -122 +122 @@
-    if (string != NULL) {
-        ntokens =
-list, string,
+string, list, 
-                            swish_hash_fetch(s3->config->metanames, meta), meta);
-        swish_debug_token_list(iterator);