[Groonga-commit] groonga/groonga at f046357 [master] ngram: remove unused field

Back to archive index

Kouhei Sutou null+****@clear*****
Wed May 9 11:44:33 JST 2018


Kouhei Sutou	2018-05-09 11:44:33 +0900 (Wed, 09 May 2018)

  New Revision: f046357ae4fc28665042bd35175d1d65e48e804d
  https://github.com/groonga/groonga/commit/f046357ae4fc28665042bd35175d1d65e48e804d

  Message:
    ngram: remove unused field

  Modified files:
    lib/tokenizers.c

  Modified: lib/tokenizers.c (+1 -3)
===================================================================
--- lib/tokenizers.c    2018-05-09 11:19:43 +0900 (443cf27d8)
+++ lib/tokenizers.c    2018-05-09 11:44:33 +0900 (e656721e8)
@@ -286,7 +286,6 @@ typedef struct {
   const unsigned char *next;
   const unsigned char *end;
   const uint_least8_t *ctypes;
-  uint32_t len;
   uint32_t tail;
 } grn_ngram_tokenizer;
 
@@ -421,7 +420,7 @@ ngram_init_raw(grn_ctx *ctx,
     grn_string_get_normalized(ctx,
                               string,
                               &normalized_raw, &normalized_length_in_bytes,
-                              &(tokenizer->len));
+                              NULL);
     tokenizer->next = (const unsigned char *)normalized_raw;
     tokenizer->end = tokenizer->next + normalized_length_in_bytes;
     tokenizer->ctypes = grn_string_get_types(ctx, string);
@@ -754,7 +753,6 @@ ngram_next(grn_ctx *ctx,
     }
   }
   tokenizer->pos = pos;
-  tokenizer->len = len;
   tokenizer->tail = pos + len - 1;
   if (p == r || tokenizer->next == e) {
     tokenizer->skip = 0;
-------------- next part --------------
HTML����������������������������...
URL: https://lists.osdn.me/mailman/archives/groonga-commit/attachments/20180509/1ee93016/attachment.htm 



More information about the Groonga-commit mailing list
Back to archive index