[Groonga-commit] groonga/groonga at e7acf61 [master] TokenRegexp: fix a bug that too much token is emitted

Back to archive index

Kouhei Sutou null+****@clear*****
Fri May 8 23:46:03 JST 2015


Kouhei Sutou	2015-05-08 23:46:03 +0900 (Fri, 08 May 2015)

  New Revision: e7acf617eba3b2db7ced9e936245bb7fdb9baf73
  https://github.com/groonga/groonga/commit/e7acf617eba3b2db7ced9e936245bb7fdb9baf73

  Message:
    TokenRegexp: fix a bug that too much token is emitted

  Modified files:
    lib/tokenizers.c

  Modified: lib/tokenizers.c (+1 -1)
===================================================================
--- lib/tokenizers.c    2015-05-08 17:16:07 +0900 (8ed0b8c)
+++ lib/tokenizers.c    2015-05-08 23:46:03 +0900 (5578b53)
@@ -664,7 +664,7 @@ regexp_next(grn_ctx *ctx, int nargs, grn_obj **args, grn_user_data *user_data)
   tokenizer->is_overlapping = (n_characters > 1);
 
   if (mode == GRN_TOKEN_GET) {
-    if ((end - tokenizer->next) < ngram_unit) {
+    if (current == end) {
       if (tokenizer->get.have_end) {
         if (tokenizer->next == end) {
           tokenizer->is_end = GRN_TRUE;
-------------- next part --------------
HTML����������������������������...
Download 



More information about the Groonga-commit mailing list
Back to archive index