"There was no search index created so far" ???

Suggestions, questions oder problems with regain

Moderator: thtesche

"There was no search index created so far" ???

Postby philCFN » Wed Sep 07, 2016 12:45 am

Hi all,

Regain 2.1.0 stable on Linux Mint 17.3 Rosa / Ubuntu 14.04.4 LTS Trusty Tahr on Java 1.8.0u101.

I've had Regain running for days indexing a network share mounted over SMB. Regain continues to report: "There was no search index created so far."

And yet below are the stats. Help?????

Code: Select all
Running index update

Processed documents: 178,575
Size: 43.16 MB
Initial document count: 227,473
Added document count: 117,182
Removed document count: 0
Current job: file:/foo/bar/baz (since 17:19 min)

Timing

Whole crawler jobs:
  Aborted jobs:   159 jobs (0.09%)
  Completed jobs: 178,575 jobs
  Total time:     147:39:43 h
  Total data:     242.73 GB
  Average time:   2.98 sec
  Average data:   1.39 MB
  Data rate:      478.79 kB/sec
  Output:         20 jobs/min
Parsed documents:
  Completed docs: 131,926 docs
  Total time:     138:03:56 h
  Total data:     242.73 GB
  Average time:   3.77 sec
  Average data:   1.88 MB
  Data rate:      512.07 kB/sec
  Output:         16 docs/min
Documents loaded from the file system:
  Completed docs: 1,514 docs
  Total time:     19:57 min
  Total data:     169.72 MB
  Average time:   791 millis
  Average data:   114.79 kB
  Data rate:      145.08 kB/sec
  Output:         76 docs/min
Indexed documents:
  Completed docs: 117,182 docs
  Total time:     53:53 min
  Total data:     228.72 GB
  Average time:   27 millis
  Average data:   2.00 MB
  Data rate:      72.44 MB/sec
  Output:         2,175 docs/min
Created breakpoints:
  Completed breakpoints: 804 breakpoints
  Total time:            148:27:07 h
  Total data:            20,604.88 GB
  Average time:          11:04 min
  Average data:          25.63 GB
  Data rate:             39.48 MB/sec
  Output:                0.09 breakpoints/min
Preparator net.sf.regain.crawler.preparator.SwingRtfPreparator:
  Aborted docs:   14 docs (6.48%)
  Completed docs: 202 docs
  Total time:     2:21 min
  Total data:     81.49 MB
  Average time:   701 millis
  Average data:   413.08 kB
  Data rate:      588.58 kB/sec
  Output:         85 docs/min
Preparator net.sf.regain.crawler.preparator.EmptyPreparator:
  Completed docs: 14,674 docs
  Total time:     53:45 min
  Total data:     72.66 GB
  Average time:   219 millis
  Average data:   5.07 MB
  Data rate:      23.07 MB/sec
  Output:         273 docs/min
Preparator net.sf.regain.crawler.preparator.XmlPreparator:
  Completed docs: 8 docs
  Total time:     17.71 sec
  Total data:     23.16 kB
  Average time:   2.21 sec
  Average data:   2.89 kB
  Data rate:      1.31 kB/sec
  Output:         27 docs/min
Preparator net.sf.regain.crawler.preparator.PoiMsOfficePreparator:
  Aborted docs:   2,533 docs (5.29%)
  Completed docs: 45,387 docs
  Total time:     26:58:30 h
  Total data:     40.18 GB
  Average time:   2.14 sec
  Average data:   928.35 kB
  Data rate:      433.89 kB/sec
  Output:         28 docs/min
Preparator net.sf.regain.crawler.preparator.PlainTextPreparator:
  Completed docs: 1,455 docs
  Total time:     23:52 min
  Total data:     161.28 MB
  Average time:   984 millis
  Average data:   113.51 kB
  Data rate:      115.32 kB/sec
  Output:         61 docs/min
Preparator net.sf.regain.crawler.preparator.ZipPreparator:
  Aborted docs:   3 docs (0.41%)
  Completed docs: 722 docs
  Total time:     9:33 min
  Total data:     4.03 GB
  Average time:   793 millis
  Average data:   5.72 MB
  Data rate:      7.21 MB/sec
  Output:         76 docs/min
Preparator net.sf.regain.crawler.preparator.PdfBoxPreparator:
  Aborted docs:   4,985 docs (8.35%)
  Completed docs: 54,684 docs
  Total time:     60:03:04 h
  Total data:     111.60 GB
  Average time:   3.95 sec
  Average data:   2.09 MB
  Data rate:      541.29 kB/sec
  Output:         15 docs/min
Preparator net.sf.regain.crawler.preparator.HtmlPreparator:
  Completed docs: 45 docs
  Total time:     34.42 sec
  Total data:     8.40 MB
  Average time:   764 millis
  Average data:   191.18 kB
  Data rate:      249.97 kB/sec
  Output:         78 docs/min
Preparator net.sf.regain.crawler.preparator.MessagePreparator:
  Completed docs: 6 docs
  Total time:     3.57 sec
  Total data:     11.12 kB
  Average time:   594 millis
  Average data:   1.85 kB
  Data rate:      3.12 kB/sec
  Output:         101 docs/min

The last log messages

16:18:04: Creating a breakpoint...
16:18:04: Switching to index mode: all closed mode
16:31:00: Switching to index mode: searching mode
16:31:59: Preparation with PdfBoxPreparator done: file:///foo/bar/baz
16:31:59: Switching to index mode: adding mode
16:34:49: Preparation with PdfBoxPreparator done: file:///foo/bar/baz
16:42:33: Preparation with PdfBoxPreparator done: file:///foo/bar/baz
16:42:33: Creating a breakpoint...
16:42:33: Switching to index mode: all closed mode
16:54:09: Switching to index mode: searching mode
16:54:26: Preparing file:///foo/bar/baz with preparator net.sf.regain.crawler.preparator.PdfBoxPreparator failed
16:54:29: Preparation with EmptyPreparator done: file:///foo/bar/baz
16:54:29: Switching to index mode: adding mode
16:54:38: Preparation with PoiMsOfficePreparator done: file:///foo/bar/baz
16:54:46: Preparation with PoiMsOfficePreparator done: file:///foo/bar/baz
16:56:07: Preparation with PdfBoxPreparator done: file:///foo/bar/baz
16:57:22: Preparation with PoiMsOfficePreparator done: file:///foo/bar/baz
16:57:32: Preparing file:///foo/bar/baz with preparator net.sf.regain.crawler.preparator.PdfBoxPreparator failed
16:57:34: Preparation with EmptyPreparator done: file:///foo/bar/baz
16:57:42: Preparing file:///foo/bar/baz with preparator net.sf.regain.crawler.preparator.PdfBoxPreparator failed
16:57:44: Preparation with EmptyPreparator done: file:///foo/bar/baz
17:02:09: Preparing file:///foo/bar/baz with preparator net.sf.regain.crawler.preparator.PdfBoxPreparator failed
17:02:13: Preparation with EmptyPreparator done: file:///foo/bar/baz
17:04:11: Preparation with PdfBoxPreparator done: file:///foo/bar/baz
17:04:28: Creating a breakpoint...
17:04:28: Switching to index mode: all closed mode
17:16:34: Switching to index mode: searching mode
17:17:26: Preparation with PoiMsOfficePreparator done: file:///foo/bar/baz
17:17:26: Switching to index mode: adding mode
17:23:56: Preparation with PdfBoxPreparator done: file:///foo/bar/baz

philCFN
 
Posts: 1
Joined: Wed Sep 07, 2016 12:33 am

Return to regain

Who is online

Users browsing this forum: No registered users and 1 guest

cron