45250 Commits

Author SHA1 Message Date
Kovid Goyal
04f6ba2b64
... 2022-07-06 19:19:49 +05:30
Kovid Goyal
0f79dbfb47
Improve wording 2022-07-06 19:19:49 +05:30
Kovid Goyal
03d9c2dbc4
Ignore undecodeable GIFs in MOBI files 2022-07-06 19:19:49 +05:30
Kovid Goyal
6d1f2989d1
A re-index button 2022-07-06 19:19:49 +05:30
Kovid Goyal
34cf27727a
Add method to re-index FTS 2022-07-06 19:19:49 +05:30
Kovid Goyal
53ae7d76cf
Ensure inserting into dirtied formats does not fail in triggers 2022-07-06 19:19:49 +05:30
Kovid Goyal
368bba0ac3
Ensure initialization is thread safe 2022-07-06 19:19:49 +05:30
Kovid Goyal
958625f660
Use a fast/slow indexing control since fast indexing is only appropriate when scanning a backlog 2022-07-06 19:19:48 +05:30
Kovid Goyal
7f503018ba
Parallelize db shutdown a bit more 2022-07-06 19:19:48 +05:30
Kovid Goyal
74b218a72a
Make shutting down the fts pool more robust
Fixes a deadlock and gives the worker threads a chance to clean exit
2022-07-06 19:19:48 +05:30
Kovid Goyal
89411a763e
Name the device manager thread 2022-07-06 19:19:48 +05:30
Kovid Goyal
aa66a5e67b
name the updates thread 2022-07-06 19:19:48 +05:30
Kovid Goyal
efc599f328
shutdown stats update timer on close 2022-07-06 19:19:48 +05:30
Kovid Goyal
e40731ab34
Automatically dirty existing books if FTS db is empty
Allows simply deleting the fts db file to force a rescan
2022-07-06 19:19:48 +05:30
Kovid Goyal
72f137c650
Ignore non_HTML spine items when extracting text 2022-07-06 19:19:48 +05:30
Kovid Goyal
69c76996dd
Warning label for incomplete indexing 2022-07-06 19:19:48 +05:30
Kovid Goyal
abe42f909b
Get pool size controls working 2022-07-06 19:19:48 +05:30
Kovid Goyal
afcaac89c6
API to get FTS indexing progress 2022-07-06 19:19:48 +05:30
Kovid Goyal
0199dd15ba
Rescan all files when indexing is enabled 2022-07-06 19:19:48 +05:30
Kovid Goyal
d4e85f06c5
Start work on a GUI for FTS 2022-07-06 19:19:48 +05:30
Kovid Goyal
568e931dff
Use a weak reference to the db object in the fts queue thread 2022-07-06 19:19:48 +05:30
Kovid Goyal
f65a05cc8f
Ensure deleted cache objects are closed
Also ensure close is only called once
2022-07-06 19:19:48 +05:30
Kovid Goyal
be83f8bfa6
Ensure cache object is closed at end of tests 2022-07-06 19:19:47 +05:30
Kovid Goyal
d52bb3646a
Get rid of no longer needed code 2022-07-06 19:19:47 +05:30
Kovid Goyal
d441eb32b5
Only print error if FTS is still enabled 2022-07-06 19:19:47 +05:30
Kovid Goyal
251fd7a92c
Queue FTS jobs in a separate thread
This allows turning FTS on/off to not block the UI
2022-07-06 19:19:47 +05:30
Kovid Goyal
2b23d75f13
... 2022-07-06 19:19:47 +05:30
Kovid Goyal
4502569b90
Get FTS search API working 2022-07-06 19:19:47 +05:30
Kovid Goyal
6f3cd9cc44
API for searching the FTS corpus 2022-07-06 19:19:47 +05:30
Kovid Goyal
fc80be414c
Add a test for shutdown with hung workers 2022-07-06 19:19:47 +05:30
Kovid Goyal
f7b47a72fc
Implement storing of failure messages in books table 2022-07-06 19:19:47 +05:30
Kovid Goyal
2f2a1063e2
more work 2022-07-06 19:19:47 +05:30
Kovid Goyal
4d2a7a20af
Fix failing test 2022-07-06 19:19:47 +05:30
Kovid Goyal
a165b34d3c
prepare for mocking of fts workers 2022-07-06 19:19:47 +05:30
Kovid Goyal
4f90074eeb
More fts indexing tests 2022-07-06 19:19:47 +05:30
Kovid Goyal
81a0f1b386
Add more fts indexing tests 2022-07-06 19:19:47 +05:30
Kovid Goyal
d009e10942
More work on fts indexing 2022-07-06 19:19:47 +05:30
Kovid Goyal
2c4891b26d
Dont buffer test output when running a specific test 2022-07-06 19:19:46 +05:30
Kovid Goyal
6fb3061c56
start testing fts pool 2022-07-06 19:19:46 +05:30
Kovid Goyal
cb74720aa5
More work on fts pool 2022-07-06 19:19:46 +05:30
Kovid Goyal
13f0f67ea7
More work on fts pool 2022-07-06 19:19:46 +05:30
Kovid Goyal
60e80e5684
More work on fts indexing 2022-07-06 19:19:46 +05:30
Kovid Goyal
164dbe9cfb
More work on fts jobs 2022-07-06 19:19:46 +05:30
Kovid Goyal
55c67d57e4
Use a full dbref rather than just get_connection 2022-07-06 19:19:46 +05:30
Kovid Goyal
58bde2e304
Basic implementation of extracting searchable text from HTML 2022-07-06 19:19:46 +05:30
Kovid Goyal
b66c72cc15
Auto clear dirtied_formats with a trigger 2022-07-06 19:19:46 +05:30
Kovid Goyal
2ecdbfb194
Finish trigger tests 2022-07-06 19:19:46 +05:30
Kovid Goyal
1dd710991f
Start work on tests for FTS backend 2022-07-06 19:19:46 +05:30
Kovid Goyal
e3d6c9f192
More work on FTS 2022-07-06 19:19:46 +05:30
Kovid Goyal
ba1707169a
Start work on fts 2022-07-06 19:19:46 +05:30