44614 Commits

Author SHA1 Message Date
Kovid Goyal
e46982f7df
Allow specifying timeout to read_url() 2022-04-02 14:22:56 +05:30
Kovid Goyal
dc92c8f9bb
DRYer 2022-04-02 13:50:14 +05:30
Kovid Goyal
7a4a6d0d19
Report document URL in domready event as well 2022-04-02 13:23:32 +05:30
Kovid Goyal
a0c9005d69
Also ignore domready for about: urls 2022-04-02 13:09:11 +05:30
Kovid Goyal
4e72452688
Use the new chromium based scraper for the kobo books plugin
Seems like a more robust workaround for its Akamai based network
protocol analysis based blocking than using python user agents.
2022-04-02 12:28:42 +05:30
Kovid Goyal
4a0b742d2d
... 2022-04-02 12:27:31 +05:30
Kovid Goyal
212ad2a135
Allow per thread scrapers 2022-04-02 12:07:49 +05:30
Kovid Goyal
a1096d303d
Stop fetching once dom is ready 2022-04-02 09:04:49 +05:30
Kovid Goyal
1c2ca981d8
Cleanup overseers explicitly on exit so that their __del__ method doesnt delay shutdown 2022-04-02 08:59:20 +05:30
Kovid Goyal
b7c92f3498
Move webengine specific code into its own module
Since webengine currently needs to be imported before QApplication is
constructed, this allows it to be controlled easily
2022-04-02 08:42:28 +05:30
Kovid Goyal
fbb0956665
Skip scraper tests when webengine is known to fail 2022-04-02 07:21:26 +05:30
Kovid Goyal
a0c0bd7af9
Print extra debug info when testing simple scraper 2022-04-02 07:07:37 +05:30
Kovid Goyal
1c8296b710
... 2022-04-02 06:36:40 +05:30
Kovid Goyal
223444e208
Test that worker cleanup happens 2022-04-02 06:26:47 +05:30
Kovid Goyal
44ccd8104b
Get simple scraper working via worker processes 2022-04-02 06:25:14 +05:30
Kovid Goyal
91268eb9c0
Merge branch 'master' of https://github.com/cbhaley/calibre 2022-04-01 19:47:38 +05:30
Charles Haley
6f22d674b4 Prevent overwriting local functions by another with the same name defined in a stored template. 2022-04-01 15:14:33 +01:00
Kovid Goyal
62ccc857fe
Update Hindustan Times 2022-04-01 14:06:28 +05:30
Kovid Goyal
1dad1560e0
fix official website link 2022-04-01 10:54:04 +05:30
Kovid Goyal
d02988d466
Use standard titlebar for lookup panel
Also fix cancel button for adding a custom lookup not working. Fixes #1967459 [[Enhancement - Content server] Make the Lookup page layout more similar to other pages](https://bugs.launchpad.net/calibre/+bug/1967459)
2022-04-01 10:49:05 +05:30
Kovid Goyal
228c3c90bd
... 2022-04-01 10:31:33 +05:30
Kovid Goyal
3e58f44085
Use versioned actions as master is currently broken for setup-python v5.40.0 2022-04-01 07:18:16 +05:30
Kovid Goyal
b43747ce1d
version 5.40.0 2022-04-01 07:05:58 +05:30
Kovid Goyal
cf78710ff8
... 2022-03-31 21:17:46 +05:30
Kovid Goyal
7095708004
Allow filtering authors/tags when creating virtual library based on them. Fixes #1966537 [[Enhancement] Filter when creating a Virtual library](https://bugs.launchpad.net/calibre/+bug/1966537) 2022-03-31 12:11:52 +05:30
Kovid Goyal
22a6e41f6d
Switch to using a string list model 2022-03-31 11:37:59 +05:30
Kovid Goyal
d1242fd29c
... 2022-03-31 11:27:29 +05:30
Kovid Goyal
9a7935b7f9
Update ftype when reading metadata from cbz sub-file 2022-03-30 15:30:47 +05:30
Kovid Goyal
3b145786c9
Read covers from CBC comic files. Fixes #1967028 [Calibre doesn't load first page of CBC file as cover](https://bugs.launchpad.net/calibre/+bug/1967028) 2022-03-30 15:27:00 +05:30
Kovid Goyal
d9c61d48b9
... 2022-03-30 13:45:05 +05:30
Kovid Goyal
49fb93a5ff
Content server viewer: Allow editing bookmarks. Fixes #1966872 [[Enhancement] - Edit bookmarks](https://bugs.launchpad.net/calibre/+bug/1966872) 2022-03-29 13:41:45 +05:30
Kovid Goyal
19a9346296
Add a copy button to the image view popup. Fixes #1966851 [Enhancement Request: Copy image in Image Viewer](https://bugs.launchpad.net/calibre/+bug/1966851) 2022-03-29 12:24:13 +05:30
Kovid Goyal
b5e5f1a10b
Get the simple scraper basically working 2022-03-29 10:39:03 +05:30
Kovid Goyal
f6dbfb0bf4
Reason Magazine by Howard Cornett 2022-03-28 22:29:06 +05:30
Kovid Goyal
bd9a37fdf8
Merge branch 'master' of https://github.com/cbhaley/calibre
Fixes #1966611 [Error in book details search: date/timestamp confusion](https://bugs.launchpad.net/calibre/+bug/1966611)
2022-03-28 19:49:32 +05:30
Charles Haley
95215eded1 [Bug 1966611] Error in book details search: date/timestamp confusion 2022-03-28 15:14:54 +01:00
Kovid Goyal
3a09e3075b
Merge branch 'master' of https://github.com/cbhaley/calibre 2022-03-27 20:20:04 +05:30
Charles Haley
48f410165f Document the template language changes 2022-03-27 15:08:56 +01:00
Kovid Goyal
dc8b1da999
pep8 2022-03-27 19:23:28 +05:30
Kovid Goyal
8f3bbf0e0d
Merge branch 'master' of https://github.com/cbhaley/calibre 2022-03-27 19:22:38 +05:30
Charles Haley
ee89d968ee Improvements to the template language:
1) Support for defining nested template functions.
2) An operator, &, to do string concatenation like strcat().
3) A fair amount of clean up. mostly reording methods to make them easier to find.
2022-03-27 14:31:53 +01:00
Kovid Goyal
9005036dd0
More work on webengine scraper 2022-03-27 11:42:09 +05:30
Kovid Goyal
3df6200ca7
DOCX Output: Fix a comment immediately after a <li> tag breaking the conversion 2022-03-24 21:02:00 +05:30
Kovid Goyal
2c8e5a3a36
Start working on using Chromiums network stack to download HTML
A bunch of websites have started using TLS fingerprinting to deny
access. Bloody morons.
2022-03-24 17:35:48 +05:30
Kovid Goyal
b5370e0270
Fix #1965693 [Search-as-you-type triggers extra search after manual confirmation](https://bugs.launchpad.net/calibre/+bug/1965693) 2022-03-23 09:14:15 +05:30
Kovid Goyal
29500738eb
Allow setting current with ids as well 2022-03-23 08:18:13 +05:30
Kovid Goyal
3155a36b4b
Use shared memory for IPC with toc editor 2022-03-22 10:49:49 +05:30
Kovid Goyal
54fd6080fc
Combine close and unlink
This gives similar semantic on Windows and UNIX. On Windows closing
unlinks automatically, so do the same on UNIX.
2022-03-22 10:48:19 +05:30
Kovid Goyal
308d9ce73b
Merge branch 'courrierinternational-categories' of https://github.com/konfiot/calibre 2022-03-22 08:20:20 +05:30
Arthur Toussaint
c4fee3ccb8
Update courrierinternational recipe
Add categories
2022-03-21 23:56:30 +01:00