Commit Graph

44614 Commits

Author SHA1 Message Date
Kovid Goyal e46982f7df Allow specifying timeout to read_url() 2022-04-02 14:22:56 +05:30
Kovid Goyal dc92c8f9bb DRYer 2022-04-02 13:50:14 +05:30
Kovid Goyal 7a4a6d0d19 Report document URL in domready event as well 2022-04-02 13:23:32 +05:30
Kovid Goyal a0c9005d69 Also ignore domready for about: urls 2022-04-02 13:09:11 +05:30
Kovid Goyal 4e72452688 Use the new chromium based scraper for the kobo books plugin
Seems like a more robust workaround for its Akamai based network
protocol analysis based blocking than using python user agents.
2022-04-02 12:28:42 +05:30
Kovid Goyal 4a0b742d2d ... 2022-04-02 12:27:31 +05:30
Kovid Goyal 212ad2a135 Allow per thread scrapers 2022-04-02 12:07:49 +05:30
Kovid Goyal a1096d303d Stop fetching once dom is ready 2022-04-02 09:04:49 +05:30
Kovid Goyal 1c2ca981d8 Cleanup overseers explicitly on exit so that their __del__ method doesnt delay shutdown 2022-04-02 08:59:20 +05:30
Kovid Goyal b7c92f3498 Move webengine specific code into its own module
Since webengine currently needs to be imported before QApplication is
constructed, this allows it to be controlled easily
2022-04-02 08:42:28 +05:30
Kovid Goyal fbb0956665 Skip scraper tests when webengine is known to fail 2022-04-02 07:21:26 +05:30
Kovid Goyal a0c0bd7af9 Print extra debug info when testing simple scraper 2022-04-02 07:07:37 +05:30
Kovid Goyal 1c8296b710 ... 2022-04-02 06:36:40 +05:30
Kovid Goyal 223444e208 Test that worker cleanup happens 2022-04-02 06:26:47 +05:30
Kovid Goyal 44ccd8104b Get simple scraper working via worker processes 2022-04-02 06:25:14 +05:30
Kovid Goyal 91268eb9c0 Merge branch 'master' of https://github.com/cbhaley/calibre 2022-04-01 19:47:38 +05:30
Charles Haley 6f22d674b4 Prevent overwriting local functions by another with the same name defined in a stored template. 2022-04-01 15:14:33 +01:00
Kovid Goyal 62ccc857fe Update Hindustan Times 2022-04-01 14:06:28 +05:30
Kovid Goyal 1dad1560e0 fix official website link 2022-04-01 10:54:04 +05:30
Kovid Goyal d02988d466 Use standard titlebar for lookup panel
Also fix cancel button for adding a custom lookup not working. Fixes #1967459 [[Enhancement - Content server] Make the Lookup page layout more similar to other pages](https://bugs.launchpad.net/calibre/+bug/1967459)
2022-04-01 10:49:05 +05:30
Kovid Goyal 228c3c90bd ... 2022-04-01 10:31:33 +05:30
Kovid Goyal 3e58f44085 Use versioned actions as master is currently broken for setup-python v5.40.0 2022-04-01 07:18:16 +05:30
Kovid Goyal b43747ce1d version 5.40.0 2022-04-01 07:05:58 +05:30
Kovid Goyal cf78710ff8 ... 2022-03-31 21:17:46 +05:30
Kovid Goyal 7095708004 Allow filtering authors/tags when creating virtual library based on them. Fixes #1966537 [[Enhancement] Filter when creating a Virtual library](https://bugs.launchpad.net/calibre/+bug/1966537) 2022-03-31 12:11:52 +05:30
Kovid Goyal 22a6e41f6d Switch to using a string list model 2022-03-31 11:37:59 +05:30
Kovid Goyal d1242fd29c ... 2022-03-31 11:27:29 +05:30
Kovid Goyal 9a7935b7f9 Update ftype when reading metadata from cbz sub-file 2022-03-30 15:30:47 +05:30
Kovid Goyal 3b145786c9 Read covers from CBC comic files. Fixes #1967028 [Calibre doesn't load first page of CBC file as cover](https://bugs.launchpad.net/calibre/+bug/1967028) 2022-03-30 15:27:00 +05:30
Kovid Goyal d9c61d48b9 ... 2022-03-30 13:45:05 +05:30
Kovid Goyal 49fb93a5ff Content server viewer: Allow editing bookmarks. Fixes #1966872 [[Enhancement] - Edit bookmarks](https://bugs.launchpad.net/calibre/+bug/1966872) 2022-03-29 13:41:45 +05:30
Kovid Goyal 19a9346296 Add a copy button to the image view popup. Fixes #1966851 [Enhancement Request: Copy image in Image Viewer](https://bugs.launchpad.net/calibre/+bug/1966851) 2022-03-29 12:24:13 +05:30
Kovid Goyal b5e5f1a10b Get the simple scraper basically working 2022-03-29 10:39:03 +05:30
Kovid Goyal f6dbfb0bf4 Reason Magazine by Howard Cornett 2022-03-28 22:29:06 +05:30
Kovid Goyal bd9a37fdf8 Merge branch 'master' of https://github.com/cbhaley/calibre
Fixes #1966611 [Error in book details search: date/timestamp confusion](https://bugs.launchpad.net/calibre/+bug/1966611)
2022-03-28 19:49:32 +05:30
Charles Haley 95215eded1 [Bug 1966611] Error in book details search: date/timestamp confusion 2022-03-28 15:14:54 +01:00
Kovid Goyal 3a09e3075b Merge branch 'master' of https://github.com/cbhaley/calibre 2022-03-27 20:20:04 +05:30
Charles Haley 48f410165f Document the template language changes 2022-03-27 15:08:56 +01:00
Kovid Goyal dc8b1da999 pep8 2022-03-27 19:23:28 +05:30
Kovid Goyal 8f3bbf0e0d Merge branch 'master' of https://github.com/cbhaley/calibre 2022-03-27 19:22:38 +05:30
Charles Haley ee89d968ee Improvements to the template language:
1) Support for defining nested template functions.
2) An operator, &, to do string concatenation like strcat().
3) A fair amount of clean up. mostly reording methods to make them easier to find.
2022-03-27 14:31:53 +01:00
Kovid Goyal 9005036dd0 More work on webengine scraper 2022-03-27 11:42:09 +05:30
Kovid Goyal 3df6200ca7 DOCX Output: Fix a comment immediately after a <li> tag breaking the conversion 2022-03-24 21:02:00 +05:30
Kovid Goyal 2c8e5a3a36 Start working on using Chromiums network stack to download HTML
A bunch of websites have started using TLS fingerprinting to deny
access. Bloody morons.
2022-03-24 17:35:48 +05:30
Kovid Goyal b5370e0270 Fix #1965693 [Search-as-you-type triggers extra search after manual confirmation](https://bugs.launchpad.net/calibre/+bug/1965693) 2022-03-23 09:14:15 +05:30
Kovid Goyal 29500738eb Allow setting current with ids as well 2022-03-23 08:18:13 +05:30
Kovid Goyal 3155a36b4b Use shared memory for IPC with toc editor 2022-03-22 10:49:49 +05:30
Kovid Goyal 54fd6080fc Combine close and unlink
This gives similar semantic on Windows and UNIX. On Windows closing
unlinks automatically, so do the same on UNIX.
2022-03-22 10:48:19 +05:30
Kovid Goyal 308d9ce73b Merge branch 'courrierinternational-categories' of https://github.com/konfiot/calibre 2022-03-22 08:20:20 +05:30
Arthur Toussaint c4fee3ccb8 Update courrierinternational recipe
Add categories
2022-03-21 23:56:30 +01:00