34923 Commits

Author SHA1 Message Date
Kovid Goyal
faf46f844f Set the Referer when accessing cached pages 2017-03-02 21:47:52 +05:30
Kovid Goyal
122a1de44d Google queries 2017-03-02 21:09:36 +05:30
Kovid Goyal
f98dfa6775 Resolve cover URLs early 2017-03-02 20:04:53 +05:30
Kovid Goyal
959583bcc2 Reduce metadata source plugin updates interval
Also touch the cache file even when there are no changes to avoid
excessive queries.
2017-03-02 19:46:57 +05:30
Kovid Goyal
b9eea6b91c Resolve wayback links to original location instead of wayback cache
Better performance since wayback cache is so slow
2017-03-02 17:02:27 +05:30
Kovid Goyal
5c9c40431f Use bing to power the amazon metadata plugin
Faster and more reliable than wayback machine
2017-03-02 16:55:32 +05:30
Kovid Goyal
287fa950a1 Allow removing a header easily 2017-03-02 13:28:36 +05:30
Kovid Goyal
17a2d6dc26 Use a common UA when searching via SE 2017-03-02 13:17:03 +05:30
Kovid Goyal
9c78d6d18b Use https URLS for web archive 2017-03-02 13:06:55 +05:30
Kovid Goyal
0350e13e87 ... 2017-03-02 13:00:53 +05:30
Kovid Goyal
8a885650f7 ... 2017-03-02 10:41:17 +05:30
Kovid Goyal
c16f555f18 Dont try to get cached URL for directly contrsucted asing based URLs 2017-03-02 10:28:58 +05:30
Kovid Goyal
f4c054397a ... 2017-03-02 10:12:59 +05:30
Kovid Goyal
1a7a561e48 ... 2017-03-02 09:37:37 +05:30
Kovid Goyal
d1ad4955a8 Implement searching amazon via wayback machine
Disabled, as wayback machine is really slow/flaky
2017-03-02 09:19:51 +05:30
Kovid Goyal
6c4c14ceca print log on failure 2017-03-02 09:15:17 +05:30
Kovid Goyal
6bde347e58 Reduce wayback min interval 2017-03-02 00:00:15 +05:30
Kovid Goyal
4e8b9c5c0c A spot of refactoring 2017-03-01 23:19:02 +05:30
Kovid Goyal
a750d21495 Update The Economist some more 2017-03-01 22:12:04 +05:30
Kovid Goyal
98a6916854 ... 2017-03-01 21:38:37 +05:30
Kovid Goyal
8c8c3dad3f Code to get cached URLs from wayback machine 2017-03-01 21:35:10 +05:30
Kovid Goyal
45c0fe8c54 Code to search using ddg 2017-03-01 20:37:47 +05:30
Kovid Goyal
59fdacad91 Wire up the metadata source plugin live updates
Updates are kicked off when the user uses either the single or bulk
download metadata tools in the GUI.
2017-03-01 14:44:44 +05:30
Kovid Goyal
722106531f ... 2017-03-01 14:33:44 +05:30
Kovid Goyal
07942bda23 ... 2017-03-01 13:03:13 +05:30
Kovid Goyal
9c90bd1f59 Ensure that hashes are correct when updating source plugins 2017-03-01 13:01:30 +05:30
Kovid Goyal
0fb0c603da Output plugin versions in identify log 2017-03-01 10:35:59 +05:30
Kovid Goyal
e9a1d3e979 Only patch metadata sources atomically 2017-03-01 10:25:25 +05:30
Kovid Goyal
58f17e9589 Throttle amazon requests some more
Hopefully this will avoid triggering their new bot detection.
2017-03-01 09:11:34 +05:30
Kovid Goyal
f143d1095a Update The Economist
Merge branch 'patch-6' of https://github.com/bobbysteel/calibre
2017-03-01 08:32:00 +05:30
bobbysteel
2a6bc4f501 Cleanup after latest changes to site 2017-02-28 20:39:45 +00:00
Kovid Goyal
0ac9ac2e15 DRYer 2017-02-28 23:56:24 +05:30
Kovid Goyal
1dfbd333a3 API to get/set user agent 2017-02-28 23:33:36 +05:30
Kovid Goyal
5d3c99df59 Raise number of versions 2017-02-28 22:56:46 +05:30
Kovid Goyal
e20230c9a7 A spot of refactoring 2017-02-28 22:44:35 +05:30
Kovid Goyal
caac92bbd8 A larger pool of random UAs 2017-02-28 21:20:21 +05:30
Kovid Goyal
3cd8b3f89d Files Browser->File Browser 2017-02-28 15:02:12 +05:30
Kovid Goyal
c31ff8f30e Google metadata download: Fix metadata not being found when the title of the book includes a sub-title 2017-02-28 14:57:07 +05:30
Kovid Goyal
329cfcd61c ... 2017-02-28 14:23:11 +05:30
Kovid Goyal
c525f5587f Improve downloading of covers from the google books metadata source 2017-02-28 14:19:19 +05:30
Kovid Goyal
b5010e7060 Code to patch in dynamically updated metadata plugins 2017-02-28 13:52:41 +05:30
Kovid Goyal
82fca6cfae Ensure all builtin metadata source plugins define version and minimum_calibre_version 2017-02-28 13:32:41 +05:30
Kovid Goyal
a8e07cd355 ... 2017-02-28 10:38:52 +05:30
Kovid Goyal
889ec6e491 Implement update interval for downloading metadata source plugins 2017-02-28 10:35:39 +05:30
Kovid Goyal
e0f1fa9206 Start work on live update for the builtin metadata plugins 2017-02-28 10:27:57 +05:30
Kovid Goyal
e7a6ff76a4 ... 2017-02-28 00:21:09 +05:30
Kovid Goyal
0250666dd9 Edit Book: When inserting full screen images, use the actual image dimensions in the generated SVG code, when available 2017-02-27 23:36:17 +05:30
Kovid Goyal
34f28d22dd Edit book: Fix a regression that caused pasting copied text from programs that generate both HTML and plain text when copying to paste the HTML in preference to the plain text 2017-02-27 20:39:24 +05:30
Kovid Goyal
3e2276db36 Do not check umask for isolated installs 2017-02-27 01:32:34 +05:30
Kovid Goyal
abbf258cfa Linux installer: Check that the umask is suitable before running the installer.
This prevents system breakage because of bugs in xdg-mime when the user
has set their umask to prevent reading of files by other users on the
system. See https://www.mobileread.com/forums/showthread.php?t=277803
2017-02-27 01:30:29 +05:30