Cutlery/calibre
1
0
Fork 0
mirror of https://github.com/kovidgoyal/calibre.git synced 2025-07-09 03:04:10 -04:00
Code Issues Packages Projects Releases Wiki Activity

When trying to detect the encoding of html, do not use more than the first 10KB so that detection is not too slow

Browse Source
This commit is contained in:
Kovid Goyal 2011-02-16 14:34:09 -07:00
parent a904d5d192
commit fd2e3db07a
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
src/calibre/ebooks/chardet/__init__.py
View File

@ -53,7 +53,7 @@ _CHARSET_ALIASES = { "macintosh" : "mac-roman",
def force_encoding(raw, verbose, assume_utf8=False): def force_encoding(raw, verbose, assume_utf8=False):
from calibre.constants import preferred_encoding from calibre.constants import preferred_encoding
try: try:
chardet = detect(raw) chardet = detect(raw[:1024*10])
except: except:
chardet = {'encoding':preferred_encoding, 'confidence':0} chardet = {'encoding':preferred_encoding, 'confidence':0}
encoding = chardet['encoding'] encoding = chardet['encoding']