I really like this script.
The only problem is when italics are converted the blocks are copied to the paragraph and then to the blank space again.
This breaks the flow of a book. Here is a example

Traceback (most recent call last):
File "wattpad2epub.py", line 33, in
import gsweb
File "C:\Users\User\Downloads\Wattpad2Epub-master\libs\gsweb.py", line 19, in
from bs4 import BeautifulSoup
ModuleNotFoundError: No module named 'bs4'

i've already tried the solution on Google but still no luck.

There are no chapter titles in epub (Tolino & calibre ebook reader)

Right now, to use the script you to use a terminal, and most users are too lazy for that, so we should provide a GUI.

A simple GUI would have an editable field to input the story URL and a button to start the process.

A nicer GUI would also have a progress bar (advancing with each downloaded chapter) and a finalization message.

As I have been made aware, the readme is a mess.

• The requirements section mentions how to install python on OSX, but nothing about windows or linux.

• The same requirement section explains one way to install beautifulsoup and ebooklib, does this work in windows? Should we mention other ways?

• Do we really want to explain how to install python and modules at all?

I'd really like to get some feedback about this.

Once I run the script with the URL from the story, it goes all the way to the last chapter and then it starts all over again from the first to the last and the final result is an EPUB file with duplicated paragraphs, from the beginning to the end.

Is there another command?

Every chapter is enclosed in

 tags. This breaks the display of the epub, because every paragraph is displayed in a single line without line break.

Thanks for the git!
But there is a problem with the results when it finds italic tags within words or paragraphs. Like the example below:
Disclaimer
Result:
Disclaimer Disclaimer

other example:
Lorem Ipsum has been the industry's standard dummy text ever since the 1500s, when an unknown printer took a galley of type and scrambled it to make a type specimen book.
Result:
Lorem Ipsum has been the industry's standard dummy text ever since the 1500s, when an unknown printer took a galley of type and scrambled it to make a type specimen book.
standard

Another example:
It has survived not only five centuries, but also the leap into electronic typesetting, remaining essentially unchanged.
Result:
It has survived not only five centuries, but also the leap into electronic typesetting, remaining essentially unchanged.
It has survived not only five centuries, but also the leap into electronic typesetting, remaining essentially unchanged.

How to resolve this ?

Even though body.css includes basic stylization for lots of tags, the chapters' xhtml files haven't got an import line for the css script. It took me a while to notice this, so I kept checking on the HTML and the CSS to see if I was coding something wrong until I compared the code to another epub I downloaded prior.

It would be interesting if the script could write the import line into head of each xhtml individual files.

Is it right that I have to change initial_url for changing the book and it would be nice to be able to have an argument where I can put it in

Hi, I am know to github and programming in general. Manage to install and play this wonderful project, but just with URL and books written in english. When I tried to download books wich are in portuguese, the above message appears. Thankyou for this amazing git!:

asus@asus-K46CA:~/wattpadscraper/Wattpad2Epub-master$ python3 wattpad2epub.py https://www.wattpad.com/903426169-percy-jackson-filho-de-voldemort-capítulo-1
Traceback (most recent call last):
File "wattpad2epub.py", line 211, in
get_book(args.initial_url[0])
File "wattpad2epub.py", line 115, in get_book
html = gsweb.get_soup(initial_url)
File "/home/asus/wattpadscraper/Wattpad2Epub-master/libs/gsweb.py", line 77, in get_soup
html = get_url(url)
File "/home/asus/wattpadscraper/Wattpad2Epub-master/libs/gsweb.py", line 51, in get_url
response = urllib.request.urlopen(request)
File "/usr/lib/python3.6/urllib/request.py", line 223, in urlopen
return opener.open(url, data, timeout)
File "/usr/lib/python3.6/urllib/request.py", line 526, in open
response = self._open(req, data)
File "/usr/lib/python3.6/urllib/request.py", line 544, in _open
'_open', req)
File "/usr/lib/python3.6/urllib/request.py", line 504, in _call_chain
result = func(*args)
File "/usr/lib/python3.6/urllib/request.py", line 1368, in https_open
context=self._context, check_hostname=self._check_hostname)
File "/usr/lib/python3.6/urllib/request.py", line 1325, in do_open
encode_chunked=req.has_header('Transfer-encoding'))
File "/usr/lib/python3.6/http/client.py", line 1281, in request
self._send_request(method, url, body, headers, encode_chunked)
File "/usr/lib/python3.6/http/client.py", line 1292, in _send_request
self.putrequest(method, url, **skips)
File "/usr/lib/python3.6/http/client.py", line 1140, in putrequest
self._output(request.encode('ascii'))
UnicodeEncodeError: 'ascii' codec can't encode character '\xed' in position 51: ordinal not in range(128)

Currently if a title has for example "/' or ":" the epub file would not be created.

An easy fix would be just to change the following lines:

https://github.com/GatoLoko/Wattpad2Epub/blob/master/wattpad2epub.py#L172
https://github.com/GatoLoko/Wattpad2Epub/blob/master/wattpad2epub.py#L238

and remove the offending characters from string epubfile.

When attempting to download a book, a 403 Forbidden error is given. I'd assume Wattpad has introduced new backend features that block applications from scraping books.

New to this kinda thing, googled my way through it all. python wattpad2epub.py [link] won't work, so I added the directory of the file. I got this reaction:

Traceback (most recent call last):
File "C:\Users-\Desktop\Wattpad2Epub-master\wattpad2epub.py", line 282, in
get_book(args.initial_url[0])
File "C:\Users-\Desktop\Wattpad2Epub-master\wattpad2epub.py", line 214, in get_book
content=open("CSS/nav.css").read())
FileNotFoundError: [Errno 2] No such file or directory: 'CSS/nav.css'

I got bs4, ebooklib and latest ver of python. anything wrong?

Most wattpad stories have a cover image.

While there is code to download it and add it as a cover to the epub file, it was commented because something didn't work as expected.

Figure out what is wrong and fix it.

Right now, the only way to download new chapters is to download the whole story.

Figure out whether there is a way to add new chapters to existing files, and implement it.

Creating a valid ePub fails, if duplicate chapter names exist:

C:\Program Files\Python38\lib\zipfile.py:1516: UserWarning: Duplicate name: 'EPUB/Frank.xhtml'
  return self._open_to_write(zinfo, force_zip64=force_zip64)

Example: https://www.wattpad.com/story/54947779-%27normal%27-ist-relativ-solangelo

The program has a timeout error on the SSL handshake and that error causes more errors because it is not caught correctly. See (partially redacted) logs below:

Entered command: D:\DOWNLO~1\WATTPA~1>WATTPA~1.PY https://www.wattpad.com/story/185706320-earthshine-the-raintree-chronicles-book-1

b"'Earthshine: The Raintree Chronicles Book 1' by grahambower"
https://a.wattpad.com/cover/185706320-352-k381040.jpg
b'Working on: 1. When the student is ready'
Current url: http://www.wattpad.com/725708244-earthshine-the-raintree-chronicles-book-1-1-when
Pages in this chapter: 3


... ... ...


b'Working on: 3. The party'
Current url: http://www.wattpad.com/727354183-earthshine-the-raintree-chronicles-book-1-3-the
Pages in this chapter: 6
Working on: http://www.wattpad.com/727354183-earthshine-the-raintree-chronicles-book-1-3-the/page/1
Working on: http://www.wattpad.com/727354183-earthshine-the-raintree-chronicles-book-1-3-the/page/2
Working on: http://www.wattpad.com/727354183-earthshine-the-raintree-chronicles-book-1-3-the/page/3
Working on: http://www.wattpad.com/727354183-earthshine-the-raintree-chronicles-book-1-3-the/page/4
Working on: http://www.wattpad.com/727354183-earthshine-the-raintree-chronicles-book-1-3-the/page/5
Working on: http://www.wattpad.com/727354183-earthshine-the-raintree-chronicles-book-1-3-the/page/6
b'Working on: 4. The first incursion'
Current url: http://www.wattpad.com/731927539-earthshine-the-raintree-chronicles-book-1-4-the
Pages in this chapter: 5
Working on: http://www.wattpad.com/731927539-earthshine-the-raintree-chronicles-book-1-4-the/page/1
Working on: http://www.wattpad.com/731927539-earthshine-the-raintree-chronicles-book-1-4-the/page/2
Working on: http://www.wattpad.com/731927539-earthshine-the-raintree-chronicles-book-1-4-the/page/3
Traceback (most recent call last):
  File "C:\Users\prime\AppData\Local\Programs\Python\Python37\lib\urllib\request.py", line 1317, in do_open
    encode_chunked=req.has_header('Transfer-encoding'))
  File "C:\Users\prime\AppData\Local\Programs\Python\Python37\lib\http\client.py", line 1244, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "C:\Users\prime\AppData\Local\Programs\Python\Python37\lib\http\client.py", line 1290, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "C:\Users\prime\AppData\Local\Programs\Python\Python37\lib\http\client.py", line 1239, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "C:\Users\prime\AppData\Local\Programs\Python\Python37\lib\http\client.py", line 1026, in _send_output
    self.send(msg)
  File "C:\Users\prime\AppData\Local\Programs\Python\Python37\lib\http\client.py", line 966, in send
    self.connect()
  File "C:\Users\prime\AppData\Local\Programs\Python\Python37\lib\http\client.py", line 1414, in connect
    server_hostname=server_hostname)
  File "C:\Users\prime\AppData\Local\Programs\Python\Python37\lib\ssl.py", line 423, in wrap_socket
    session=session
  File "C:\Users\prime\AppData\Local\Programs\Python\Python37\lib\ssl.py", line 870, in _create
    self.do_handshake()
  File "C:\Users\prime\AppData\Local\Programs\Python\Python37\lib\ssl.py", line 1139, in do_handshake
    self._sslobj.do_handshake()
socket.timeout: _ssl.c:1059: The handshake operation timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "D:\DOWNLO~1\WATTPA~1\wattpad2epub.py", line 285, in <module>
    get_book(args.initial_url[0])
  File "D:\DOWNLO~1\WATTPA~1\wattpad2epub.py", line 241, in get_book
    chapter = get_chapter("{}{}".format(base_url, item['href']))
  File "D:\DOWNLO~1\WATTPA~1\wattpad2epub.py", line 145, in get_chapter
    for j in get_page(page_url):
  File "D:\DOWNLO~1\WATTPA~1\wattpad2epub.py", line 128, in get_page
    text = get_html(text_url).select('pre')
  File "D:\DOWNLO~1\WATTPA~1\wattpad2epub.py", line 65, in get_html
    request = urllib.request.urlopen(req)
  File "C:\Users\prime\AppData\Local\Programs\Python\Python37\lib\urllib\request.py", line 222, in urlopen
    return opener.open(url, data, timeout)
  File "C:\Users\prime\AppData\Local\Programs\Python\Python37\lib\urllib\request.py", line 531, in open
    response = meth(req, response)
  File "C:\Users\prime\AppData\Local\Programs\Python\Python37\lib\urllib\request.py", line 641, in http_response
    'http', request, response, code, msg, hdrs)
  File "C:\Users\prime\AppData\Local\Programs\Python\Python37\lib\urllib\request.py", line 563, in error
    result = self._call_chain(*args)
  File "C:\Users\prime\AppData\Local\Programs\Python\Python37\lib\urllib\request.py", line 503, in _call_chain
    result = func(*args)
  File "C:\Users\prime\AppData\Local\Programs\Python\Python37\lib\urllib\request.py", line 755, in http_error_302
    return self.parent.open(new, timeout=req.timeout)
  File "C:\Users\prime\AppData\Local\Programs\Python\Python37\lib\urllib\request.py", line 525, in open
    response = self._open(req, data)
  File "C:\Users\prime\AppData\Local\Programs\Python\Python37\lib\urllib\request.py", line 543, in _open
    '_open', req)
  File "C:\Users\prime\AppData\Local\Programs\Python\Python37\lib\urllib\request.py", line 503, in _call_chain
    result = func(*args)
  File "C:\Users\prime\AppData\Local\Programs\Python\Python37\lib\urllib\request.py", line 1360, in https_open
    context=self._context, check_hostname=self._check_hostname)
  File "C:\Users\prime\AppData\Local\Programs\Python\Python37\lib\urllib\request.py", line 1319, in do_open
    raise URLError(err)
urllib.error.URLError: <urlopen error _ssl.c:1059: The handshake operation timed out>

It would be nice if we had a better documentation with:

1. How to install
2. How to run
3. Where the file output will be

After the script run for about 5 minutes, at some point, I had a 404 timeout:

Traceback (most recent call last):
  File "wattpad2epub.py", line 271, in <module>
    get_book(args.initial_url[0])
  File "wattpad2epub.py", line 228, in get_book
    chapter = get_chapter("{}{}".format(base_url, item['href']))
  File "wattpad2epub.py", line 135, in get_chapter
    for j in get_page(page_url):
  File "wattpad2epub.py", line 118, in get_page
    text = get_html(text_url).select('pre')
  File "wattpad2epub.py", line 63, in get_html
    request = urllib.request.urlopen(req)
  File "/usr/local/Cellar/python3/3.6.3/Frameworks/Python.framework/Versions/3.6/lib/python3.6/urllib/request.py", line 223, in urlopen
    return opener.open(url, data, timeout)
  File "/usr/local/Cellar/python3/3.6.3/Frameworks/Python.framework/Versions/3.6/lib/python3.6/urllib/request.py", line 532, in open
    response = meth(req, response)
  File "/usr/local/Cellar/python3/3.6.3/Frameworks/Python.framework/Versions/3.6/lib/python3.6/urllib/request.py", line 642, in http_response
    'http', request, response, code, msg, hdrs)
  File "/usr/local/Cellar/python3/3.6.3/Frameworks/Python.framework/Versions/3.6/lib/python3.6/urllib/request.py", line 564, in error
    result = self._call_chain(*args)
  File "/usr/local/Cellar/python3/3.6.3/Frameworks/Python.framework/Versions/3.6/lib/python3.6/urllib/request.py", line 504, in _call_chain
    result = func(*args)
  File "/usr/local/Cellar/python3/3.6.3/Frameworks/Python.framework/Versions/3.6/lib/python3.6/urllib/request.py", line 756, in http_error_302
    return self.parent.open(new, timeout=req.timeout)
  File "/usr/local/Cellar/python3/3.6.3/Frameworks/Python.framework/Versions/3.6/lib/python3.6/urllib/request.py", line 532, in open
    response = meth(req, response)
  File "/usr/local/Cellar/python3/3.6.3/Frameworks/Python.framework/Versions/3.6/lib/python3.6/urllib/request.py", line 642, in http_response
    'http', request, response, code, msg, hdrs)
  File "/usr/local/Cellar/python3/3.6.3/Frameworks/Python.framework/Versions/3.6/lib/python3.6/urllib/request.py", line 570, in error
    return self._call_chain(*args)
  File "/usr/local/Cellar/python3/3.6.3/Frameworks/Python.framework/Versions/3.6/lib/python3.6/urllib/request.py", line 504, in _call_chain
    result = func(*args)
  File "/usr/local/Cellar/python3/3.6.3/Frameworks/Python.framework/Versions/3.6/lib/python3.6/urllib/request.py", line 650, in http_error_default
    raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 404: Not Found

What should happen?
Just keep trying until I cancel it, or at least don't lose all the things the script did in the process, so we can resume it. (This error happened like 4 times in 10 tries)

Example, be able to download everything from https://www.wattpad.com/list/999999999.

Hi,
At the end of the script (I'm using python 3.6 with Windows 7), I have an error "AttributeError: 'bytes' object has no attribute 'encode'".
I try also with your own example, there isi the same issue... I think it should be an error in the usage of the ebooklib library...

(...)
Pages in this chapter: 3
Working on: http://www.wattpad.com/464522910-asylum-chapitre-40/page/1
Working on: http://www.wattpad.com/464522910-asylum-chapitre-40/page/2
Working on: http://www.wattpad.com/464522910-asylum-chapitre-40/page/3
Working on: Chapitre 41
Current url: http://www.wattpad.com/464524707-asylum-chapitre-41
Pages in this chapter: 2
Working on: http://www.wattpad.com/464524707-asylum-chapitre-41/page/1
Working on: http://www.wattpad.com/464524707-asylum-chapitre-41/page/2
Traceback (most recent call last):
File "D:\Téléchargements\Wattpad2Epub-master\wattpad2epub.py", line 261, in
get_book(args.initial_url[0])
File "D:\Téléchargements\Wattpad2Epub-master\wattpad2epub.py", line 239, in ge
t_book
epub.write_epub(epubfile, book, {})
File "C:\Python36\lib\site-packages\ebooklib\epub.py", line 1534, in write_epu
b
epub.write()
File "C:\Python36\lib\site-packages\ebooklib\epub.py", line 1224, in write
self._write_items()
File "C:\Python36\lib\site-packages\ebooklib\epub.py", line 1213, in _write_it
ems
self.out.writestr('%s/%s' % (self.book.FOLDER_NAME, item.file_name), item.ge
t_content())
File "C:\Python36\lib\site-packages\ebooklib\epub.py", line 453, in get_conten
t
self.content = self.book.get_template('cover')
File "D:\Téléchargements\Wattpad2Epub-master\wattpad2epub.py", line 106, in ne
w_get_template
return original_get_template(*args, **kwargs).encode(encoding='utf8')
AttributeError: 'bytes' object has no attribute 'encode'

Resuming/updating would be very useful to handle stories where the author is still adding new chapters, and maybe other cases.

Some test to "update" an existing epub have been done, but for some reason it ends up being a mess that doesn't comply with the epub specification and can't be handled by most readers.

This need's to be figured out and implemented properly.

Used last version but autonome for chapters and index is broken, could you please fix it?

Thank you in advance

Right now, there is no "easy" (end user easy) way to install the script.

We should leverage setuptools to install and/or package it

I have a problem with running program. I can't understand where should I input those commands:

pip3 install BeautifulSoup4
pip3 install ebooklib

And this comand as well:
python3 wattpad2epub.py your_url_argument