wakaru44 / capitulizer Goto Github PK

we need a front-end to select some episodes and perform complex actions, like

• recheck the episode info,
• launch newPosts,
• refresh picture

Maybe a good aproach is to create a form with checkboxes to select the desired episode, a select for the action, and a submit button. If we have a textbox to perform selects, great.
The page should be protected with authentication.

Cambiar diseño de la web, por otro mas limpio y estetico

Sending a mail to the app, if the html message is broken, extractSY.linksToEpisodes gives an exception.

'NoneType' object has no attribute 'replace'
Traceback (most recent call last):
File "/base/python27_runtime/python27_lib/versions/third_party/webapp2-2.5.1/webapp2.py", line 1536, in call
rv = self.handle_exception(request, response, e)
File "/base/python27_runtime/python27_lib/versions/third_party/webapp2-2.5.1/webapp2.py", line 1530, in call
rv = self.router.dispatch(request, response)
File "/base/python27_runtime/python27_lib/versions/third_party/webapp2-2.5.1/webapp2.py", line 1278, in default_dispatcher
return route.handler_adapter(request, response)
File "/base/python27_runtime/python27_lib/versions/third_party/webapp2-2.5.1/webapp2.py", line 1102, in call
return handler.dispatch()
File "/base/python27_runtime/python27_lib/versions/third_party/webapp2-2.5.1/webapp2.py", line 572, in dispatch
return self.handle_exception(e, self.app.debug)
File "/base/python27_runtime/python27_lib/versions/third_party/webapp2-2.5.1/webapp2.py", line 570, in dispatch
return method(_args, *_kwargs)
File "/base/python27_runtime/python27_lib/versions/1/google/appengine/ext/webapp/mail_handlers.py", line 65, in post
self.receive(mail.InboundEmailMessage(self.request.body))
File "/base/data/home/apps/scapitulizer/1.363265656426203682/email_aggregateEpisodes.py", line 32, in receive
self.getBody(mail_message)) # Links list
File "/base/data/home/apps/scapitulizer/1.363265656426203682/extractSY.py", line 115, in linksToEpisodes
syMsg = msg.replace("=\n", "")

There is a hole than can fill the admin's inbox.
the newPost trigger action is not protected.

El titulo del post es mas util, y facil de ordenar en el blog, si esta construido de otra manera:

Serie - temporada - numero capitulo - titulo

Por poner un ejemplo

Triggering a newPost event,
Key: ag1zfmNhcGl0dWxpemVycg0LEgdlcGlzb2RlGAUM

Internal Server Error

The server has either erred or is incapable of performing the requested operation.

Traceback (most recent call last):
File "/base/python27_runtime/python27_lib/versions/third_party/webapp2-2.5.1/webapp2.py", line 1536, in call
rv = self.handle_exception(request, response, e)
File "/base/python27_runtime/python27_lib/versions/third_party/webapp2-2.5.1/webapp2.py", line 1530, in call
rv = self.router.dispatch(request, response)
File "/base/python27_runtime/python27_lib/versions/third_party/webapp2-2.5.1/webapp2.py", line 1278, in default_dispatcher
return route.handler_adapter(request, response)
File "/base/python27_runtime/python27_lib/versions/third_party/webapp2-2.5.1/webapp2.py", line 1102, in call
return handler.dispatch()
File "/base/python27_runtime/python27_lib/versions/third_party/webapp2-2.5.1/webapp2.py", line 572, in dispatch
return self.handle_exception(e, self.app.debug)
File "/base/python27_runtime/python27_lib/versions/third_party/webapp2-2.5.1/webapp2.py", line 570, in dispatch
return method(_args, *_kwargs)
File "/base/data/home/apps/s~capitulizer/1.363432210333487870/task_newPost.py", line 78, in post
raise Exception
Exception

After adding the video to the datastore, the app throws an exception.
This causes the task to repeat again, and add another video.
Because we have no duplicate for the videos, they add again and again.

2012-11-24 21:58:17.857
'int' object is not callable
Traceback (most recent call last):
  File "/base/python27_runtime/python27_lib/versions/third_party/webapp2-2.5.1/webapp2.py", line 1547, in __call__
    return response(environ, start_response)
TypeError: 'int' object is not callable

The link in the href of the response episode, links to the source. It should link to the blog or nothing.

To hide the admin's email, the copy to them should be bcc.
NOTE: we dont send any submitter information. We use this notification for debugging the app. But we want to protect ourselves a little bit. A contact address will be provided in the projects webpage or in the documentation.

Para la completar la prueba hay que:

• Primero probar que tal se ve un iframe en una de blogger
• Luego hacer que esa pagina sea la frontal del blog, en lugar de los posts,
• si asi no funciona, probar a insertar el iframe en un post, y que ese post sea el principal

while trying to fetch a website with urllib:

2012-11-25 20:06:34.830
user agent
D 2012-11-25 20:06:34.830
Amiga-AWeb/3.4.167SE
E 2012-11-25 20:06:34.864
Could't get the link. Url ERROR
E 2012-11-25 20:06:34.865
<urlopen error An error occured while connecting to the server: DNS lookup failed for URL: http://www.seriescoco.comhttp://capitulo/the-big-bang-theory/capitulo-8/224754>
E 2012-11-25 20:06:34.865
{'User-Agent': 'Amiga-AWeb/3.4.167SE '}
E 2012-11-25 20:06:34.865
u'http://www.seriescoco.comhttp://capitulo/the-big-bang-theory/capitulo-8/224754'
E 2012-11-25 20:06:34.865
Type Error madafaca. Dunno if this mean something, but i will just die
E 2012-11-25 20:06:34.865
init() takes exactly 2 arguments (1 given)

Creacion de publicidad
Enlaces con publicidad de 5 segundos (adfly)
Otras opciones a analizar...

For God's sake!!
It is madness to write the same things to build an email instead of just passing parameters and get it built and sent

It should be a re-usable function, accesible for every Handler, that gets email parts, and creates a task to send one.
Try to make it easy to test

The application should send an email to the submitter with the info regarding the state of his/her submission

tasks/newPost needs to be refatored to a more elegant approach.
Eliminate the plain functions,
create a Post object,
use jinja templates,
be able to create different kinds of post,
and add a parameter to actually send the email or just logit

Should send a notification email to the admin in case of not finding links to videos to play in an episode web.
Send the link to the web, and the list of links found nicely ordered

2012-11-24 21:57:30.834
--- Extracting the interLinks---
E 2012-11-24 21:57:30.914
No interlinks Found on the website given

Maybe is because the mail is sent by .apphosting.bounces.google.com

Headers:

from:  Capitulizer Mighty Bot [email protected] via 2uix4h7xygsz66weerlq.apphosting.bounces.google.com 
to:  wakaru himura [email protected]
date:  27 November 2012 08:48
subject:  New Episode Available to Watch
mailed-by:  2uix4h7xygsz66weerlq.apphosting.bounces.google.com

Hay que reducir el volumen de email qeu la aplicacion envia.
Actualmente llega a bloquearse por superar la cuota de correo maximo diario que puee enviar.
El problema viene principal mente pq la tarea watchnotify manda varios, y luego ademas, la propia herramienta envia duplicados de seguridad al email.
Esto ya no parece necesario y podemos evitar incurrir en overquota