mutaku / stumpy Goto Github PK

``>>> for c in b:
... url = "http://192.168.11.4:8001/url/"+urllib.quote(c[0])
... f = urllib.urlopen(url)
... f.read()
...
'

Add in a check for shortening links that are already shortened (self domain) using url parsing like in the old stumpy.

string.punctuation includes " and ' which could easily mess up copying and including for use as a variable such as SECRET_KEY which be default looks like:
SECRET_KEY = ''

string.punctuation
'!"#$%&'()*+,-./:;<=>?@[]^_`{|}~'

Either replace " and ' with something else or triple quote SECRET_KEY like:
SECRET_KEY = ''' '''

Need a clickable link in admin interface so when sorting or searching links, you can actually click to visit rather than copy and paste out.

Can't seem to access the admin interface anymore with urls.py

# show the index from /
url(r'^$', 'shortener.views.index'),
# get a url for redirection /shorty
url(r'^(?P<short>\w+)/$', 'shortener.views.detail'),
# send a url to be shortened from /url/someencodedurl
url(r'^url/(?P<url>\S+)/$', 'shortener.views.submit'),

# Uncomment the admin/doc line below to enable admin documentation:
url(r'^admin/doc/', include('django.contrib.admindocs.urls')),
# Uncomment the next line to enable the admin:
url(r'^admin/', include(admin.site.urls)),

judging by the 500 error it seems to be sending it to the submit view

Environment:

Request Method: GET
Request URL: http://192.168.11.4:8001/admin/

Django Version: 1.3 SVN-16009
Python Version: 2.6.5
Installed Applications:
['django.contrib.auth',
'django.contrib.contenttypes',
'django.contrib.sessions',
'django.contrib.sites',
'django.contrib.messages',
'django.contrib.staticfiles',
'django.contrib.admin',
'django.contrib.admindocs',
'shortener']
Installed Middleware:
('django.middleware.common.CommonMiddleware',
'django.contrib.sessions.middleware.SessionMiddleware',
'django.middleware.csrf.CsrfViewMiddleware',
'django.contrib.auth.middleware.AuthenticationMiddleware',
'django.contrib.messages.middleware.MessageMiddleware')

Traceback:
File "/home/mugen/programming/django/django/core/handlers/base.py" in get_response

1.                     response = callback(request, _callback_args, *_callback_kwargs)
   

   File "/home/mugen/programming/Stumpy/shortener/views.py" in detail
   __ 11. thisurl = url.objects.get(shorturl=short) __
   File "/home/mugen/programming/django/django/db/models/manager.py" in get

2.     return self.get_query_set().get(_args, *_kwargs)
   

   File "/home/mugen/programming/django/django/db/models/query.py" in get

3.                 % self.model._meta.object_name)
   

Exception Type: DoesNotExist at /admin/
Exception Value: url matching query does not exist.

seems that i can still create dupes but breaks on creating the short url (after the save method) since it finds multiple returns on longurl.

However, if i scrape through this before saving, i can't update values later like +=1 hits.

Would solve #29 and allows for some other query string parameters to be built in later like adding support for IRC bot submissions and so forth.

setup lighty to run the app

add another layer of url cleaning before dumping.
right now it does a verify_exists which is decent i guess.

old way was to run it through an htmlcleaner but lets do something more django built-in.

-> In the index the BOOKMARKLET has hardcoded domain in it.
-> Self stump check in shortener.views.submit has hardcoded domain in it.

something like this should work:

Site.objects.get_current().domain
u'example.com'

but that's obviously not correct.

right now the way things work is that all strings after / go to decoding into a url EXCEPT if string == admin or account (since these come before the general url decoding bit)

This is okay until someone would hit over 150million links:

import shortener.base62 as s
s.Decode('admin').num
150947331
s.Decode('account').num
579179102503L

not really an urgent issue (of course) but programmatically it sucks.
==> fix regex

urls that are encoded get passed to /ur/encoded_url
the encoded_url always yeilds:
http://google.com -> http:/google.com

// -> / for some reason.
admin interface submission is fine (right to model) something is just off with lighttpd+request parsing !?

djang-user google group link: http://groups.google.com/group/django-users/browse_thread/thread/76919b39159b66db

could manually look for this and adjust but that's kinda meh and doesn't solve the issue:

stump_split = list(this_stump.partition(":")) if stump_split[1] and not stump_split[2].startswith("//"): stump_split[2] = "/"+stump_split[2] this_stump = ''.join(stump_split)

since the hashurl is currently created via views.py, if you enter a url in teh admin interface, no hashurl is created.

move hashurl creation to model level.

query strings in submitted urls are stripped off when submitting and not logged in...
redirected to login page where url is stored as 'next=' so the query string is getting sucked into the url grab then.

right now can't dupe submit as it picks up on validation error at hashurl field.
because debug=True (for now) it spits back validation error.

This should instead give back a detail view with the existing short url.
[do something like try: except ValidationError (duplication): blah]

Need an informative return after posting url to provide the shortened version.
Kinda does this now but it's ugly.

can read in most of the url with the urls.py and views.py configuration as is... but some gets cut if we have "?"
e.g.:
http://192.168.11.4:8001/url/http%3A//google.com/blah.py?&bl=203
yields:
ttp://192.168.11.4:8001/url/http%3A//google.com/blah.py
Maybe we need to try sending with js urlencode

urlencoding works:
http://192.168.11.4:8001/url/http%3A//google.com/blah.py%3Fs%3D23/
yields:
Adding link http://google.com/blah.py?s=23
as it should.

When the last bugs are finalized, create a public branch to put at the main mutaku github and then keep a private development branch for personal use and development that can be pushed out to the public one and vice versa.

see commit comment here : 04c8850

basically, the clipboard feature is working in the loaded page but not when loaded into an iframe via bookmarklet.

We need a nice index template to match the one currently at t04u.be

create a 404 or other nice error when hitting a dupe entry (now spits out a mysql error on the unique field [hashurl])

Environment:

Request Method: GET
Request URL: http://192.168.11.4:8001/url/http://forecast.weather.gov/MapClick.php?CityName=Philadelphia&state=PA&site=PHI&lat=39.9525&lon=-75.1657/

Django Version: 1.3 SVN-16009
Python Version: 2.6.5
Installed Applications:
['django.contrib.auth',
'django.contrib.contenttypes',
'django.contrib.sessions',
'django.contrib.sites',
'django.contrib.messages',
'django.contrib.staticfiles',
'django.contrib.admin',
'django.contrib.admindocs',
'shortener']
Installed Middleware:
('django.middleware.common.CommonMiddleware',
'django.contrib.sessions.middleware.SessionMiddleware',
'django.middleware.csrf.CsrfViewMiddleware',
'django.contrib.auth.middleware.AuthenticationMiddleware',
'django.contrib.messages.middleware.MessageMiddleware')

Traceback:
File "/home/mugen/programming/django/django/core/handlers/base.py" in get_response

1.                     response = callback(request, _callback_args, *_callback_kwargs)
   

   File "/home/mugen/programming/Stumpy/shortener/views.py" in submit
2. thisurl = url(longurl=theurl)

Exception Type: TypeError at /url/http://forecast.weather.gov/MapClick.php?CityName=Philadelphia&state=PA&site=PHI&lat=39.9525&lon=-75.1657/
Exception Value: 'unicode' object is not callable

from shortener.models import url
url = u'http://t04u.be/'
type(url)
<type 'unicode'>
b = url(longurl=url)
Traceback (most recent call last):
File "", line 1, in
TypeError: 'unicode' object is not callable
from django.utils.encoding import smart_str
b = url(longurl=smart_str(url))
Traceback (most recent call last):
File "", line 1, in
TypeError: 'unicode' object is not callable
smart_str(url)
'http://t04u.be/'
type(smart_str(url))
<type 'str'>
a = smart_str(url)
type(a)
<type 'str'>
b = url(longurl=a)
Traceback (most recent call last):
File "", line 1, in
TypeError: 'unicode' object is not callable

not working for some reason.

implement the chainsaw (or django session) so that, if wanted, could associated with a specific user jsut for being able to 'show all my stumps'.

however, it could also be done by using real authentication. And so when the user clicks bookmarklet and session has expired, the pop up will spit in the login first then redirect back to submit link. This way, the cookie column would then be just user names that we can show your username associated stumps if you ask for them.

Seems that it's passing nicely over a double post on updates. (editing a past url and changing to an existing) But I think new creation dupes are picked up fine.

updates to the hits column also trigger this duplication problem.

Have to differential the inserts on the urls vs updates for duplication checks.

do it.

Show the currently logged in users stumps on the main page so they don't always have to go to the admin interface to view their personal stumps.

should we dump in the old urls?

all we would have to do us drop the table (when ready), then take the old database and for each row grab the full url and use urllib to do a "/url/FULLURL" kind of thing for each and since the shortened url is made off the auto_incrementing id column for each insert, they should match up.
Once they are verified to match, we can backup old database and take it down.

need to trim the full urls... caused a mess when they are shown in full.
shows up in admin interface and in the index, e.g. ...

could use this, at least in the template:
{{ some_list.longurl|slice:":40"}}
this would chop at 40 characters... but we would probably want to do an if {{some_list.longurl|length}} >40 then we add "..." after that template insertion to indicate to the user that we chopped it.

too small... make a tad taller and double the width maybe.

or adjust the css for the post results html.

input box to submit a url on the main page

redirect from django.shortcuts is used to do a:
return redirect(stump.longurl)

but if longurl == 'google.com', the redirect breaks and shows the error in parsign urls.py?!?

for now i've just added a hack to add a default http:// protocol so google.com becomes http://google.com but this is meh as well.

for now this saves the redirect.

after setting up lighty,
remove the debug switch so we aren't feeding out all kinds of code to the public.

title.

Seems ones that have an uppercase counterpart are broken. May be seeing 2a == 2A.

Can't seem to access the admin interface anymore with urls.py

judging by the 500 error it seems to be sending it to the submit view

Environment:

Request Method: GET
Request URL: http://192.168.11.4:8001/admin/

Django Version: 1.3 SVN-16009
Python Version: 2.6.5
Installed Applications:
['django.contrib.auth',
'django.contrib.contenttypes',
'django.contrib.sessions',
'django.contrib.sites',
'django.contrib.messages',
'django.contrib.staticfiles',
'django.contrib.admin',
'django.contrib.admindocs',
'shortener']
Installed Middleware:
('django.middleware.common.CommonMiddleware',
'django.contrib.sessions.middleware.SessionMiddleware',
'django.middleware.csrf.CsrfViewMiddleware',
'django.contrib.auth.middleware.AuthenticationMiddleware',
'django.contrib.messages.middleware.MessageMiddleware')

Traceback:
File "/home/mugen/programming/django/django/core/handlers/base.py" in get_response

1.                     response = callback(request, _callback_args, *_callback_kwargs)
   

   File "/home/mugen/programming/Stumpy/shortener/views.py" in detail
   __ 11. thisurl = url.objects.get(shorturl=short) __
   File "/home/mugen/programming/django/django/db/models/manager.py" in get

2.     return self.get_query_set().get(_args, *_kwargs)
   

   File "/home/mugen/programming/django/django/db/models/query.py" in get

3.                 % self.model._meta.object_name)
   

Exception Type: DoesNotExist at /admin/
Exception Value: url matching query does not exist.