grhbit / mirrorrr Goto Github PK

What steps will reproduce the problem?
1. Visit http://store.steampowered.com/search/?specials=1&page=1 via 
https://mirrorrr.appspot.com/
2. Click Page 2 (or 3)

What is the expected output? What do you see instead?
Page URL should be:
https://mirrorrr.appspot.com/store.steampowered.com/search/?sort_by=&sort_order=
ASC&specials=1&page=2
This URL is opened instead:
https://mirrorrr.appspot.com/store.steampowered.com/search/?specials=1&page=1#so
rt_by=&sort_order=ASC&specials=1&page=2
However _opening the link in new tab_ works fine.

What version of the product are you using? On what operating system?
Firefox 14.0.1
Chrome 21.0.1180.60 m

Please provide any additional information below.

Currently, mirrorrr is setup to cache all pages in the datastore.  For some
setups, you may not desire this behavior. 

I have modified mirrorrr to enable or disable cache using the global
ENABLE_CACHE (defaulting to True for compatibility reasons).  

This code is built up from the changes I made in issue #6 (enable/disable
recent pages).  

Great program - it works fine as long as the original site answers fast
enough :-)

One issue I had when deploying this on App Engine was that the latest_urls
were not getting added to memcache - maybe because there were no
entrypoints to start with, and it stored an empty list ?

Anyway, replacing memcache.add('latest_urls') by
memcache.set('latest_urls') fixed the issue...

Some suggestions for the future:
1. ability to limit the mirroring to certain sites (personal proxy)

2. ability to place this in a subdirectory /mirror/ (or whatever)
For this to work, transform_content.py needs to be adapted. Since I have
sites using base href="..." and relative URLs relating to that base, the
easiest way I found for this to work was to :
a. add %{host_url}s/mirror/ for ABSOLUTE_URL_REGEX urls - complete URL so
that the base href is taken into account and the browser can do its job
b. add /mirror/%(base)s/ for BASE_RELATIVE_URL_REGEX urls
c. don't add %(accessed_dir)s for SAME_DIR_URL_REGEX and
TRAVERSAL_URL_REGEX urls

What steps will reproduce the problem?
1. Go to any website.
2. Try to log in.

What is the expected output? What do you see instead?
A successful login. Instead I see a blank page on Chrome and "The HTTP 
request method was not accepted by the server" on Opera.


What version of the product are you using? On what operating system?
Revision 9 from svn

What steps will reproduce the problem?
1. login onto email
2. logging onto facebook
3. logging onto anything else

What is the expected output? What do you see instead?

I expect to view the site as a logged in user.

What steps will reproduce the problem?
1. trying to watch youtube video.
2. Trying to listen to music with Grooveshark.
3.

What is the expected output? What do you see instead?
I expect it to play flash normally, instead it did not load the video.

What version of the product are you using? On what operating system?
I'm using the newest version secureable on win7.

Please provide any additional information below.

Hi all,

I'm new at App Engine, I was trying to make Mirrorrr worked on pre-defined but 
I've failed, my app always produced errors :(

So please help me, I want every time I access my app URL, it will automatic 
access to pre-defined URL without typing in any forms.

For example:
When I access my Google App Engine: ap.giang.us it will access my blog at 
giang.us.

Thank in advanced,
Giang

What i want to do is add some javascript to the proxied pages to display
ads and a url bar. I know this is possible but i have no idea on how to mod
the code to make this work. Any ideas?

for example, visit this page 
https://mirrorrr.appspot.com/fan.lib.ru/k/kriptilia. most links cannot be 
visited becouse finished slash a ripped

What steps will reproduce the problem?
1. Download revision 9 from svn
2. run the app python2.5 /usr/local/google_appengine/dev_appserver.py 
mirrorrr-read-only/
3. Go to assenna.com

What is the expected output? What do you see instead?
The expected output should be assenna.com. Instead I get a blank page. I 
noticed the regex was changing javascript in the HTML files that looked like 
this:

ratings_mouseover_image.src=ratingsL10n.plugin_url

translated to 

ratings_mouseover_image.src=/assenna.com/ratingsL10n.plugin_url

To fix this I changed the TAG_START to only replace works that have a space 
before the word boundary

TAG_START = r"(?i)\b(?P<tag>src|href|action|url|background)(?P<equals>[\t 
]*=[\t ]*)(?P<quote>[\"']?)"

changed to 

TAG_START = 
r"(?i)(?<!\S)\b(?P<tag>src|href|action|url|background)(?P<equals>[\t ]*=[\t 
]*)(?P<quote>[\"']?)"

That didn't help.

What version of the product are you using? On what operating system?
Revision 9 on OSX Lion python 2.5

Please provide any additional information below.

Would be nice to base64 encode urls when serving back content to users. 
This way things are more obfuscated... especially the urls displayed in the
URL bar.

1. Submit the form (405 Method Not Allowed) 
2. URL encryption (please refer to CGIProxy and GO2) 
3. Login and Cookie (please refer to CGIProxy and GO2) 
4. Multi-mirror load (please refer to GO2)

If Your can solve these problems mirrorrr on the "perfect" 

I hope Your do not give up mirrorrr development, thank your 

CGIProxy = http://jmarshall.com/tools/cgiproxy 
GO2 = http://go2.appspot.com

//application: mirrorrr-->//application: anson5803

Basically, flash doesn't load. For example, on YouTube, it says "An error 
occurred. Please try again later". Is there anyway to fix this? Btw - HTML5 
looks lovely!

Also, on the main page if it is unsecure, if you click on the lock it takes you 
to a secure page. Is there a way to change that link? 

What version of the product are you using? On what operating system?
Google AppEngine 1.6.2.1481
Mac OS X Lion 10.7.3
I downloaded the "everything" .rar file from the English instructions. (March 
6, 2012)

What steps will reproduce the problem?
1. Open this page (it's an Ubuntu ISO on The Pirate Bay, mirrored through 
proxybaris.appspot.com, which uses Mirrorrr):
http://proxybaris.appspot.com/thepiratebay.se/torrent/7223166/_Ubuntu_12.04_LTS_
x86
2. Click "Get this torrent"
3. then nothing...

What is the expected output?
My torrent program should open and start the download.

What do you see instead?
Nothing (because the magnet: link is badly formatted/translated)

What version of the product are you using? On what operating system?
Using it through proxybaris.appspot.com

Please provide any additional information below.
A good "magnet" link should start with magnet: instead of all the stuff that's 
in front of that right now.

I have modified this program to enable or disable the recent urls feature.
 This involves adding a global SHOW_RECENT (True/False), defaulting to True
for compatibility reasons.

Additionally, I took the code related to forming the latest_urls variable
and moved it to its own method.

Attached are the modified files.  Please let me know what you think and if
this can be included in the existing codebase.

Right now a single user can compromise the whole system. Need to rate-limit
some users so they don't burn through all the quota.

I believe you intend to remove the "trailer" hop-by-hop header, not "trailers". 
See http://www.w3.org/Protocols/rfc2616/rfc2616-sec14.html#sec14.40 or even 
http://en.wikipedia.org/wiki/List_of_HTTP_header_fields.

Could not guess mimetype for static/favicon.ico.  Using application/octet-
stream
.
Cloning 8 static files.
Cloning 5 application files.
Closing update.
Uploading index definitions.
Error 400: --- begin server output ---
Creating a composite index failed: This index:
entity_type: "EntryPoint"
ancestor: false
Property {
  name: "last_updated"
  direction: 2
}

is not necessary, since single-property indices are built in. Please 
remove it f
rom your index file and upgrade to the latest version of the SDK, if you 
haven't
 already.
--- end server output ---

What steps will reproduce the problem?
1. Set up App with custom domain
2. Select domain and log in only from this domain
3. visit proxy

What is the expected output? What do you see instead?
To see a login page (or the proxy if logged in)

What version of the product are you using? On what operating system?
Latest SVN

Please provide any additional information below.