If a Github Pages repo, is accessed through githack, in many cases a website will render and operate as intended locating all resources through githack instead of Github/Fastly, the user must visually ignore the address bar, but localStorage, ummm, origin will be "rawcdn.githack.com" and localStorage contents can easily be fetched later with a malicious github pages repo to the sensitive github pages repo running on wrong origin. Not sure if there is a real bug since github pages shouldn't have a concept of "logging in", but some GH pages sites do "login" with localStorage. Feel free to close if there is no quick fix.

I've used githack as a quick and dirty different "origin" for a GH Pages site when a CORS API WAF got tired of my no API key anonymous usage and punishes my Origin: header by omitting "Access-Control-Allow-Credentials: true" in response for some minutes to my Origin: header and I burned through the official domain and "http://localhost" already. file:// doesn't work as that makes a browser send "Origin: null" for XHR CORS.

Example URLs:

https://android.googlesource.com/platform/external/linux-tools-perf/+/jb-dev/Documentation/perf-script.txt
https://pdfium.googlesource.com/pdfium.git/+/dab1161c861cc239e48a17e1a5d729aa12785a53/core/fdrm/fx_crypt.cpp
https://chromium.googlesource.com/chromium/src.git/+/c15858db55ed54c230743eaa9678117f21d5517e/third_party/blink/renderer/core/svg/svg_point.cc

I have a web app in which I would like to display source code from these repos. However, googlesource.com (Gitiles) does not have a way to serve raw source with CORS headers. In fact, it does not have a way to serve raw unencoded source code at all! It only supports base64-encoded source code, but without CORS headers:

https://android.googlesource.com/platform/external/linux-tools-perf/+/jb-dev/Documentation/perf-script.txt?format=TEXT

There has been a long-standing feature request in the Gitiles issue tracker about this (original request (filed in 2012), migrated issue) and you can see many people complaining that they have to work around this limitation, but no progress has been made.

If rawgithack supported these repos, this would be an excellent workaround.

I am not sure bypassing gitlabs CORS policy on artifacts is one of the goals of this project but I would find that really handy. It currently works for most artifacts but not when you are trying to use re-directs.

https://glcdn.githack.com/openflexure/openflexure-microscope/-/jobs/artifacts/master/raw/builds/main_body_LS65.stl?job=STLs

re-directs to

https://gitlab.com/openflexure/openflexure-microscope/-/jobs/223115318/artifacts/raw/builds/main_body_LS65.stl

so when I try and use URLs like that that grab the latest artifacts from the master branch I get CORS errors.

My computer wont let me on this site due to "Anonymous Proxies"

BIG ISSUE!!

Was looking around and couldn't find anywhere to donate 😟
How is the community supposed to help out with the server fees!?

Like I said, this is a serious issue. You should add a donate button somewhere.

Hi,

I'm setting rawgithack up for a html page stored on Gitlab, but the url I get from rawgithack.com forwards me to the gitlab sign in page instead of serving the html. My repo is private. Does that ruin things?
https://gl.githack.com/digilabs/GooseChaserRover/raw/Pre-Release_V0.2/wiki/wikipage.html

Hey, neat service!

I was trying to use the following with CORS through rawgithack. https://gitlab.com/openflexure/openflexure-microscope/-/jobs/artifacts/master/raw/builds/main_body_LS65.stl?job=STLs
The form on your site says it will be https://gl.githack.com/openflexure/openflexure-microscope/-/jobs/artifacts/master/raw/builds/main_body_LS65.stl but it's missing the ?job=STLs.

It would be nice to support Bitbucket snippets.

• Example 1 snippet URL
• Example 2 snippet URL

Github serves files stored using git lfs, on media.githubuserconent.com. Please support it on rawgithack

https://repo.or.cz/
https://notabug.org/

Not sure if it's a problem or not but running locally on Ubuntu 16.04 with

docker build -t rawgithack .
docker run -p 80:80 rawgithack

Reports error:

2019/06/01 15:23:41 [error] 1#1: lua_load_resty_core failed to load the resty.core module from https://github.com/openresty/lua-resty-core; ensure you are using an OpenResty release from https://openresty.org/en/download.html (rc: 2, reason: module 'resty.core' not found:
	no field package.preload['resty.core']
	no file '/etc/nginx/rawgithack/resty/core.lua'
	no file '/usr/local/openresty/site/lualib/resty/core.so'
	no file '/usr/local/openresty/lualib/resty/core.so'
	no file './resty/core.so'
	no file '/usr/local/lib/lua/5.1/resty/core.so'
	no file '/usr/local/openresty/luajit/lib/lua/5.1/resty/core.so'
	no file '/usr/local/lib/lua/5.1/loadall.so'
	no file '/usr/local/openresty/site/lualib/resty.so'
	no file '/usr/local/openresty/lualib/resty.so'
	no file './resty.so'
	no file '/usr/local/lib/lua/5.1/resty.so'
	no file '/usr/local/openresty/luajit/lib/lua/5.1/resty.so'
	no file '/usr/local/lib/lua/5.1/loadall.so')
nginx: [error] lua_load_resty_core failed to load the resty.core module from https://github.com/openresty/lua-resty-core; ensure you are using an OpenResty release from https://openresty.org/en/download.html (rc: 2, reason: module 'resty.core' not found:
	no field package.preload['resty.core']
	no file '/etc/nginx/rawgithack/resty/core.lua'
	no file '/usr/local/openresty/site/lualib/resty/core.so'
	no file '/usr/local/openresty/lualib/resty/core.so'
	no file './resty/core.so'
	no file '/usr/local/lib/lua/5.1/resty/core.so'
	no file '/usr/local/openresty/luajit/lib/lua/5.1/resty/core.so'
	no file '/usr/local/lib/lua/5.1/loadall.so'
	no file '/usr/local/openresty/site/lualib/resty.so'
	no file '/usr/local/openresty/lualib/resty.so'
	no file './resty.so'
	no file '/usr/local/lib/lua/5.1/resty.so'
	no file '/usr/local/openresty/luajit/lib/lua/5.1/resty.so'
	no file '/usr/local/lib/lua/5.1/loadall.so')

EDIT: Seems to work ok though? If I add this to /etc/hosts, I can see the rawgit page and can see a GET request logged locally.

127.0.0.1 raw.githack.com

By the way, also tried to add:

127.0.0.1 gl.githack.com

But that doesn't seem enough to test the proxy locally.

The website states that results are cached for "1 year" which is excessive. Cache hits follow a zipf distribution, the general rule-of-thumb for TTL : cache hit rate is (very roughly) 15 minutes : 85%, 1 hour : 95% and 24 hours : 97%. The Cloudflare cache also respects ETags, so you shouldn't need to do a lot of processing.

You have a unique set of customers so YMMV, but it couldn't hurt to experiment. I would drop the browser-side cache to 15 minutes or an hour and just report Cloudflare's standard 2-hour cache.

Hi, I have an image on github here:

https://rawcdn.githack.com/metroroland/blissful-eloquent-1xe3f/f1dda6c3144b2ff51d595ab5a712ebedcf763e83/src/assets/logo.png

From browse, the mime type of the resource is not an image.

Did I encounter a bug or something?

Thanks for developing the tool and devoting your time to help others.

Regards,

Because of "Mixed content" limitations with the browser fetch API / xmlHttpRequest,
scripts that send requests to http:// are not working.. So, should it be enabled?

Hi! I have some private repository in BitBucket, and I tried to rawgithack these following URLs of my repo:

• https://bitbucket.org/dwiyatci/hello-private/raw/master/index.html
• https://bitbucket.org/dwiyatci/hello-private/raw/50c67ea88982b12d5a2ea3ba97b439f3a89ec288/index.html

...and it didn't work. Is githack currently not supporting private repos in BitBucket? If not, will there be any plan to support it in the future?

The CloudFlare API allows you to purge individual files. The CDN would be much more useful if we could purge certain files on demand. The simplest option would be to setup a site that allows people to just submit a URL for purging and rate limit based on IP address.

Would it be possible to add Gitea support?

Thanks for the cool project!

It seems githack.com does not work with git lfs. Here's a test repo (not mine) with an LFS file: https://github.com/Schoonology/git-lfs-test - the file binary.jpg is stored with LFS. If I understand how githack is supposed to work, I should be able to wget that file straight from githack.com:

wget https://raw.githack.com/Schoonology/git-lfs-test/master/binary.jpg

But that just returns the pointer file:

% head binary.jpg
version https://git-lfs.github.com/spec/v1
oid sha256:6fe2e48ef494b7855e6d8f93c59cf38d38350274e304a9ac35102d5c365ee002
size 620773

which is not good.

Downloading straight from github raw works fine:

% wget https://github.com/Schoonology/git-lfs-test/raw/master/binary.jpg
% file binary.jpg.2
binary.jpg.2: JPEG image data, JFIF standard 1.01

but downloading using raw.githubusercontent.com (which may be where githack.com is proxying from?) does not:

% wget https://raw.githubusercontent.com/Schoonology/git-lfs-test/master/binary.jpg 
% file binary.jpg.3
binary.jpg.3: ASCII text

So it would appear that at this point, githack doesn't support LFS. It would be great if it could!

I'm trying to stream audio files, which requires the request to support partial response by specifying the "Range: " header.

Partial request should already be supported by Cloudflare, and it works for Github (rawcdn.githack.com, gistcdn.githack.com). However I found that both Bitbucket (bbcdn.githack.com) and Gitlab (glcdn.githack.com) does not support partial response.

In this case Content-Type doesn't matter, it still works if the content-type is application/octet-stream instead of audio/x-m4a, as long as partial request is supported.

Is that an intentional behaviour or configuration problem?

Test for Github CDN, which returns 206 Partial Content:

curl --header 'Range: bytes=0-10' -v -o /dev/null 'https://gistcdn.githack.com/arcnavier/725bc575222fe8e9931618c2d5b6580f/raw/Lovely%20Day%20-%20Most%20Beautiful%20Anime%20Music%20%281%20Hour%20BGM%29.m4a'

  Trying 104.31.95.240...
* TCP_NODELAY set
* Connected to gistcdn.githack.com (104.31.95.240) port 443 (#0)
...
< HTTP/2 206 
< date: Thu, 19 Apr 2018 13:17:43 GMT
< content-type: application/octet-stream
< content-length: 11
...
< cf-cache-status: HIT
< content-range: bytes 0-10/57847658
< server: cloudflare
< 
{ [11 bytes data]

Test for Gitlab CDN, returns 200 with the entire content

curl --header 'Range: bytes=0-10' -v -o /dev/null 'https://glcdn.githack.com/maomihz/bigmusic/raw/master/2 Hour Beautiful Piano Music - Romantic Love Song 【BGM】.m4a'

  Trying 104.31.94.240...
* TCP_NODELAY set
* Connected to glcdn.githack.com (104.31.94.240) port 443 (#0)
...
< HTTP/2 200 
< date: Thu, 19 Apr 2018 13:17:23 GMT
< content-type: application/octet-stream
< content-length: 114571793
...
< cf-cache-status: HIT
< server: cloudflare
< cf-ray: 40dfa6afbec5586d-DFW
< 
{ [783 bytes data]

Bitbucket, returns 200

curl --header 'Range: bytes=0-10' -v -o /dev/null 'https://bbcdn.githack.com/pypy/pypy/raw/51718fe91a11a641de8dfd2e54a7df4876ceca20/get_externals.py'

  Trying 104.31.94.240...
* TCP_NODELAY set
* Connected to bbcdn.githack.com (104.31.94.240) port 443 (#0)

< HTTP/2 200 
< date: Thu, 19 Apr 2018 13:33:45 GMT
< content-type: text/plain

Thank you for your effort!

It is hardcoded now and injected in request for every, even binary, file

Hey this is an awesome repo! especially now that rawgit.com is going away.

I was trying to run this repo locally:

docker build -t rawgithack .
docker run -p 8080:80 rawgithack &
[1] 70585
docker ps
CONTAINER ID        IMAGE               COMMAND                  CREATED             STATUS              PORTS                  NAMES
7742acb7107c        rawgithack          "nginx -g 'daemon of…"   3 seconds ago       Up 2 seconds        0.0.0.0:8080->80/tcp   gracious_lovelace

Then I see this at localhost:8080:

But how do test it out locally?

Thanks!

As discussed in #39 and #40 Gitlab CI artifacts currently, kind of work, so much that I assumed they were supported. But:

1. Using git ref urls that re-direct to specific job artifacts ends up re-directing to gitlab.com. This is a more general issue and tracked as #41

https://glcdn.githack.com/openflexure/openflexure-microscope/-/jobs/artifacts/master/raw/builds/main_body_LS65.stl?job=STLs

re-directs to

https://gitlab.com/openflexure/openflexure-microscope/-/jobs/223115318/artifacts/raw/builds/main_body_LS65.stl

so when I try and use URLs like that that grab the latest artifacts from the master branch I get CORS errors.

2. Query parameters are not supported by the cache and the frontend utility that tells you what the URLs are but:

https://gl.githack.com/openflexure/openflexure-microscope/-/jobs/artifacts/master/raw/builds/main_body_LS65.stl serves a 404 and https://gl.githack.com/openflexure/openflexure-microscope/-/jobs/artifacts/master/raw/builds/main_body_LS65.stl?job=STLs serves the file :/

This could maybe be a more general issue around supporting query parameters?

Are there any other potential issues with supporting Gitlab CI artifacts that haven't been mentioned yet?

This would be useful for links like https://github.com/harfbuzz/harfbuzz/releases/download/2.1.1/harfbuzz-2.1.1-win32.zip

This is link for raw content:

https://gist.githubusercontent.com/vemv-kantox/eabfe191fdcab95183bd/raw/45a30beec4861b128c20dcdb382d607613da6c0c/afdas.html

If I try replacing 'gist.githubusercontent' for 'raw.githack', I'll get a 404.

Example code:

/* Checkboxes and radios share much of the same code. */
@import './input.shared.css';

input[type='checkbox' i] {
	/* Checkboxes are boxes with rounded corners. */
	--checkable-border-radius: 15%;
}

input[type='checkbox' i]:before {
	border-top: none;
	border-left: none;
	border-radius: 0;
	background: none;
	height: calc(var(--checkable-mark-scale) * 55%);
	width: calc(var(--checkable-mark-scale) * 28%);
}

Output example:

@import './input.shared.css';input[type=checkboxi]{--checkable-border-radius: 15%}input[type=checkboxi]:before{border-top:none;border-left:none;border-radius:0;background:0 0;height:calc(var(--checkable-mark-scale) * 55%);width:calc(var(--checkable-mark-scale) * 28%)}

URL: https://rawcdn.githack.com/lume/basicss/1a2352cf30c07494ede015bb13b6e81bd26c4f9a/src/elements/input/input-checkbox.css

Notice the i values inside the attribute selectors have been squashed onto the attribute values. The CSS no longer works when this happens.

Hello,

Testing out some personal webpage stuff and I'm running into this issue:

• My webpage keeps cycling through all of the previous links to a particular page, and when I try to purge the link via your site, it keeps saying "too many requests".
• Also, it does not appear that the links are being purged (when it allegedly does successfully purge it), as they keep popping back up in the rotation.

Am I doing something wrong? Please let me know what you think.

Is the support for Gitlab complete?

I pasted this random link (as an example) https://gitlab.com/dankremniov/holiday-confession/blob/900c112f5673b247830ec88d829011cfa4a5da62/build/images/backgrounds/1.jpg and the site generates the CDN hosted version as https://glcdn.githack.com/dankremniov/holiday-confession/raw/900c112f5673b247830ec88d829011cfa4a5da62/build/images/backgrounds/1.jpg.

However, that link simply redirects back to gitlab as seen below.

$ curl -I "https://glcdn.githack.com/dankremniov/holiday-confession/raw/900c112f5673b247830ec88d829011cfa4a5da62/build/images/backgrounds/1.jpg"
HTTP/1.1 301 Moved Permanently
Date: Tue, 08 Nov 2016 08:59:12 GMT
Content-Type: text/html
Content-Length: 185
Connection: keep-alive
Set-Cookie: __cfduid=df5855d81064f688ac6fd7077fd2177b01478595552; expires=Wed, 08-Nov-17 08:59:12 GMT; path=/; domain=.githack.com; HttpOnly
Location: https://gitlab.com/dankremniov/holiday-confession/raw/900c112f5673b247830ec88d829011cfa4a5da62/build/images/backgrounds/1.jpg
CF-Cache-Status: MISS
Expires: Wed, 08 Nov 2017 08:59:12 GMT
Cache-Control: public, max-age=31536000
Server: cloudflare-nginx
CF-RAY: 2fe7d3dbbeca31b0-SIN

This URL responds with a redirect loop: https://rawcdn.githack.com/rust-lang/rust/88f19c6dab716c6281af7602e30f413e809c5974/library/std/src/sys/windows/thread.rs

This happened after I initially opened it with an extra slash (note the double slash before library): https://rawcdn.githack.com/rust-lang/rust/88f19c6dab716c6281af7602e30f413e809c5974//library/std/src/sys/windows/thread.rs

It seems that some bad state is cached.

I can reproduce this with arbitrary other URLs, if the initial request to them contains the extra slash. Once the bad state is cached, the URL is "poisoned". For example, I confirmed this with https://rawcdn.githack.com/rust-lang/rust/88f19c6dab716c6281af7602e30f413e809c5974/library/std/src/sys/unix/alloc.rs .

Hi neoascetic,

Do you think it's possible to add a Favicon ?
I made little hack to reuse rawgit.com Favicon to identify you webapp ;)

If use full path to get the image :

<link rel="icon" href="/path/to/favicon.png">

Maybe you want to add your own custom Icon ;)

I take advantage to thank you for your githack.com service.

Best regards,
Nicolas D.

Old url >> https://glcdn.githack.com/xsilent-cleopatra/research-test/raw/master/imgfo/example-json-source-1.6.0.json

Now >> https://glcdn.githack.com/xsilent-cleopatra/research-test/-/raw/master/imgfo/example-json-source-1.6.0.json

How to fixed this? all of my personal website is broken guys.. help me..

Just FYI. Pretty sure. :)

The past couple of days making a request to the homepage results in a 503. For example, using a tool like postman to perform a GET request to https://raw.githack.com/

This breaks tools like awesome-lists that do link liveness validation. Example validation failure.

I. e. fix rgrove/rawgit#44.

Support for Gitlab repos would be nice.

like jsdelivr https://www.jsdelivr.com/rawgit

example

https://gitcdn.xyz/repo/JJ/Test-Text/master/text/en/text.md

First off, thanks for running this...

I'd like to be able to offer 'latest'-tag functionality for accessing a gitlab-hosted JS file. I'm updating my 'latest' tag whenever I update this file. But of course, your CDN will cache that record for a year. Is there a way to send a parameter to CDN that invalidates the rawcdn entry with the new file?

I just found that raw.githack.com for gitlab is down today...

Please check, my url is

https://glcdn.githack.com/imgfo/example/-/raw/master/imgfo/example-api-1.17.1.json

rawgit is being discontinued, I am grateful for this alternative!

Gitlab Repositorys and Groups can be in Groups
https://gitlab.com/nerothe/js/holiday.js/blob/v1.0.0/holiday.js
Where "nerothe" is user and "js" is a subgroup then "holiday.js" is a project
Also a link like:
https://gitlab.com/user/group/subgroup/subsubgroup/.../project/blob/TAG/FILE
could happen.
This seems to be not supported by rawgithack.

Is there anyway to quickly add multiple files to CDN ?

Thanks

NanoAdblocker/NanoCore#220 (comment)

When i enter a script file then i would want something like cdnjs gives you

	<script
		src="https://cdnjs.cloudflare.com/ajax/libs/PapaParse/5.1.0/papaparse.min.js"
		integrity="sha256-Fh801SO9gqegfUdkDxyzXzIUPWzO/Vatqj8uN+5xcL4="
		crossorigin="anonymous"
	></script>

test link https://raw.githubusercontent.com/lewisje/jansal/master/adblock/hostslt