joaohenggeler / web-cache-exporter Goto Github PK

A command line tool that allows you to more easily view and obtain the contents of a web browser or web plugin's HTTP cache that's stored on disk.

License: Apache License 2.0

Batchfile 4.29% C++ 90.88% C 3.01% Java 0.49% Python 0.74% VBScript 0.59%

web-cache http-cache cache wininet internet-explorer mozilla mozilla-firefox flash flash-player flash-plugin

web-cache-exporter's Introduction

Web Cache Exporter

⚠️ This tool is currently being rewritten from scratch. See the progress so far in the overhaul branch. ⚠️

A command line tool that allows you to more easily view and obtain the contents of a web browser or web plugin's HTTP cache that's stored on disk. It runs on Windows 98, ME, 2000, XP, Vista, 7, 8.1, and 10, and supports the following cache formats:

The WinINet cache - Internet Explorer 4 to 11.
The Mozilla cache - Mozilla Firefox, Netscape Navigator 6.1 to 9, etc.
The Flash Player's shared library cache and temporary Flash videos.
The Shockwave Player's cache, including Xtras.
The Java Plugin's cache - Java 1.3 to 8.
The Unity Web Player's cache.

This tool was developed to aid the recovery and preservation of lost web media (games, animations, virtual worlds, etc) whose files might exist in old computers where they were viewed or played when they were still available.

Here's a list of browser games whose assets were found by searching the web cache.

Features

Runs natively on Windows 98, ME, 2000, XP, Vista, 7, 8.1, and 10.
Copies each cached file using their original website's directory structure.
Creates CSV files that list every cached file along with additional information (URL, HTTP headers, SHA-256 hash, etc).
Finds the default and user-defined cache locations of various web browsers.
Supports labelling cached files based on their file signatures, MIME types, file extensions, and URLs. Files can be grouped and filtered by their format or domain.
Supports exporting the cache from external locations (e.g. from the contents of an old computer that won't boot up anymore).
Decompresses cached files based on the Content Encoding in the HTTP headers. Supported formats: Gzip, Zlib, Raw DEFLATE, Brotli, Compress.

Screenshots

Command Line Arguments

See the help file to learn how to use this application.

Group Files

See the "About Groups" help file to learn how the tool labels cached files based on their file signatures, MIME types, file extensions, and URLs. For example, here's the Plugin group file that matches files used by various web plugins (Flash, Shockwave, Java, etc).

External Locations

See the "About External Locations" help file to learn how the tool can export the cache from the contents of an old computer that won't boot up anymore.

Building

See the building instructions to learn how to compile this application.

Tools And Resources

This section lists some useful tools and resources that were used throughout this application's development. This includes learning how to process certain cache formats, validating the application's output, extracting assets from plugin-specific file formats, and other general purpose tools.

Internet Explorer

Mozilla Firefox And Friends

firefox-cache-forensics - FfFormat.wiki.
dtformats - Firefox cache file format.
The Mozilla Firefox repository - first and second version of the Mozilla cache format.
NirSoft - MZCacheView - View the cache files of Firefox Web browsers.

Flash Player

NirSoft's FlashCookiesView can be used to view Flash cookies (.SOL files) where a game might save its progress or cache assets.
NirSoft's VideoCacheView can be used to recover Flash videos (.FLV files) from the web cache.

Shockwave Player

TOMYSSHADOW's Movie Restorer Xtra allows you to open Shockwave movies in Director. This is useful when trying to find out the name of a Shockwave game (e.g. by looking at the game's menu screen) since the plugin's cache does not store the original filename or URL.
Valentin's Unpack tool allows you to extract Xtras from Xtra-Packages (.W32 files). This is useful for finding out which Xtras were stored in the plugin's cache.

Unity Web Player

uTinyRipper and DerPopo's Unity Assets Bundle Extractor can be used to extract assets from the cached AssetBundle files.

Other

Geoff Chappell's software analysis website was also used to check the minimum supported Windows version for some functions in the Windows API.
NirSoft's CSVFileView is a useful lightweight tool for viewing the resulting CSV files.
See also NirSoft's browser tools, including ChromeCacheView, OperaCacheView, and SafariCacheView.

Special Thanks

Special thanks to Computerdude77 for his general assistance and for helping me test this tool in older Windows versions.
Special thanks to TOMYSSHADOW for his extensive Director and Shockwave knowledge.

web-cache-exporter's People

Contributors

Stargazers

Watchers

Forkers

follow-the-vine-to-get-to-the-melon

web-cache-exporter's Issues

Load Group Files: Found 1 tokens while looking for a new group when two were expected.

[INFO] Startup: Running the Web Cache Exporter version 1.1.4 compiled with Visual Studio 1400 in release mode for NT-x64.
[INFO] Startup: Using Windows version 6.2 '' build 9200 in platform 2.
[INFO] Startup: Using Internet Explorer version 11.1.22621.0.
[INFO] Startup: The current Windows ANSI code page is '1252  (ANSI - Latin I)' (1252).
[INFO] Startup: Allocating 16777216 bytes for the temporary memory arena.
[INFO] Startup: Parsing command line arguments.
[INFO] Startup: Allocating 68886 bytes for the permanent memory arena.
[INFO] Startup: Loading 255 groups.
[INFO] Load Group File: Loading the group file '001-Text.group'.
[ERROR] Load Group Files: Found 1 tokens while looking for a new group when two were expected.
[INFO] Load Group File: Loading the group file '002-Image.group'.
[ERROR] Load Group Files: Found 1 tokens while looking for a new group when two were expected.
[INFO] Load Group File: Loading the group file '003-Audio.group'.
[ERROR] Load Group Files: Found 1 tokens while looking for a new group when two were expected.
[INFO] Load Group File: Loading the group file '004-Video.group'.
[ERROR] Load Group Files: Found 1 tokens while looking for a new group when two were expected.
[INFO] Load Group File: Loading the group file '005-Font.group'.
[ERROR] Load Group Files: Found 1 tokens while looking for a new group when two were expected.
[INFO] Load Group File: Loading the group file '006-Plugin.group'.
[ERROR] Load Group Files: Found 1 tokens while looking for a new group when two were expected.
[INFO] Load Group File: Loading the group file '007-Model.group'.
[ERROR] Load Group Files: Found 1 tokens while looking for a new group when two were expected.
[INFO] Load Group File: Loading the group file '008-Archive.group'.
[ERROR] Load Group Files: Found 1 tokens while looking for a new group when two were expected.
[INFO] Load Group File: Loading the group file '009-Binary.group'.
[ERROR] Load Group Files: Found 1 tokens while looking for a new group when two were expected.
[INFO] Load Group File: Loading the group file '100-Lost-Media-Websites.group'.
[INFO] Load Group File: Loading the group file '101-Gaming-Websites.group'.
[INFO] Load Group File: Loading the group file '102-Multiplayer-Gaming-Websites.group'.
[ERROR] Load Group Files: Found 1 tokens while looking for a new group when two were expected.
[INFO] Load Group File: Loading the group file '103-Other-Websites.group'.
[INFO] Load All Group Files: Allocating 40 bytes for the file signature buffer.
[INFO] Startup: The permanent memory arena is at 81.36% used capacity before being locked.
[INFO] Clear Temporary Windows Directory: Deleting 0 temporary exporter directories with the prefix 'WCE' located in 'C:\Users\wiene\AppData\Local\Temp\'.
[INFO] Startup: Created the temporary exporter directory in 'C:\Users\wiene\AppData\Local\Temp\WCE1E42.tmp'.
[INFO] Startup: The temporary memory arena is at 0.04% used capacity before exporting files.

------------------------------------------------------------
[INFO] Exporter Options:
------------------------------------------------------------
- Cache Type: Unity Web Player
- Should Copy Files: Yes
- Should Create CSV: Yes
- Should Overwrite Previous Output: No
- Should Show Full Paths: No
- Should Group By Request Origin: No
- Should Decompress Files: Yes
- Should Clear Temporary Windows Directory: Yes
------------------------------------------------------------
- Should Filter By Groups: No
- Number Of Group Files Enabled For Filtering: -1
------------------------------------------------------------
- Should Use Internet Explorer's Hint: No
- Internet Explorer Hint Path: ''
------------------------------------------------------------
- Should Load External Locations: No
- External Locations Path: ''
------------------------------------------------------------
- Cache Path: '2D74'
- Output Path: 'ExportedCache'
- Is Exporting From Default Locations: No

------------------------------------------------------------
[INFO] Current Locations:
------------------------------------------------------------
- Executable Path: 'C:\Users\wiene\Downloads\web-cache-exporter-x86-1.1.4-release'
- Exporter Temporary Path: 'C:\Users\wiene\AppData\Local\Temp\WCE1E42.tmp'
- Was Temporary Directory Created: Yes
------------------------------------------------------------
- Drive Path: 'C:\'
- Windows Directory Path: 'C:\WINDOWS'
- Windows Temporary Path: 'C:\Users\wiene\AppData\Local\Temp\'
- User Profile Path: 'C:\Users\wiene'
- Roaming AppData Path: 'C:\Users\wiene\AppData\Roaming'
- Local AppData Path: 'C:\Users\wiene\AppData\Local'
- LocalLow AppData Path: 'C:\Users\wiene\AppData\LocalLow'
- WinINet Cache Path: 'C:\Users\wiene\AppData\Local\Microsoft\Windows\INetCache'

[INFO] Unity Web Player: Exporting the cache from 'C:\Users\wiene\Downloads\web-cache-exporter-x86-1.1.4-release\2D74'.
[INFO] Unity Web Player: Finished exporting the cache.
[INFO] Terminate Cache Exporter: Deleting the CSV file 'C:\Users\wiene\Downloads\web-cache-exporter-x86-1.1.4-release\ExportedCache\UN.csv' since no files were exported for the Unity Web Player cache.

[INFO] Finished Running: Created 1 CSV files. Processed 0 cache entries. Copied 0 cached files. Assign

Question

Does the web cache exporter export levels for flash games includes data needed or just the swf