docs and README: add wacz format doc, tweak links, tweak README
This commit is contained in:
+1
-1
@@ -8,7 +8,7 @@ GEM
|
|||||||
eventmachine (>= 0.12.9)
|
eventmachine (>= 0.12.9)
|
||||||
http_parser.rb (~> 0.6.0)
|
http_parser.rb (~> 0.6.0)
|
||||||
eventmachine (1.2.7)
|
eventmachine (1.2.7)
|
||||||
ffi (1.13.0)
|
ffi (1.13.1)
|
||||||
forwardable-extended (2.6.0)
|
forwardable-extended (2.6.0)
|
||||||
http_parser.rb (0.6.0)
|
http_parser.rb (0.6.0)
|
||||||
i18n (0.9.5)
|
i18n (0.9.5)
|
||||||
|
|||||||
@@ -5,14 +5,18 @@
|
|||||||
## Serverless Web Archive Replay
|
## Serverless Web Archive Replay
|
||||||
|
|
||||||
ReplayWeb.page provides a full web archive replay system running directly in the browser,
|
ReplayWeb.page provides a full web archive replay system running directly in the browser,
|
||||||
available at: https://replayweb.page/
|
available at: [https://replayweb.page/](https://replayweb.page)
|
||||||
|
|
||||||
For full user docs, see: https://replayweb.page/docs
|
For full user docs, see: [https://replayweb.page/docs](https://replayweb.page/docs)
|
||||||
|
|
||||||
The ReplayWeb.page App can be downloaded from: https://replayweb.page/releases
|
The ReplayWeb.page App can be downloaded from the [Releases](https://replayweb.page/releases) page.
|
||||||
|
|
||||||
|
### Embedding Guide
|
||||||
|
|
||||||
|
See the [Embedding Guide](https://replayweb.page/docs/embedding) for more info on embedding web archives in other sites.
|
||||||
|
|
||||||
|
|
||||||
## Architecture / What's in this repo
|
## What's in this repo
|
||||||
|
|
||||||
ReplayWeb.page is a static web site / offline web app + Electron app.
|
ReplayWeb.page is a static web site / offline web app + Electron app.
|
||||||
|
|
||||||
@@ -59,12 +63,12 @@ For service workers to work, they must be served from either localhost or an HTT
|
|||||||
|
|
||||||
See the [user docs](https://replayweb.page/docs/) for additional info about using ReplayWeb.page
|
See the [user docs](https://replayweb.page/docs/) for additional info about using ReplayWeb.page
|
||||||
|
|
||||||
|
|
||||||
|
|
||||||
## LICENSE
|
## LICENSE
|
||||||
|
|
||||||
ReplayWeb.page is made available under the AGPLv3 License.
|
ReplayWeb.page is made available under the AGPLv3 License.
|
||||||
|
|
||||||
[Embedding ReplayWeb.page](https://replayweb.page/docs/embedding) from published releases is encouraged.
|
|
||||||
|
|
||||||
If you would like to use it under a different license or have a question, please reach out as that may be a possibility.
|
If you would like to use it under a different license or have a question, please reach out as that may be a possibility.
|
||||||
|
|
||||||
|
|
||||||
|
|||||||
+2
-2
@@ -24,12 +24,12 @@ The archive view presents several tabs:
|
|||||||
- **Story** - This Story view presents lists of curated pages, as developed by the creator of the web archive.
|
- **Story** - This Story view presents lists of curated pages, as developed by the creator of the web archive.
|
||||||
This option is only shown if there is a curated story. As curated lists are not a standard part of WARC, only WARCs exported from Webrecorder.io/Conifer can have this option.
|
This option is only shown if there is a curated story. As curated lists are not a standard part of WARC, only WARCs exported from Webrecorder.io/Conifer can have this option.
|
||||||
|
|
||||||
The new [Web Archive Collection (WACZ)](web-archive-collection-format) can also include curated lists.
|
The new [Web Archive Collection (WACZ)](wacz-format) can also include curated lists.
|
||||||
|
|
||||||
- **Pages** - The Pages view presents all pages in the web archive. As pages are not a standard part of WARC format,
|
- **Pages** - The Pages view presents all pages in the web archive. As pages are not a standard part of WARC format,
|
||||||
generally only WARCs from Webrecorder.io/Conifer will have pages.
|
generally only WARCs from Webrecorder.io/Conifer will have pages.
|
||||||
|
|
||||||
The new [Web Archive Collection (WACZ)](web-archive-collection-format) can also store pages.
|
The new [Web Archive Collection (WACZ)](wacz-format) can also store pages.
|
||||||
|
|
||||||
|
|
||||||
- **Page Resources** - This view allows searching the archive by URLs, as well as by common MIME type.
|
- **Page Resources** - This view allows searching the archive by URLs, as well as by common MIME type.
|
||||||
|
|||||||
+1
-1
@@ -12,7 +12,7 @@ parent: Reference
|
|||||||
ReplayWeb.Page supports the archive formats listed below.
|
ReplayWeb.Page supports the archive formats listed below.
|
||||||
Format is currently determined based on the file extension.
|
Format is currently determined based on the file extension.
|
||||||
|
|
||||||
The `.wacz` refers to the newly proposed [Web Archive Collection Zip Format](web-archive-collection).
|
The `.wacz` refers to the newly proposed [Web Archive Collection Zip Format](wacz-format).
|
||||||
|
|
||||||
|
|
||||||
| Format | Extensions | Status |
|
| Format | Extensions | Status |
|
||||||
|
|||||||
+2
-2
@@ -44,7 +44,7 @@ To load a remote archive, simply enter the URL of the archive and click `Load`.
|
|||||||
{: .fs-3 .pad .bg-grey-lt-100}
|
{: .fs-3 .pad .bg-grey-lt-100}
|
||||||
See [Supported Locations](locations) for details on where archives can be loaded from.
|
See [Supported Locations](locations) for details on where archives can be loaded from.
|
||||||
|
|
||||||
The archive will be downloaded, either fully or [only as needed (if possible)](streaming-archives.md) and presented on the archive page.
|
The archive will be downloaded, either fully or on-demand (if possible) and presented on the archive page.
|
||||||
|
|
||||||
The system supports WARC files, as well as several other formats
|
The system supports WARC files, as well as several other formats
|
||||||
|
|
||||||
@@ -74,7 +74,7 @@ Due to the nature of the WARC format, the entire file must be read on first use
|
|||||||
For WARC files **>25MB**, only the index is initially stored in the browser, and the actual content is loaded 'on-demand',
|
For WARC files **>25MB**, only the index is initially stored in the browser, and the actual content is loaded 'on-demand',
|
||||||
when the content is first accessed. This leads to faster loading and saves memory when dealing with large archives.
|
when the content is first accessed. This leads to faster loading and saves memory when dealing with large archives.
|
||||||
|
|
||||||
[Web Archive Collection (WACZ)](web-archive-collection-format) are always loaded on-demand, as no indexing is required.
|
[Web Archive Collection (WACZ)](wacz-format) are always loaded on-demand, as no indexing is required.
|
||||||
The initial archive view should load almost instantly as a result.
|
The initial archive view should load almost instantly as a result.
|
||||||
|
|
||||||
If an archive could not be loaded, an error will be displayed instead of the progress.
|
If an archive could not be loaded, an error will be displayed instead of the progress.
|
||||||
|
|||||||
@@ -0,0 +1,26 @@
|
|||||||
|
---
|
||||||
|
layout: default
|
||||||
|
title: 'Web Archive Collection Zipped (WACZ) Format'
|
||||||
|
nav_order: 1
|
||||||
|
permalink: /docs/wacz-format
|
||||||
|
parent: Reference
|
||||||
|
---
|
||||||
|
|
||||||
|
## Web Archive Collection Format Specification
|
||||||
|
|
||||||
|
ReplayWeb.page supports a new format for bundling raw web archive data (usually WARC files), indices,
|
||||||
|
page lists and other metadata into a single ZIP file.
|
||||||
|
|
||||||
|
The full spec for this format is available at: [https://github.com/webrecorder/web-archive-collection-format/blob/master/README.md](https://github.com/webrecorder/web-archive-collection-format/blob/master/README.md)
|
||||||
|
|
||||||
|
Files bundled into this format can use the .wacz (web archive collection zipped) file extension.
|
||||||
|
|
||||||
|
ReplayWeb.page will recognize this extension (as well as regular .zip) and will also load it from Google Drive when the
|
||||||
|
[Google Drive Integration](https://gsuite.google.com/u/2/marketplace/app/replaywebpage/160798412227) is installed.
|
||||||
|
|
||||||
|
The key benefit of this format is that large web archive collections can be loaded very quickly, to show the page list
|
||||||
|
and other key metadata, by downloading only parts of the WACZ file, as [outlined here](https://github.com/webrecorder/web-archive-collection-format/blob/master/README.md#appendix-a-use-case-random-access-to-web-archives-in-zip)
|
||||||
|
|
||||||
|
The actual raw content is loaded on-demand when the user requests each page.
|
||||||
|
|
||||||
|
With a WARC file, the entire contents must be loaded or indexed to determine the contents of the web archive collection.
|
||||||
Reference in New Issue
Block a user