Commit Graph
206 Commits
Author SHA1 Message Date
Ilya Kreymer b26f4b082d Compute unique collection id using full sourceUrl if relative url given (#179)
* loading: update sourceToId to resolve any pathname to absolute URL (via document.baseURI) for computing unique id (eg. to avoid conflicts of two 'webarchive.wacz' loaded from different paths) - matches behavior used in embed
embed demo: fix typo, don't change default service worker name
2023-06-15 09:45:01 -07:00
Ilya Kreymer 3fb9e82c1c Deps Update for 1.8.0 (#178)
* update to wabac.js 2.16.1, electron 25.1.1, ruffle 2023-06-14
2023-06-14 17:28:48 -07:00
Ilya Kreymer 21ddc5b713 Show All Pages Option (#177)
* show all pages:
- add option to 'show all pages' if additional non-seed pages are present in the wacz file
- only show checkbox if there are additional pages
- tweak page results to just show 'Pages' or 'Pages Shown' to avoid confusion over 'Pages Found'
- bump to 1.8.0

fixes #176

CHANGES: add changes for 1.8.0
2023-06-14 17:17:20 -07:00
Ilya Kreymer a1c0a9bb57 deps: bump wabac.js to 2.16.0
update README
2023-05-30 19:50:21 -07:00
Ilya Kreymer c7adbdeb0c file chooser: relax extension pattern to allow query/hash after extension (check for ?/#) (#171)
bump to 1.7.15
2023-05-12 13:52:33 +02:00
Ilya Kreymer e9d5ca7f21 CHANGES: update changelist
deps: bump to wabac.js 2.15.5
2023-04-06 10:43:56 -07:00
Ilya Kreymer 913a28b594 wabac.js + wombat version bump (#166)
- Fidelity: Support dynamic 'import()' in non-module JS (via wabac.js 2.15.4)
- Fidelity: Fix dynamic iframes that fall through via document.write / srcdoc by rewriting to blob:<content> (via wombat 3.5.0, wabac.js 2.15.4)
- Dependencies: Update to wabac.js 2.15.4, wombat 3.5.0
2023-03-31 18:15:42 -07:00
Ilya Kreymer 05287749ca fidelity / loading fixes: (#159)
- Fidelity: Improved replay via unrewriting fixes of style urls, request/response urls (via wabac.js 2.15.3)
- Embeds: Support updating auth headers if custom headers provided in embed 'config'
- Dependencies: Update to wabac.js 2.15.3, wombat 3.4.6, Electron 23.1.1
- bump to 1.7.13
2023-02-25 16:38:10 -08:00
Ilya Kreymer 8b2a5c6076 fidelity: improved fb/instagram replay (via wabac.js 2.15.1)
loading: fix incorrect loading of some WACZ files (incorrect SURT detection, fixed in wabac 2.15.2)
deps: update to wabac.js 2.15.2
bump to 1.7.12
2023-02-02 17:55:30 -08:00
Ilya Kreymer 0c737101c2 loading + fidelity fix:
- loading: Support loading URLs without extension (including blob: urls), automated type detection of WACZ, WARC, compressed and uncompressed (via wabac.js)
 - fidelity: Improved handling of ESM modules, cookies, Vimeo videos (via wabac.js)
 - dependencies: Update to wabac.js 2.15.0, wombat 3.4.3
bump to 1.7.11
2023-01-15 11:17:06 -08:00
Ed Summers c0ff3b426b Use crt.sh (#144)
Switch back to using crt.sh for certificate lookups since censys now
require a login to search by cert fingerprint.
bump to 1.7.10
2023-01-04 10:12:18 -08:00
Ilya Kreymer 7d0866aa23 deps: update to wabac.js 2.14.0 (#143)
deps: also includes update to wombat 3.4.2, warcio 2.0.1
ci: fix yarn flags, add --ignore-engines to electron build
build: update banner copyright text to use current year
fidelity fixes:  including better location and ESM module rewriting (via wabac.js and wombat)
reduce size of sw.js by ~40k
bump to 1.7.9
2022-12-17 10:39:19 -08:00
Ilya Kreymer e6f837df13 Cleanup Electron App + Dependency Update (#139)
* electron: clean-up / remove unused code in main process, including:
- remove native plugin init (no longer supported)
- remove auto-js-ipfs (used in render process)
- remove ipfs handling logic (handled in render process)
- use custom file2:// scheme for loading files, instead of custom prefix
- proxyLive supports POST requests, using original UA (if set, for archiveweb.page)
- webpack: remove unused __IPFS_CORE_URL__
- ci: add lint check

* dependency update:
- update to wabac.js 2.13.15 for latest auto-js-ipfs (2.1.0) and wombat (3.3.13)
- update to electron 22.0
- update webpack + electron updater to latest

* bump to 1.7.8
2022-12-07 13:33:36 -08:00
Ilya Kreymer 591753d6d8 loading: remove cacehing ruffle.js to avoid old versions being cached
deps: wabac.js 2.13.14
2022-12-02 14:14:03 -08:00
Ilya Kreymer e4e6f07618 loading fixes:
- fix for ignoring partial videos (partial 206s)
- fix for error on first load (waiting to load check injected scripts)
update to wabac.js 2.13.13
bump to 1.7.7
2022-12-02 13:41:26 -08:00
Ilya Kreymer 9dc7d8d8c1 deps: update to wabac.js 2.13.12 to update wombat, fixing occasional window.open regression (fixed in wombat 3.3.12) 2022-11-25 10:57:35 -08:00
Ilya Kreymer 6b14849d60 regression fix for flash: fix ruffle.js not loading (reported via webrecorder/archiveweb.page#121) via wabac.js
opt: check if ruffle.js exists before injecting into page (via wabac.js)
deps: update wabac.js 2.13.11, update ruffle to 2022-11-25 version
bump to 1.7.6
2022-11-25 10:03:03 -08:00
Ilya Kreymer 3d1d4bcceb build: readd /assets dir to npm package, need for archiveweb.page
bump to 1.7.5
2022-11-25 10:03:02 -08:00
Ilya Kreymer 99d2fe492a deps: update to wabac.js 2.13.10 2022-11-24 20:33:15 -08:00
Ilya Kreymer bc5f8b07eb embeds: new embed option 'loading="eager"' to support eager loading entire WACZ file, instead of on-demand loading
deps: update to wabac 2.13.9 to support eager loading, update electron to 21.3.1
package: remove assets from package
bump to 1.7.4
2022-11-24 17:28:53 -08:00
Ilya Kreymer 26b54cb7bf loading: fix issues with multiple embeds on same page + force reload issues (via wabac.js 2.13.8) 2022-11-21 19:11:30 -08:00
Ilya Kreymer 54b53f9d9b dependencies: update to wabac.js 2.13.7, latest wombat (3.3.11), auto-js-ipfs 1.5.1
update CHANGES.md
2022-11-21 17:33:27 -08:00
Ilya Kreymer 5c7dc64e0b update to wabac.js 2.13.6 for misc fidelity improvements / bug fixes via wabac.js 2.13.6 + wombat 3.3.10
bump to 1.7.3
2022-11-12 14:42:23 -08:00
Ilya Kreymer 8bfd93837d dependencies: update to wombat 2.13.4
fidelity: fix replay of tiktok via webrecorder/wabac.js#85
bump to 1.7.2
2022-10-19 11:42:50 -07:00
Ilya Kreymer e006028bab electron app: fix app not loading preload.js, regression in 1.7.0
fidelity: Fixed embedded tweet video issue (via wabac.js)
fidelity: include target="new" in target rewriting (possibly fix for #118)
deps: bump to wabac.js 2.13.3
bump to 1.7.1
2022-10-09 23:55:49 -04:00
Ilya Kreymer 415d344027 dependency update: bump to wabac.js 2.13.2, electron 20.x
bump to 1.7.0 for release
2022-10-04 16:55:10 -07:00
RangerMauveandIlya Kreymer f1df02ea3c remove js-ipfs in electron app, eslint to dev deps (#123)
- add ipfs:// protocol handlers, not enabled for now
- use browser-side auto-js-ipfs for loading from ipfs even in electron app
- deps: bump wabac.js to 2.13.0
- update CHANGES

Co-authored-by: Ilya Kreymer <ikreymer@gmail.com>
2022-10-04 15:54:43 -07:00
Ilya Kreymer 43122425e5 Restrict new windows in replay + improved service worker loading + better error messages (#126)
* embeds:
- support target rewriting with named iframe as per webrecorder/wombat#94
- refactor sw init: detect additional errors, such as CORS issues in nested iframes
- support cross-origin replaybase for embeds
- add 'requirecrossoriginiframe' to restrict embed to only be loaded in subdomain iframes, otherwise showing
- rename noSandbox -> sandbox, not enabled by default

init: set appName on service worker init
docs:
- add example embed to embedding doc
- update docs for noSandbox -> sandbox
- add warning if deprecated 'noSandbox' flag is used, explaining that it is now deprecated
- update embedding and CHANGES.md with latest features
- add tweet-example.wacz
- add embed.html to test embeds

bump to 1.7.0-beta.1
2022-10-03 20:04:35 -07:00
Ilya Kreymer 27a8524aac Archive verification info + Embed improvements + Embed Receipts UI (#125)
info panel verification/integrity additions, (fixes on #113)
- info panel: display number of hashes verified valid (and invalid), observer domain (if any), and certificate fingerprint, creation software, and package digest
- info: ensure replayTS is updated, not just replayUrl, to ensure correct stats

404 page: improved formatting on 404 page (via wabac.js)

embeds:
- new embed 'replay-with-info mode, displays replay-only with dropdown showing archival 'receipt, which includes condensed info and verification (hashes valid/invalid, observer domain, cert fingerprint)
- support 'newWindowBase' attribute for specifying base replay URL for opening new window. default: use current url if deepLink enabled, otherwise use https://replayweb.page/
use transparent for embeds
- embed dropdown/receipt styling from @Shrinks99 
- automatically setting noCache and noWebWorker for older browsers (eg. safari < 16)
- add 'hideOffscreen' attribute to enable unloading embed when offscreen

dependencies: update to wabac.js 2.13.0-beta.0

bump version to 1.7.0-beta.0

Embed receipt styling co-authored-by: @Shrinks99
2022-10-01 18:22:30 -07:00
Ilya Kreymer 7e8650519e fidelity: various replay improvements (fix module script rewriting, twitter embedded video rewriting fidelity, ignore invalid link headers)
dependencies: update to wabac.js 2.12.5
bump to 1.6.5
2022-09-01 18:37:30 -07:00
Matteo Cargnelutti 064f6db55e Upgrade to the latest version of webpack (#116) 2022-09-01 18:31:45 -07:00
Ilya Kreymer 8a698bef41 loading: don't ignore hashtag, eg. '#.wacz' to specify file type for source when loading (via wabac.js)
dependencies: bump wabac.js to 2.12.4
bump to 1.6.5
2022-08-24 10:33:43 -07:00
Ilya Kreymer 6c6d66f03a loading: add 'noCache' option for <replay-web-page> embeds, ensure option is passed to wabac.js loader
dependencies: update to wabac.js 2.12.3 to fully support noCache for WARCs
bump to 1.6.4
2022-08-06 17:56:16 -07:00
Ilya Kreymer 2a0aba02bb dependency: update to wabac.js 2.12.2 (includes fixes for replaying revisit records + incorrect js module detection)
bump to 1.6.3
2022-08-04 21:34:48 -07:00
Ilya Kreymer 1bf83416d3 dependencies: update wabac.js to 2.12.1 for ipfs loading fix 2022-07-15 13:41:01 +00:00
Ilya Kreymer f1c5e931c8 extensability: make purge cache configurable
ui: fix date padding for month-day
package: add index.html to npm package
bump to 1.6.2, update CHANGES.md
2022-07-05 12:24:50 -07:00
Ilya Kreymer 54fd92c273 error fix + embedding extensability (#110)
* embed mode: make embedding options more extensible
ui: unify service worker not available errors, show same error in standard/embed mode, including when loaded over http
- more customizations for extended embed, allow hiding 'browse contents' button
- simplify title updates
- make error page / icon more customizable
- autoupdating in editable mode: don't update if previous one didn't finish, make customizable, don't autoupdate at all over >=100 pages

* dependencies: update ruffle to 2022-07-02

* bump to 1.6.1, update CHANGELIST
2022-07-05 10:48:32 -07:00
Ilya Kreymer 0619d28b02 electron build: fix osx build by adding 'singleArchFiles' entry 2022-06-15 12:30:49 -07:00
Ilya Kreymer 7ff5b49011 dependencies: update to wabac.js 1.12.0 (improved eval() and twitter video fidelity)
electron: update to 19.0.4, update electron-builder
CHANGES: update for 1.6.0
bump to 1.6.0
2022-06-15 12:04:26 -07:00
Ilya Kreymer 36da7fa2c6 Add a 'noWebWorker=true' option to <replay-web-page> embed to disable loading in separate web worker (#102)
* add a 'noWebWorker' option to <replay-web-page> embed to disable the default webworker-based loading, and load via the service worker directly. this feature was previously available, but turned-off, as its less efficient (uses sw for what can be done in a separate web worker thread). however, service-worker based loading may be needed for certain edge cases (see #97), and this option enables this loading method to be turned back on for embedding.
* docs: update guide to include 'noWebWorker', also use include attribute for boolean attributes
* update CHANGES.md
* bump to 1.5.12
2022-06-15 11:38:04 -07:00
Ilya Kreymer 789e5ba2b1 dependabot batch (#104)
Bumps [addressable](https://github.com/sporkmonger/addressable) from 2.7.0 to 2.8.0.
Bumps [path-parse](https://github.com/jbgutierrez/path-parse) from 1.0.6 to 1.0.7.
Bumps [marked](https://github.com/markedjs/marked) from 3.0.3 to 4.0.10.
Bumps [node-fetch](https://github.com/node-fetch/node-fetch) from 2.6.2 to 2.6.7.
Bumps [engine.io](https://github.com/socketio/engine.io) from 5.2.0 to 5.2.1.
Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.14.3 to 1.14.8.
Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6.
Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.25 to 3.3.1.
Bumps [protobufjs](https://github.com/protobufjs/protobuf.js) from 6.11.2 to 6.11.3.
2022-06-15 11:36:29 -07:00
Ilya Kreymer d3892abdbe dependency: update to wabac 2.11.1 - fix loading for very large wacz files containing warcs by loading an extra block on load if needed 2022-03-25 10:09:29 -07:00
Ilya Kreymer 44182c66d8 dependency: update to wabac 2.11.0
loading: various loading improvements, support for per-host live proxy config, fix url-prefix api errors (via wabac.js)
bump to 1.5.11
2022-03-24 22:28:35 -07:00
Ilya Kreymer 8a1e2a5ac4 replay fidelity: encoding fix for non-ascii links, optimizations for utf-8 parsing (via wabac.js 2.10.3)
dependencies: update to wabac.js 2.10.3
bump to 1.5.10
2022-03-07 17:45:13 -08:00
Ilya Kreymer 221aabaaf7 dependencies: update to wabac.js 2.10.2
loading: for experimental multi-wacz input, disable periodic reload for now
bump to 2.5.9
2022-02-01 18:18:03 -08:00
Ilya Kreymer 213079ce11 dependency: update to wabac.js 2.10.1
bump version to 1.5.8
2022-02-01 16:59:10 -08:00
Ilya Kreymer b55594861d subpath hosting: fix top-frame redirect in new tab (via wabac.js 2.10.1), fixes #82
loading: fix multi-wacz support (was disabled in wabac.js, fixed in 2.10.1)
bump to 2.5.8
2022-01-31 14:19:31 -08:00
Ilya Kreymer 114d5fe1c9 gh action: update action version
dependency: update lit to latest
dependency: rollback ipfs-core update, as electron-builder does not yet support node>=15
2022-01-09 10:17:52 -08:00
Ilya Kreymer 91ef718b08 dependency update release: update to wabac.js 2.10.0, wombat 3.3.6, electron 16.0.6, ruffle (2022-01-08)
bump to 1.5.7
2022-01-08 23:33:33 -08:00
Ilya Kreymer 178d0507eb * large WARC loading optimizations (attempted to fix #67)
- use dedicated web worker for loading, remove when done
- update to warcio 1.5.0 for faster loading of large WARCs
- show WARC records loading for better progress update

* fidelity: fix potentially invalid location redirect via wombat 3.3.5 (see: webrecorder/pywb#684)

* dependencies: wabac.js 2.10.0-beta.0 (includes warcio 1.5.0, wombat 3.3.5)

* bump to 1.5.6, update CHANGES
2021-11-27 17:06:37 -08:00