Skip to content

SolrWayback API

Jump to bottom Edit New page
Thomas Egense edited this page May 5, 2026 · 147 revisions

SolrWayback API with examples

Overview

This documentation covers the REST API endpoints provided by the SolrWaybackResource and SolrWaybackResourceWeb classes in the dk.kb.netarchivesuite.solrwayback.service package. The classes serves as a JAX-RS resource for interacting with archived web content, search results, exports, and related functionalities in the SolrWayback system.

SolrWayback has two different webservice endpoints. (here with default local Tomcat port 8080 installation)

The /services endpoint the primary backend for playback,export data etc.

The /services/frontend has most of the methods used by the VUE frontend for searching and tools used in the GUI.

Methods under each endpoints will be listed in the two tables below. Clicking the method will jump to a detailed description with examples for that method.

Service methods for /services

Method Description Payload
/warc/header/ Load the WARC-header and HTTP header for a record text
/web/{path:.+} Playback Playback
/lenient/web/{path:.+} Lenient playback (fuzzy match) Playback
/statistics/domain Various collection statistics for a domain JSON
/image Load image from warc file and scale (for thumbnail etc.) PNG
/downloadRaw Returns the binary payload Original MIME type
/export/linkgraph Export linkgraph for query CSV (Gephi format)
/export/warc Export all records from a query to warc-file warc/warc.gz
/export/warcExpanded Export all records from a query to warc-file include HTML page resources warc/warc.gz
/image/pagepreview Generate a screenshot for a webpage PNG
/export/fields Export fields from a query to CVS file CSV/CVS.gz
/export/zip Export records from a query to a ZIP archive file. ZIP multifile
/getContentType Get content encoding for a record String (UTF-8) etc.
/generatepwid Generate PWID for a single record String
/timestampsforpage Find nearest crawl time for all resources on a HTML page used on playback csv

Service methods for /services/frontend

Method Description Payload
/smurf/text Generate statistics for text frequenzy over time JSON
/smurf/tags Generate statistics for HTML element frequenzy over time JSON
/graph/domain_result Generate bar-chart data with domains for query JSON
/pagepreviewsyearinfo Count number of harvests of a specific URL by year JSON
/pagepreviews Generate list of url that will generate screenshot images over time for a webpage JSON
/harvestDates Genererate list of all crawl times fom a specific url (calendar) JSON
/images/search Search for images by query JSON
/images/search/location Search for images by lattitude ,longitude and radius (exit metadata) JSON
/wordcloud/domain Generate non-deterministic wordcloud image for a domain PNG
/wordcloud/query Generate non-deterministic wordcloud image from a query PNG
/wordcloud/wordfrequency Generate non-deterministic word count from a query JSON
/util/normalizeurl Normalize URL and puny code domain JSON
/upload/gethash Search by uploading a fil and return all entries with same SHA1 hash. JSON
/solr/search/results Search by query, filter query etc. to find solr documents JSON
/solr/search/facets Search by query, filter query etc. and get facets JSON
/solr/search/facets/loadmore Same as /solr/search/facet with higher facet limit JSON
/solr/idlookup Load a single solr document with all fields JSON
/properties/solrwaybackweb Load various properties from properties files used by frontend JSON
/tools/linkgraph Load various properties from properties files used by frontend JSON (D3.js format)
/images/logo Load the custom defined logo in top left corner of the frontend Image type
/images/htmlpage Find all images on a webpage (img-tag) with links to image JSON
/statistics/querystats Get statistics information about fields for a query JSON
/statistics/percentilestats Get percentile statistics information about a numeric field for a query JSON

/tools/linkgraph graph/domain_result

Examples

Warc header

Service path: services/warc-header

Example url:

http://localhost:8080/solrwayback/services/warc/header/?source_file_path=/warcs/test.warc.gz&offset=301937

Response:

WARC/1.0
WARC-Type: response
WARC-Target-URI: https://www.dr.dk/
WARC-Date: 2026-03-06T05:36:55Z
WARC-IP-Address: 2.23.172.130
WARC-Payload-Digest: sha1:YMNFVNV7KZSLYQVLWUN2XK32FUFKRC6Q
WARC-Record-ID: <urn:uuid:2dd9603a-3df5-4401-aec3-47847e34ba94>
Content-Type: application/http; msgtype=response
Content-Length: 1186938

HTTP/1.1 200 OK
Content-Type: text/html; charset=utf-8
x-frame-options: SAMEORIGIN
x-content-type-options: nosniff
x-xxs-protection: 1; mode=block
Content-Security-Policy: default-src 'self';script-src 'self' 'unsafe-inline' 'unsafe-eval' https:;style-src 'self' 'unsafe-inline' https:;img-src 'self' data: https: android-webview-video-poster:;font-src 'self' data: https:;connect-src 'self' https: wss: blob: android-webview-video-poster:;manifest-src 'self' blob:;media-src 'self' data: https: blob:;object-src 'none';child-src 'self' https: data: blob:;form-action 'self' https:
ETag: "149yn558f0hpdt7"
Cache-Control: public, max-age=19
Date: Fri, 06 Mar 2026 05:36:55 GMT
Transfer-Encoding:  chunked
Connection: close
Connection: Transfer-Encoding
x-dr-appname: HYDRA
Strict-Transport-Security: max-age=31536000 ; preload

Playback

Service path: /web

Example url:

http://localhost:8080/service/web/20251029070506/https://archive.org/

Lenient playback

Service path: /lenient/web

Example url:

http://localhost:8080/services/lenient/web/20251029070506/https://archive.org/

Domain statistics

Service path: /services/statistics/domain/

Example url:

 http://localhost:8080/solrwayback/services/statistics/domain/?domain=archive.org&startdate=2010-01-01&enddate=2011-01-01&scale=YEAR

Example data:

[
  {
    "date": "2010-01-01",
    "ingoingLinks": 3117,
    "sizeInKb": 12519,
    "domain": "archive.org",
    "contentTextLength": 19896,
    "totalPages": 264
  },
  {
    "date": "2011-01-01",
    "ingoingLinks": 3468,
    "sizeInKb": 27034,
    "domain": "archive.org",
    "contentTextLength": 9913,
    "totalPages": 1058
  }
]

Image

Service path: /services/image

Example url:

https://localhost:8080/solrwayback/services/image?source_file_path=/warcs/test.warc.gz&offset=914346010&height=200&width=200

Download raw

Service path: /services/downloadRaw

Example url:

http://localhost:8080/solrwayback/services/downloadRaw?source_file_path=/warcs/test.warc.gz&offset=914346010

Export linkgraph

Service path: /services/export/linkgraph

Example url:

http://localhost:8080/solrwayback/services/export/linkgraph?query=cats AND dogs

Export warc

Service path: /services/export/warc

Example url:

http://localhost:8080/solrwayback/services/export/warc?query=cats AND dogs AND funny

Export warc expanded

Service path: /services/export/warcExpanded

Example url:

https://localhost:8080/solrwayback/services/exportExpanded/warc?query=cats AND dogs AND funny

Image Pagepreview

ServicePath: /services/image/pagepreview

Example url:

http://localhost:8080/solrwayback/services/image/pagepreview?source_file_path=/warcs/test.warc.gz&offset=914346010

Export fields

Service path: /services/export/fields Example url:

http://localhost:8080/solrwayback/services/export/fields?query=cats AND dogs AND funny&fields=id,index_time,author,description,keywords,description,license_url,content,content_encoding&flatten=false&format=csv&gzip=false

Export zip

ServicePath: /services/export/zip Example url:

https://solrwb-liveqa.kb.dk:4000/solrwayback/services/export/zip?query=cats AND dogs AND funny

Get content type

ServicePath: /services/getContentType Example url:

http://localhost:8080/solrwayback/services/getEncoding?source_file_path=/warcs/test.warc.gz&offset=914346010

Generate PWID

Service path: /services/generatepwid Example url:

http://localhost:8080/solrwayback/services/getEncoding?source_file_path=/warcs/test.warc.gz&offset=914346010

Example data:

<part>
urn:pwid:netarkivet.dk:2025-12-16T08:59:28Z:part:http://archive.org/
</part>
<part>
urn:pwid:netarkivet.dk:2025-12-16T08:59:44Z:part:http://archive.org/offshoot_assets/favicon.ico
</part>
<part>
urn:pwid:netarkivet.dk:2025-12-16T08:59:54Z:part:http://archive.org/offshoot_assets/index-Cemds5ne.js
</part>
<part>
urn:pwid:netarkivet.dk:2025-12-16T08:59:47Z:part:http://archive.org/offshoot_assets/index.css
</part>
<part>
urn:pwid:netarkivet.dk:2025-12-16T08:59:52Z:part:http://archive.org/offshoot_assets/vendor/@webcomponents/webcomponentsjs@2.6.0/webcomponents-loader.js
</part>
<part>
urn:pwid:netarkivet.dk:2025-12-16T08:59:49Z:part:http://archive.org/offshoot_assets/vendor/lit/polyfill-support.js
</part>

Timestamps for page

Service path: /services/timestampsforpage Example url:

http://localhost:8080/solrwayback/services/timestampsforpage?source_file_path=/warcs/test.warc.gz&offset=914346010

Example data:

{
  "pageCrawlDate": 1765875568000,
  "pageUrl": "http://archive.org/",
  "pagePreviewUrl": "http://localhost:8080/solrwayback/services/image/pagepreview?source_file_path=/warcs/fildir/510627-383-20251216085617774-00000-kb-prod-har-011.kb.dk.warc.gz&offset=322936672&showToolbar=false",
  "maximumTimeDifferenceBackward": "0 seconds",
  "maximumTimeDifferenceForward": "26 seconds",
  "resources": [
    {
      "url": "http://archive.org/offshoot_assets/favicon.ico",
      "downloadUrl": "http://localhost:8080/solrwayback/services/downloadRaw?source_file_path=/warcs/fildir/510627-383-20251216085617774-00000-kb-prod-har-011.kb.dk.warc.gz&offset=376702490",
      "contentType": "image",
      "crawlTime": 1765875584000,
      "timeDifference": "16 seconds"
    },
    {
      "url": "http://archive.org/offshoot_assets/index-Cemds5ne.js",
      "downloadUrl": "http://localhost:8080/solrwayback/services/downloadRaw?source_file_path=/warcs/fildir/510627-383-20251216085617774-00000-kb-prod-har-011.kb.dk.warc.gz&offset=412105525",
      "contentType": "other",
      "crawlTime": 1765875594000,
      "timeDifference": "26 seconds"
    },
    {
      "url": "http://archive.org/offshoot_assets/index.css",
      "downloadUrl": "http://localhost:8080/solrwayback/services/downloadRaw?source_file_path=/warcs/fildir/510627-383-20251216085617774-00000-kb-prod-har-011.kb.dk.warc.gz&offset=380788683",
      "contentType": "other",
      "crawlTime": 1765875587000,
      "timeDifference": "19 seconds"
    },
    {
      "url": "http://archive.org/offshoot_assets/vendor/@webcomponents/webcomponentsjs@2.6.0/webcomponents-loader.js",
      "downloadUrl": "http://localhost:8080/solrwayback/services/downloadRaw?source_file_path=/warcs/fildir/510627-383-20251216085617774-00000-kb-prod-har-011.kb.dk.warc.gz&offset=398874683",
      "contentType": "other",
      "crawlTime": 1765875592000,
      "timeDifference": "24 seconds"
    },
    {
      "url": "http://archive.org/offshoot_assets/vendor/lit/polyfill-support.js",
      "downloadUrl": "http://localhost:8080/solrwayback/services/downloadRaw?source_file_path=/warcs/fildir/510627-383-20251216085617774-00000-kb-prod-har-011.kb.dk.warc.gz&offset=390551573",
      "contentType": "other",
      "crawlTime": 1765875589000,
      "timeDifference": "21 seconds"
    }
  ],
  "notHarvested": [
    "http://analytics.archive.org/"
  ]
}

Smurf text

Service path: /services/frontend/smurf/text

Example url:

http://localhost:8080/solrwayback/services/frontend/smurf/text/?q=corona&startdate=2020-01-01&enddate=2027-01-01&scale=YEAR

Example data:

{
  "countPercent": [
    3.8101440299999996,
    3.4419411400000004,
    1.6268630199999998,
    0.98650153,
    0.69178421,
    0.5094841999999999,
    0.44807909999999995,
    0
  ],
  "countsTotal": [
    {
      "date": "2020-01-01",
      "count": 60463029,
      "total": 1586896150
    },
    {
      "date": "2021-01-01",
      "count": 48756132,
      "total": 1416530092
    },
    {
      "date": "2022-01-01",
      "count": 37941803,
      "total": 2332206374
    },
    {
      "date": "2023-01-01",
      "count": 23314403,
      "total": 2363341806
    },
    {
      "date": "2024-01-01",
      "count": 15475230,
      "total": 2237002505
    },
    {
      "date": "2025-01-01",
      "count": 10450815,
      "total": 2051253979
    },
    {
      "date": "2026-01-01",
      "count": 1463077,
      "total": 326522033
    },
    {
      "date": "2027-01-01",
      "count": 0,
      "total": 0
    }
  ],
  "emptyResult": false
}

Smurf tags

Service path: /services/frontend/smurf/tags

Example url:

http://localhost:8080/solrwayback/services/frontend/smurf/tags/?tag=table&startdate=1998-01-01&enddate=2027-01-01&scale=YEAR

Example data:

{
  "countPercent": [
    67.54573643,
    65.71033729999999,
    63.189676490000004,
    70.62155541,
    72.7186205,
    100
  ],
  "countsTotal": [
    {
      "date": "2000-01-01",
      "count": 4059005,
      "total": 6009269
    },
    {
      "date": "2001-01-01",
      "count": 12944303,
      "total": 19699036
    },
    {
      "date": "2002-01-01",
      "count": 24156456,
      "total": 38228485
    },
    {
      "date": "2003-01-01",
      "count": 45481942,
      "total": 64402351
    },
    {
      "date": "2004-01-01",
      "count": 60219083,
      "total": 82811091
    },
    {
      "date": "2005-01-01",
      "count": 85,
      "total": 85
    }
  ],
  "emptyResult": false
}

Smurf text

Service path: /services/frontend/smurf/text

Example url:

http://localhost:8080/solrwayback/services/frontend/smurf/text/?q=corona&startdate=2020-01-01&enddate=2027-01-01&scale=YEAR

Example data:

{
  "countPercent": [
    3.8101440299999996,
    3.4419411400000004,
    1.6268630199999998,
    0.98650153,
    0.69178421,
    0.5094841999999999,
    0.44807909999999995,
    0
  ],
  "countsTotal": [
    {
      "date": "2020-01-01",
      "count": 60463029,
      "total": 1586896150
    },
    {
      "date": "2021-01-01",
      "count": 48756132,
      "total": 1416530092
    },
    {
      "date": "2022-01-01",
      "count": 37941803,
      "total": 2332206374
    },
    {
      "date": "2023-01-01",
      "count": 23314403,
      "total": 2363341806
    },
    {
      "date": "2024-01-01",
      "count": 15475230,
      "total": 2237002505
    },
    {
      "date": "2025-01-01",
      "count": 10450815,
      "total": 2051253979
    },
    {
      "date": "2026-01-01",
      "count": 1463077,
      "total": 326522033
    },
    {
      "date": "2027-01-01",
      "count": 0,
      "total": 0
    }
  ],
  "emptyResult": false
}

Graph domain result

Service path: /services/frontend/graph/domain_result

Example url:

http://localhost:8080/solrwayback/services/frontend/graph/domain_result/?q=corona&start=0&startdate=2025-01-01&enddate=2026-01-01&scale=YEAR

Example data:

{
State,altinget.dk,amtsavisen.dk,avisendanmark.dk,berlin-nyt.dk,berlingske.dk,blazar.dk,borsen.dk,bt.dk,check-in.dk,danmarksfrihedsraad.com,dr.dk,e-pages.dk,folkets.dk,fyens.dk,gatesofvienna.net,gymnasieskolen.dk,heartbeats.dk,jakobsvejen.dk,jv.dk,jwplatform.com,kontrast.dk,kost.dk,kristeligt-dagblad.dk,lex.dk,navisen.dk,parkhuset.dk,polennu.dk,politiken.dk,pov.international,raeson.dk,saebyavis.dk,senest.dk,skagensavis.dk,soefart.dk,soendagaften.dk,solidaritet.dk,sonderborgnyt.dk,standby.dk,tv2bornholm.dk,tv2kosmopol.dk,tv2nord.dk,tv2ostjylland.dk,tvmidtvest.dk,ugeskriftet.dk,vafo.dk,version2.dk,watchmedier.dk,zetland.dk

2025-01-01,104,19,18,0,23,45,28,91,0,412,835,0,0,98,0,0,28,0,165,2972,104,0,116,0,0,0,23,63,0,125,0,20,0,46,90,435,0,0,34,18,40,80,34,0,2244,0,36,16
2026-01-01,1965,0,0,2551,0,0,0,1927,4018,0,2912,2037,3234,1827,2170,57174,4104,5460,3373,0,2038,2886,0,9796,5329,6146,0,3670,1984,7950,2173,0,2280,0,8807,1944,2504,10393,0,0,0,0,0,2906,6096,3056,0,0

Page previews

Service path: /services/frontend/pagepreviews

Example url:

http://localhost:8080/solrwayback/services/frontend/pagepreviews?year=2025&url=http://archive.org

Example data:

[
  {
    "pagePreviewUrl": "http://localhost:8080/solrwayback/services/image/pagepreview?source_file_path=/warcs/fildir/477122-433-20250112163127988-00003-kb-prod-har-001.kb.dk.warc.gz&offset=54244848&showToolbar=false",
    "crawlDate": 1736699654000,
    "solrWaybackUrl": "http://localhost:8080/solrwayback/services/view?source_file_path=/warcs/fildir/477122-433-20250112163127988-00003-kb-prod-har-001.kb.dk.warc.gz&offset=54244848"
  },
  {
    "pagePreviewUrl": "http://localhost:8080/solrwayback/services/image/pagepreview?source_file_path=/warcs/fildir/477258-433-20250114082212356-00005-kb-prod-har-014.kb.dk.warc.gz&offset=885072380&showToolbar=false",
    "crawlDate": 1736849968000,
    "solrWaybackUrl": "http://localhost:8080/solrwayback/services/view?source_file_path=/warcs/fildir/477258-433-20250114082212356-00005-kb-prod-har-014.kb.dk.warc.gz&offset=885072380"
  }
]

Page previews year info

Service path: /services/frontend/pagepreviewsyearinfo

Example url:

http://localhost:8080/solrwayback/services/frontend/pagepreviewsyearinfo?url=http://archive.org

Example data:

[
  {
    "count": 397,
    "value": "2019"
  },
  {
    "count": 302,
    "value": "2014"
  }
]

Harvest dates

Service path: /services/frontend/harvestDates

Example url:

http://localhost:8080/solrwayback/services/frontend/pagepreviewsyearinfo?url=http://archive.org

Example data:

{
"harvestDates": {
  "dates": [
     "1119362042000",
     "1120315527000",
     "1120961083000",
     "1121469749000",
     "1122101346000" 
  ],
  "numberOfHarvests": "5",
  "url": "http://archive.org"
 }
}

Images search

Service path: /services/images/search

Example url:

http://localhost:8080/solrwayback/services/frontend/images/search/?query=corona

Example data:

[
  {
    "downloadUrl": "http://localhost:8080/solrwayback/services/downloadRaw?source_file_path=/warcs/fildir/kb-btrix-prod-vinter-ol-2026-parasport-dk-manual-20260302102211-815543d3-e92-20260302111950441-11.warc.gz&offset=39252591",
    "imageUrl": "http://localhost:8080/solrwayback/services/image?source_file_path=/warcs/fildir/kb-btrix-prod-vinter-ol-2026-parasport-dk-manual-20260302102211-815543d3-e92-20260302111950441-11.warc.gz&offset=39252591",
    "hash": "sha1:KG7CT5QBCKFR6UNZC7C72EJDDVTOYCYF",
    "urlNorm": "http://dif.dk/media/ijkhwk1k/20200316-corona-smitte-1052-1.jpg?width=320&height=312&format=jpg&quality=90&v=1d7a327d9c46da0",
    "latitude": null,
    "longitude": null,
    "resourceName": null,
    "lastModified": 0
  },
  {
    "downloadUrl": "http://localhost:8080/solrwayback/services/downloadRaw?source_file_path=/warcs/fildir/kb-btrix-prod-vinter-ol-2026-parasport-dk-manual-20260302102211-815543d3-e92-20260302111950441-11.warc.gz&offset=39233381",
    "imageUrl": "http://localhost:8080/solrwayback/services/image?source_file_path=/warcs/fildir/kb-btrix-prod-vinter-ol-2026-parasport-dk-manual-20260302102211-815543d3-e92-20260302111950441-11.warc.gz&offset=39233381",
    "hash": "sha1:5GHGTNL4CSGM2M3CVGL7LSBFRYPSIRZU",
    "urlNorm": "http://dif.dk/media/ijkhwk1k/20200316-corona-smitte-1052-1.jpg?width=160&height=156&format=jpg&quality=90&v=1d7a327d9c46da0",
    "latitude": null,
    "longitude": null,
    "resourceName": null,#images-search-location
    "lastModified": 0
  }

]

Images search location

Service path: /services/images/search/location

Example url:

http://localhost:8080/solrwayback/services/frontend/images/search/?query=*:*&latitude=56.17&longitude=10.20&d=50

Example data:

[
  {
    "downloadUrl": "http://localhost:8080/solrwayback/services/downloadRaw?source_file_path=/warcs/fildir/516151-450-20260223134954229-00047-kb-prod-har-014.kb.dk.warc.gz&offset=482452250",
    "imageUrl": "http://localhost:8080/solrwayback/services/image?source_file_path=/warcs/fildir/516151-450-20260223134954229-00047-kb-prod-har-014.kb.dk.warc.gz&offset=482452250",
    "hash": "sha1:FEPFF7YRAK6XWQLEWCZIQUCQHN46WJRP",
    "urlNorm": "http://gymnasieskolen.dk/wp-content/uploads/2025/04/test.jpg",
    "latitude": 56.170474999999996,
    "longitude": 10.201130555555554,
    "resourceName": "test.jpg",
    "lastModified": 1743673813000
  },
  {
    "downloadUrl": "http://localhost:8080/solrwayback/services/downloadRaw?source_file_path=/warcs/fildir/520290-246-20260323092710609-00001-sb-prod-har-004.statsbiblioteket.dk.warc.gz&offset=845954495",
    "imageUrl": "http://localhost:8080/solrwayback/services/image?source_file_path=/warcs/fildir/520290-246-20260323092710609-00001-sb-prod-har-004.statsbiblioteket.dk.warc.gz&offset=845954495",
    "hash": "sha1:2SJYIDZXBIWD3S5EEENVGCV3MBUCU3QK",
    "urlNorm": "http://via.ritzau.dk/files/13561235/14846879/359027/da",
    "latitude": 56.17070277777778,
    "longitude": 10.199791666666666,
    "resourceName": "da",
    "lastModified": 1774125179000
  }
]

Wordcloud domain

Service path: /services/frontend/wordcloud/domain

Example url:

http://localhost:8080/solrwayback/services/frontend/wordcloud/domain?domain=dr.dk

Example:

image

Wordcloud query

Service path: /services/frontend/wordcloud/query

Example url:

http://localhost:8080/solrwayback/services/frontend/wordcloud/query&q="donald trump"

Example:

image

Wordcloud wordfrequency

Service path: /services/frontend/wordcloud/wordfrequency

Example url:

http://localhost:8080/solrwayback/services/frontend/wordcloud/wordfrequency?q="Donald Trump"

Example data:

[
  {
    "count": 106112,
    "word": "trump"
  },
  {
    "count": 59198,
    "word": "donald"
  },
  {
    "count": 28777,
    "word": "finans"
  },
  {
    "count": 16971,
    "word": "politik"
  },
  {
    "count": 16356,
    "word": "trumps"
  },
  {
    "count": 15041,
    "word": "præsident"
  },
  {
    "count": 12015,
    "word": "internationalt"
  },
  {
    "count": 11621,
    "word": "briefing"
  },
  {
    "count": 11274,
    "word": "amerikanske"
  },
  {
    "count": 11023,
    "word": "seneste"
  },
  {
    "count": 10133,
    "word": "clinton"
  },
  {
    "count": 7754,
    "word": "berlingske"
  },
  {
    "count": 7440,
    "word": "økonomi"
  },
  {
    "count": 7245,
    "word": "kontakt"
  },
  {
    "count": 7229,
    "word": "hillary"
  },
  {
    "count": 7040,
    "word": "nyheder"
  },
  {
    "count": 6930,
    "word": "washington"
  },
  {
    "count": 6360,
    "word": "debat"
  },
  {
    "count": 6306,
    "word": "amerikansk"
  },
  {
    "count": 5872,
    "word": "erhverv"
  },
  {
    "count": 5691,
    "word": "investor"
  },
  {
    "count": 5641,
    "word": "nyhedsbreve"
  },
  {
    "count": 5371,
    "word": "york"
  }


....
]

Normalize url

Service path: /services/frontend/util/normalizeurl

Example url:

http://localhost80800/solrwayback/services/frontend/util/normalizeurl?url=http://pølser.dk/INDEX.HTML

Reponse:

{"url":"http://xn--plser-vua.dk/index.html"}

Upload gethash

Service path: /services/frontend/upload/gethash (POST with attachment)

Example url:

http://localhost80800/solrwayback/services/frontend/upload/gethash

Reponse: Solr document in JSON format

Solr search results

Service path: /services/frontend/solr/search/results

Example url:

http://localhost:8080/solrwayback/services/frontend/solr/search/results?query=computers&grouping=false&fq=domain:microsoft.com

Reponse: Solr document in JSON format (no facets, only results)

Solr search facets

Service path: /services/frontend/solr/search/facets

Example url:

http://localhost:8080/solrwayback/services/frontend/solr/search/facets?query=computers&fq=domain:microsoft.com

Reponse: Solr document in JSON format (only facets, no results)

Solr search facets load more

Service path: /services/frontend/solr/search/facets/loadmore

Example url:

http://localhost:8080/solrwayback/services/frontend/solr/search/facets/loadmore?query=computers&fq=domain:microsoft.com

Reponse: Solr document in JSON format (only facets, no results)

Solr idlookup

Service path: /services/frontend/solr/idlookup

Example url:

http://localhost:8080/solrwayback/services/frontend/solr/idlookup?id=20180519013016%2Fn34ec%2BmacqOYi2EIMgWcpA%3D%3D

Reponse: Single Solr document in JSON format

Properties solrwaybackweb

Service path: /services/frontend/properties/solrwaybackweb

Example url:

http://localhost:8080/solrwayback/services/frontend/properties/solrwaybackweb

Reponse:

{
  "leaflet.attribution": "&copy; <a href=\"https://www.openstreetmap.org/copyright\">OpenStreetMap</a> contributors",
  "top.left.logo.image": "https://solrwb-test.kb.dk:4000/solrwayback/services/frontend/images/logo",
  "playback.alternative.engine": "https://pywb-test.kb.dk/myindex/",
  "wayback.baseurl": "https://solrwb-test.kb.dk:4000/solrwayback/",
  "allow.export.zip": "true",
  "wordcloud.stopwords": "[ad, af, aldrig, alle, alt, anden, andet, andre, at, bare, begge, blev, blive, bliver, da, de, dem, den, denne, der, deres, det, dette, dig, din, dine, disse, dit, dog, du, efter, ej, eller, en, end, ene, eneste, enhver, er, et, fem, fik, fire, flere, fleste, for, fordi, forrige, fra, få, får, før, god, godt, ham, han, hans, har, havde, have, hej, helt, hende, hendes, her, hos, hun, hvad, hvem, hver, hvilken, hvis, hvor, hvordan, hvorfor, hvornår, i, ikke, ind, ingen, intet, ja, jeg, jer, jeres, jo, kan, kom, komme, kommer, kun, kunne, lad, lav, lidt, lige, lille, man, mange, med, meget, men, mens, mere, mig, min, mine, mit, mod, må, ned, nej, ni, nogen, noget, nogle, nu, ny, nyt, når, nær, næste, næsten, og, også, okay, om, op, os, otte, over, på, se, seks, selv, ser, ses, sig, sige, sin, sine, sit, skal, skulle, som, stor, store, syv, så, sådan, tag, tage, thi, ti, til, to, tre, ud, under, var, ved, vi, vil, ville, vor, vores, være, været, alene, allerede, alligevel, altid, bag, blandt, burde, bør, dens, derefter, derfor, derfra, deri, dermed, derpå, derved, egen, ellers, endnu, ens, enten, flest, foran, først, gennem, gjorde, gjort, gør, gøre, gørende, hel, heller, hen, henover, herefter, heri, hermed, herpå, hvilke, hvilkes, hvorefter, hvorfra, hvorhen, hvori, hvorimod, hvorved, igen, igennem, imellem, imens, imod, indtil, langs, lave, lavet, ligesom, længere, mellem, mest, mindre, mindst, måske, nemlig, nogensinde, nok, omkring, overalt, samme, sammen, selvom, senere, siden, stadig, synes, syntes, således, temmelig, tidligere, tilbage, tit, uden, udover, undtagen, via, vore, vær, øvrigt]",
  "stats.fields.all": "[links, domain, elements_used, content_type, content_language, links_images, type, content_length, crawl_year, content_text_length, image_height, image_width, image_size, wayback_date ]",
  "leaflet.source": "https://{s}.tile.openstreetmap.org/{z}/{x}/{y}.png",
  "search.pagination": "40",
  "solrwayback.version": "5.4.3-SNAPSHOT",
  "export.csv.fields": "id,index_time, author, description,keywords,description,license_url,content,content_encoding,content_length,content_language, content_type_droid,content_type_ext,content_type_full,content_type_norm,content_type_served,content_type_tika,content_type,content_type_version,elements_used,hash,wayback_date,crawl_date,crawl_year,url_norm,url_path,url,url_type,domain,host,host_surt,public_suffix,resourcename,image_size,links_images,links_domains,links_hosts,links_hosts_surts,links_norm,links_public_suffixes,links,server,status_code,generator,redirect_to_norm,source_file_path,source_file_offset,source_file,text,title,type,warc_key_id,warc_ip ,ssdeep_hash_bs_3, ssdeep_hash_bs_6, ssdeep_hash_bs_12, ssdeep_hash_bs_24, ssdeep_hash_bs_48, ssdeep_hash_bs_96,ssdeep_hash_bs_192,arc_orig,arc_job,arc_full,arc_harvest,arc_name,arc_harvesttime",
  "facets": "[domain, content_type_norm, type, crawl_year, status_code, public_suffix, keywords]",
  "playback.disabled": "false",
  "maps.radius": "50000",
  "maps.longitude": "10.20",
  "webapp.baseurl": "/solrwayback/",
  "playback.primary.engine": null,
  "stats.fields.numeric": "[links, domain, elements_used, content_type, content_language, links_images, type, content_length, crawl_year, content_text_length, image_height, image_width, image_size, wayback_date ]",
  "allow.export.warc": "true",
  "allow.export.csv": "true",
  "archive.start.year": "1998",
  "search.uploaded.file.disabled": "false",
  "top.left.logo.image.link": "https://www.kb.dk/",
  "maps.latitude": "56.17"
}

Tools linkgraph

Service path: /services/frontend/tools/linkgraph Example url:

http://localhost:8080/solrwayback/services/services/frontend/tools/linkgraph/?domain=kb.dk&facetLimit=25&ingoing=false&dateStart=883609200000&dateEnd=1776417971408

Reponse:

{
  "nodes": [
    {
      "name": "danbib.dk",
      "group": 0,
      "size": 5,
      "color": null
    },
    {
      "name": "auc.dk",
      "group": 1,
      "size": 5,
      "color": null
    },
    {
      "name": "ekstrabladet.dk",
      "group": 2,
      "size": 5,
      "color": null
    },
   ...
  ],
  "links": [
    {
      "source": 189,
      "target": 24,
      "weight": 5
    },
    {
      "source": 80,
      "target": 92,
      "weight": 5
    },
    {
      "source": 80,
      "target": 177,
      "weight": 5
    },

...

  ]
}

Images logo

Service path: /services/frontend/images/logo Example url:

http://localhost:8080/solrwayback/services/services/frontend/images/logo

Reponse: Custom defined logo (full size). Will be scaled in the frontend.

Images htmlpage

Service path: /services/frontend/images/logo Example url:

http://localhost:8080//solrwayback/services/frontend/images/htmlpage/?source_file_path=/warcs/test.warc.gz&offset=52655649

Reponse:

[
  {
    "downloadUrl": "http://localhost:8080/solrwayback/services/downloadRaw?source_file_path=/warcs/test.warc.gz&offset=5694361",
    "imageUrl": "http://localhost:8080/solrwayback/services/image?source_file_path=/warcs/test.warc.gz&offset=5694361",
    "hash": "sha1:2P42IT3QGVP4ATHMO4YBRBVVIQUA4XC2",
    "urlNorm": "http://gfx.cphmerchandise.dk/54.png",
    "latitude": null,
    "longitude": null,
    "resourceName": null,
    "lastModified": 0
  },
  {
    "downloadUrl": "https//localhost:8080/solrwayback/services/downloadRaw?source_file_path=/warcs/test.warc.gz&offset=6546673",
    "imageUrl": "http:localgost:8080/solrwayback/services/image?source_file_path=/warcs/test.warc.gz&offset=6546673",
    "hash": "sha1:76XH66ZKMMTNHQROTOI6ZY6M4UARK7GE",
    "urlNorm": "http://gfx.cphmerchandise.dk/57.png",
    "latitude": null,
    "longitude": null,
    "resourceName": null,
    "lastModified": 0
  }
]

Statistics querystats

Service path: /services/frontend/d/statistics/querystats

Example url:

http://localhost:8080//solrwayback/services/frontend/statistics/querystats?query=content_type_norm:pdf&fields=content_text_length

Reponse:

[
  {
    "name": "content_text_length",
    "min": 0,
    "max": 524247,
    "sum": 2561548591642,
    "count": 133190482,
    "missing": 33724452,
    "mean": 19232.219548856352,
    "sumOfSquares": 435747503232688500,
    "stddev": 53867.73786477073
  }
]

Statistics percentilestats

Service path: /services/frontend/d/statistics/percentilestats

Example url:

http://localhost:8080//solrwayback/services/frontend/statistics/percentilestats?query=content_type_norm:pdf&fields=content_text_length&percentiles=25&percentiles=50&percentiles=75&percentiles=100

Reponse:

[
  {
    "name": "content_text_length",
    "percentiles": {
      "25.0": 824.2126555974706,
      "50.0": 3015.147482670994,
      "75.0": 12156.82355642039,
      "100.0": 524247.00166994333
    }
  }
]```
Add a custom footer
Add a custom sidebar

Clone this wiki locally