keepset 0.33.0 → 0.34.0

package/README.md

@@ -57,7 +57,7 @@ An alias that is a path, such as `foo/graphs/bar`, files the entry in a second g
 
 ## The entry format
 
-An entry is a JSON document in `catalogue/entries/`: a descriptor (stable id, name, description, domain, subjects, tags), the category whose normalisation target the entry resolves to, its sources (each with a retrieval date, and for a dead source a pinned Wayback snapshot that travels with the URL because the snapshot timestamp is part of the recipe's reproducibility), its licence and citations, the recipe that turns downloaded bytes into the dataset's native JSON shape, and a crossmap crosswalk mapping that native shape onto the category target. The format is defined by Zod schemas, and the generated JSON Schema is published with the package as `keepset/schemas/entry.schema.json`, with the catalogue manifest's beside it. The domain is the entry's topic, its tags are the node fields it carries, its namespace is the source it comes from, and its subjects are the fields of study it is relevant to (for example `operations-research`), as slugs a search filters by (`keepset search --subject operations-research`), a listing page per subject on the site and keywords in the JSON-LD.
+An entry is a JSON document in `catalogue/entries/`: a descriptor (stable id, name, description, domain, subjects, tags), the category whose normalisation target the entry resolves to, its sources (each with a retrieval date, and for a dead source a pinned Wayback snapshot that travels with the URL because the snapshot timestamp is part of the recipe's reproducibility), its licence and citations, the recipe that turns downloaded bytes into the dataset's native JSON shape, and a crossmap crosswalk mapping that native shape onto the category target. A recipe's archive is no archive, a compressed file (gzip or bzip2), a tar archive (plain, gzip or bzip2 compressed), a zip archive or an Excel workbook, and a member of an archive is selected by path, extension or pattern. The format is defined by Zod schemas, and the generated JSON Schema is published with the package as `keepset/schemas/entry.schema.json`, with the catalogue manifest's beside it. The domain is the entry's topic, its tags are the node fields it carries, its namespace is the source it comes from, and its subjects are the fields of study it is relevant to (for example `operations-research`), as slugs a search filters by (`keepset search --subject operations-research`), a listing page per subject on the site and keywords in the JSON-LD.
 
 The catalogue itself is a manifest (`catalogue/manifest.json`: id, version, repository) plus the entries and their crosswalks. Contribution is by forking with lineage: a fork is its own catalogue, its manifest names the catalogue and version it was forked from, and entry ids stay stable across forks so two catalogues can be compared entry by entry.
 

package/dist/{bundled-pT7q4sWm.js → bundled-CPSe9InV.js}

@@ -511,7 +511,8 @@ const ArchiveMemberSchema = z.union([
 const FileArchiveKindSchema = z.enum([
 	"zip",
 	"tar",
-	"tar.gz"
+	"tar.gz",
+	"tar.bz2"
 ]);
 /** An archive a collection is read from: every file a selector matches, at least one. */
 const CollectionArchiveSchema = z.object({
@@ -523,10 +524,11 @@ const InnerArchiveSchema = z.union([z.object({ kind: z.literal("gzip") }).strict
 	kind: FileArchiveKindSchema,
 	member: ArchiveMemberSchema
 }).strict()]);
-/** How the downloaded bytes unpack into the file the parser reads, or for a collection the files it reads one by one. A `members` selector gives every member it matches, at least one, in path order. A member that is an archive in its turn (a contest bundle that ships its problems as a zip inside the zip) is unpacked by `inner`. A workbook (`xlsx`) is read as the CSV of its named sheet, with dates as ISO 8601 text, for the `csv-table` parser. */
+/** How the downloaded bytes unpack into the file the parser reads, or for a collection the files it reads one by one. A `members` selector gives every member it matches, at least one, in path order. `gzip` and `bzip2` are one compressed file, and `tar.gz` and `tar.bz2` a tar archive compressed with them. A member that is an archive in its turn (a contest bundle that ships its problems as a zip inside the zip) is unpacked by `inner`. A workbook (`xlsx`) is read as the CSV of its named sheet, with dates as ISO 8601 text, for the `csv-table` parser. */
 const ArchiveSchema = z.union([
 	z.object({ kind: z.literal("none") }).strict(),
 	z.object({ kind: z.literal("gzip") }).strict(),
+	z.object({ kind: z.literal("bzip2") }).strict(),
 	z.object({
 		kind: FileArchiveKindSchema,
 		member: ArchiveMemberSchema,
@@ -567,6 +569,30 @@ const ParserSchema = z.discriminatedUnion("format", [
 		format: z.literal("matrix-market"),
 		encoding: EncodingSchema
 	}).strict(),
+	z.object({
+		format: z.literal("user-item-ratings"),
+		encoding: z.literal("utf-8"),
+		/** What separates the fields of a line: a comma, a tab, or the two colons of MovieLens's `ratings.dat`. */
+		delimiter: z.enum([
+			"comma",
+			"tab",
+			"double-colon"
+		]),
+		/** The header lines before the first rating, counted as the file's lines. */
+		skipLines: z.int().min(0),
+		/** What the rated items are, which is their node type and fixes the prefix of their ids. */
+		itemType: z.enum(["movie", "product"]),
+		/** The top of the rating scale: a rating is divided by it to give the edge's weight, and a rating above it is refused. */
+		maxRating: z.number().positive()
+	}).strict(),
+	z.object({
+		format: z.literal("konect"),
+		encoding: z.literal("utf-8"),
+		/** Whether the third column is read as the edge's weight; the file's own weight type must agree. */
+		weighted: z.boolean(),
+		/** Whether the fourth column is read as the edge's time. */
+		timestamped: z.boolean()
+	}).strict(),
 	z.object({
 		format: z.literal("gml"),
 		encoding: EncodingSchema
@@ -1070,7 +1096,7 @@ var catalogue_default = {
 		"id": "keepset",
 		"name": "keepset",
 		"description": "The keepset catalogue: datasets with machine-readable recipes that fetch each one and normalise it into its category's target shape.",
-		"version": "1.24.0",
+		"version": "1.25.0",
 		"repository": "https://github.com/Mearman/keepset",
 		"namespaceAliases": {
 			"networkrepository": ["nr"],
@@ -1078,6 +1104,85 @@ var catalogue_default = {
 		}
 	},
 	crosswalks: {
+		"crosswalks/graph-v1/rated.json": {
+			"source": "keepset/rated",
+			"target": "graph/v1",
+			"rules": [
+				{
+					"op": "move",
+					"from": "meta",
+					"to": "meta"
+				},
+				{
+					"op": "move",
+					"from": "nodes[].id",
+					"to": "nodes[].id"
+				},
+				{
+					"op": "move",
+					"from": "edges[].source",
+					"to": "edges[].source"
+				},
+				{
+					"op": "move",
+					"from": "edges[].target",
+					"to": "edges[].target"
+				},
+				{
+					"op": "move",
+					"from": "nodes[].type",
+					"to": "nodes[].type"
+				},
+				{
+					"op": "move",
+					"from": "edges[].type",
+					"to": "edges[].type"
+				},
+				{
+					"op": "move",
+					"from": "edges[].weight",
+					"to": "edges[].weight"
+				},
+				{
+					"op": "move",
+					"from": "edges[].timestamp",
+					"to": "edges[].timestamp"
+				}
+			],
+			"oneWay": []
+		},
+		"crosswalks/graph-v1/timestamped.json": {
+			"source": "keepset/timestamped",
+			"target": "graph/v1",
+			"rules": [
+				{
+					"op": "move",
+					"from": "meta",
+					"to": "meta"
+				},
+				{
+					"op": "move",
+					"from": "nodes[].id",
+					"to": "nodes[].id"
+				},
+				{
+					"op": "move",
+					"from": "edges[].source",
+					"to": "edges[].source"
+				},
+				{
+					"op": "move",
+					"from": "edges[].target",
+					"to": "edges[].target"
+				},
+				{
+					"op": "move",
+					"from": "edges[].timestamp",
+					"to": "edges[].timestamp"
+				}
+			],
+			"oneWay": []
+		},
 		"crosswalks/graph-v1/topology.json": {
 			"source": "keepset/topology",
 			"target": "graph/v1",
@@ -1105,6 +1210,75 @@ var catalogue_default = {
 			],
 			"oneWay": []
 		},
+		"crosswalks/graph-v1/weighted-timestamped.json": {
+			"source": "keepset/weighted-timestamped",
+			"target": "graph/v1",
+			"rules": [
+				{
+					"op": "move",
+					"from": "meta",
+					"to": "meta"
+				},
+				{
+					"op": "move",
+					"from": "nodes[].id",
+					"to": "nodes[].id"
+				},
+				{
+					"op": "move",
+					"from": "edges[].source",
+					"to": "edges[].source"
+				},
+				{
+					"op": "move",
+					"from": "edges[].target",
+					"to": "edges[].target"
+				},
+				{
+					"op": "move",
+					"from": "edges[].weight",
+					"to": "edges[].weight"
+				},
+				{
+					"op": "move",
+					"from": "edges[].timestamp",
+					"to": "edges[].timestamp"
+				}
+			],
+			"oneWay": []
+		},
+		"crosswalks/graph-v1/weighted.json": {
+			"source": "keepset/weighted",
+			"target": "graph/v1",
+			"rules": [
+				{
+					"op": "move",
+					"from": "meta",
+					"to": "meta"
+				},
+				{
+					"op": "move",
+					"from": "nodes[].id",
+					"to": "nodes[].id"
+				},
+				{
+					"op": "move",
+					"from": "edges[].source",
+					"to": "edges[].source"
+				},
+				{
+					"op": "move",
+					"from": "edges[].target",
+					"to": "edges[].target"
+				},
+				{
+					"op": "move",
+					"from": "edges[].weight",
+					"to": "edges[].weight"
+				}
+			],
+			"oneWay": []
+		},
 		"crosswalks/tasks-v1/nodes.json": {
 			"source": "keepset/nodes",
 			"target": "tasks/v1",
@@ -1560,10 +1734,19 @@ var catalogue_default = {
 			"licence": { "kind": "unrecorded" },
 			"citations": [{ "text": "McAuley, Julian, Targett, Christopher, Shi, Qinfeng, van den Hengel, Anton (2015). Image-Based Recommendations on Styles and Substitutes. Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval." }],
 			"recipe": {
-				"status": "not-fetchable",
-				"reason": "no download is in a form keepset reads yet (amazon-ratings: format amazon-ratings has a pipeline-specific parser with no declarative keepset form yet)"
+				"status": "fetchable",
+				"source": 0,
+				"archive": { "kind": "none" },
+				"parser": {
+					"format": "user-item-ratings",
+					"encoding": "utf-8",
+					"delimiter": "comma",
+					"skipLines": 0,
+					"itemType": "product",
+					"maxRating": 5
+				}
 			},
-			"crosswalk": { "file": "crosswalks/graph-v1/topology.json" },
+			"crosswalk": { "file": "crosswalks/graph-v1/rated.json" },
 			"expectedCounts": {
 				"edges": 2023070,
 				"nodes": 1459545
@@ -1597,10 +1780,19 @@ var catalogue_default = {
 			"licence": { "kind": "unrecorded" },
 			"citations": [{ "text": "McAuley, Julian, Targett, Christopher, Shi, Qinfeng, van den Hengel, Anton (2015). Image-Based Recommendations on Styles and Substitutes. Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval." }],
 			"recipe": {
-				"status": "not-fetchable",
-				"reason": "no download is in a form keepset reads yet (amazon-ratings: format amazon-ratings has a pipeline-specific parser with no declarative keepset form yet)"
+				"status": "fetchable",
+				"source": 0,
+				"archive": { "kind": "none" },
+				"parser": {
+					"format": "user-item-ratings",
+					"encoding": "utf-8",
+					"delimiter": "comma",
+					"skipLines": 0,
+					"itemType": "product",
+					"maxRating": 5
+				}
 			},
-			"crosswalk": { "file": "crosswalks/graph-v1/topology.json" },
+			"crosswalk": { "file": "crosswalks/graph-v1/rated.json" },
 			"expectedCounts": {
 				"edges": 836006,
 				"nodes": 744649
@@ -1660,7 +1852,7 @@ var catalogue_default = {
 		{
 			"id": "amazon-movies-tv",
 			"name": "Amazon Movies and TV Reviews",
-			"description": "Directed bipartite user-product review network for Movies and TV on Amazon. Users are linked to products they reviewed; edge weights are normalised star ratings.",
+			"description": "Undirected bipartite user-product review network for Movies and TV on Amazon. Users are linked to products they reviewed; edge weights are normalised star ratings.",
 			"tags": [],
 			"category": "graph/v1",
 			"sources": [{
@@ -1671,10 +1863,19 @@ var catalogue_default = {
 			"licence": { "kind": "unrecorded" },
 			"citations": [{ "text": "McAuley, Julian, Targett, Christopher, Shi, Qinfeng, van den Hengel, Anton (2015). Image-Based Recommendations on Styles and Substitutes. Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval." }],
 			"recipe": {
-				"status": "not-fetchable",
-				"reason": "no download is in a form keepset reads yet (amazon-ratings-undirected: format amazon-ratings-undirected has a pipeline-specific parser with no declarative keepset form yet)"
+				"status": "fetchable",
+				"source": 0,
+				"archive": { "kind": "none" },
+				"parser": {
+					"format": "user-item-ratings",
+					"encoding": "utf-8",
+					"delimiter": "comma",
+					"skipLines": 0,
+					"itemType": "product",
+					"maxRating": 5
+				}
 			},
-			"crosswalk": { "file": "crosswalks/graph-v1/topology.json" },
+			"crosswalk": { "file": "crosswalks/graph-v1/rated.json" },
 			"expectedCounts": {
 				"edges": 4607047,
 				"nodes": 2289561
@@ -1708,10 +1909,19 @@ var catalogue_default = {
 			"licence": { "kind": "unrecorded" },
 			"citations": [{ "text": "McAuley, Julian, Targett, Christopher, Shi, Qinfeng, van den Hengel, Anton (2015). Image-Based Recommendations on Styles and Substitutes. Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval." }],
 			"recipe": {
-				"status": "not-fetchable",
-				"reason": "no download is in a form keepset reads yet (amazon-ratings: format amazon-ratings has a pipeline-specific parser with no declarative keepset form yet)"
+				"status": "fetchable",
+				"source": 0,
+				"archive": { "kind": "none" },
+				"parser": {
+					"format": "user-item-ratings",
+					"encoding": "utf-8",
+					"delimiter": "comma",
+					"skipLines": 0,
+					"itemType": "product",
+					"maxRating": 5
+				}
 			},
-			"crosswalk": { "file": "crosswalks/graph-v1/topology.json" },
+			"crosswalk": { "file": "crosswalks/graph-v1/rated.json" },
 			"expectedCounts": {
 				"edges": 500176,
 				"nodes": 422277
@@ -1745,10 +1955,19 @@ var catalogue_default = {
 			"licence": { "kind": "unrecorded" },
 			"citations": [{ "text": "McAuley, Julian, Targett, Christopher, Shi, Qinfeng, van den Hengel, Anton (2015). Image-Based Recommendations on Styles and Substitutes. Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval." }],
 			"recipe": {
-				"status": "not-fetchable",
-				"reason": "no download is in a form keepset reads yet (amazon-ratings: format amazon-ratings has a pipeline-specific parser with no declarative keepset form yet)"
+				"status": "fetchable",
+				"source": 0,
+				"archive": { "kind": "none" },
+				"parser": {
+					"format": "user-item-ratings",
+					"encoding": "utf-8",
+					"delimiter": "comma",
+					"skipLines": 0,
+					"itemType": "product",
+					"maxRating": 5
+				}
 			},
-			"crosswalk": { "file": "crosswalks/graph-v1/topology.json" },
+			"crosswalk": { "file": "crosswalks/graph-v1/rated.json" },
 			"expectedCounts": {
 				"edges": 1324753,
 				"nodes": 876977
@@ -8824,7 +9043,7 @@ var catalogue_default = {
 			"namespace": ["konect"],
 			"aliases": ["opsahl-collaboration"],
 			"name": "Opsahl Collaboration Network",
-			"description": "Undirected weighted co-authorship network from the arXiv. Edge weights represent the number of papers co-authored by each pair of researchers, making it genuinely weighted.",
+			"description": "Bipartite authorship network of the arXiv condensed matter section (cond-mat) from 1995 to 1999: an edge joins an author, a left node, and a paper they wrote, a right node. The network is unweighted and has no repeated pairs.",
 			"tags": [],
 			"category": "graph/v1",
 			"sources": [{
@@ -8835,27 +9054,37 @@ var catalogue_default = {
 			"licence": { "kind": "unrecorded" },
 			"citations": [{ "text": "Opsahl, Tore (2013). Triadic closure in two-mode networks: Redefining the global and local clustering coefficients. Social Networks." }],
 			"recipe": {
-				"status": "not-fetchable",
-				"reason": "no download is in a form keepset reads yet (konect-tarbz2: bzip2 compression has no keepset unpacker yet)"
+				"status": "fetchable",
+				"source": 0,
+				"archive": {
+					"kind": "tar.bz2",
+					"member": { "pattern": "(?:[^/]+/)?out\\.[^/]+" }
+				},
+				"parser": {
+					"format": "konect",
+					"encoding": "utf-8",
+					"weighted": false,
+					"timestamped": false
+				}
 			},
 			"crosswalk": { "file": "crosswalks/graph-v1/topology.json" },
 			"expectedCounts": {
 				"edges": 58595,
-				"nodes": 22015
+				"nodes": 38741
 			},
 			"properties": {
-				"components": 1,
-				"connected": true,
+				"components": 1188,
+				"connected": false,
 				"cyclic": true,
-				"density": .00024177210459736553,
+				"density": 7808365090394136e-20,
 				"directed": false,
 				"edgeTypes": 1,
 				"heterogeneous": false,
-				"multigraph": true,
+				"multigraph": false,
 				"nodeTypes": 1,
 				"rawBytes": 0,
-				"selfLoops": true,
-				"weighted": true
+				"selfLoops": false,
+				"weighted": false
 			}
 		},
 		{
@@ -8875,10 +9104,20 @@ var catalogue_default = {
 			"licence": { "kind": "unrecorded" },
 			"citations": [{ "text": "Panzarasa, Pietro, Opsahl, Tore, Carley, Kathleen M. (2009). Patterns and dynamics of users' behavior and interaction: Network analysis of an online community. Journal of the American Society for Information Science and Technology 60(5), 911-932." }],
 			"recipe": {
-				"status": "not-fetchable",
-				"reason": "no download is in a form keepset reads yet (konect-tarbz2: bzip2 compression has no keepset unpacker yet)"
+				"status": "fetchable",
+				"source": 0,
+				"archive": {
+					"kind": "tar.bz2",
+					"member": { "pattern": "(?:[^/]+/)?out\\.[^/]+" }
+				},
+				"parser": {
+					"format": "konect",
+					"encoding": "utf-8",
+					"weighted": false,
+					"timestamped": true
+				}
 			},
-			"crosswalk": { "file": "crosswalks/graph-v1/topology.json" },
+			"crosswalk": { "file": "crosswalks/graph-v1/timestamped.json" },
 			"expectedCounts": {
 				"edges": 59835,
 				"nodes": 1899
@@ -8909,10 +9148,20 @@ var catalogue_default = {
 			"licence": { "kind": "unrecorded" },
 			"citations": [{ "text": "M. Michalski (2010). Manufacturing Company Emails." }],
 			"recipe": {
-				"status": "not-fetchable",
-				"reason": "no download is in a form keepset reads yet (tsv: bzip2 compression has no keepset unpacker yet)"
+				"status": "fetchable",
+				"source": 0,
+				"archive": {
+					"kind": "tar.bz2",
+					"member": { "pattern": "(?:[^/]+/)?out\\.[^/]+" }
+				},
+				"parser": {
+					"format": "konect",
+					"encoding": "utf-8",
+					"weighted": false,
+					"timestamped": true
+				}
 			},
-			"crosswalk": { "file": "crosswalks/graph-v1/topology.json" },
+			"crosswalk": { "file": "crosswalks/graph-v1/timestamped.json" },
 			"expectedCounts": {
 				"edges": 82927,
 				"nodes": 167
@@ -8942,8 +9191,18 @@ var catalogue_default = {
 			"licence": { "kind": "unrecorded" },
 			"citations": [{ "text": "R. West, J. Leskovec (2012). Human Wayfinding in Information Networks. Proceedings of the 21st International Conference on World Wide Web, 619-628." }],
 			"recipe": {
-				"status": "not-fetchable",
-				"reason": "no download is in a form keepset reads yet (tsv: bzip2 compression has no keepset unpacker yet)"
+				"status": "fetchable",
+				"source": 0,
+				"archive": {
+					"kind": "tar.bz2",
+					"member": { "pattern": "(?:[^/]+/)?out\\.[^/]+" }
+				},
+				"parser": {
+					"format": "konect",
+					"encoding": "utf-8",
+					"weighted": false,
+					"timestamped": false
+				}
 			},
 			"crosswalk": { "file": "crosswalks/graph-v1/topology.json" },
 			"expectedCounts": {
@@ -9414,10 +9673,20 @@ var catalogue_default = {
 			"licence": { "kind": "unrecorded" },
 			"citations": [{ "text": "Donald E. Knuth (1993). The Stanford GraphBase: A Platform for Combinatorial Computing. Addison-Wesley." }],
 			"recipe": {
-				"status": "not-fetchable",
-				"reason": "no download is in a form keepset reads yet (konect-tarbz2: bzip2 compression has no keepset unpacker yet)"
+				"status": "fetchable",
+				"source": 0,
+				"archive": {
+					"kind": "tar.bz2",
+					"member": { "pattern": "(?:[^/]+/)?out\\.[^/]+" }
+				},
+				"parser": {
+					"format": "konect",
+					"encoding": "utf-8",
+					"weighted": true,
+					"timestamped": false
+				}
 			},
-			"crosswalk": { "file": "crosswalks/graph-v1/topology.json" },
+			"crosswalk": { "file": "crosswalks/graph-v1/weighted.json" },
 			"expectedCounts": {
 				"edges": 254,
 				"nodes": 77
@@ -11479,10 +11748,22 @@ var catalogue_default = {
 			},
 			"citations": [{ "text": "F. Maxwell Harper, Joseph A. Konstan (2016). The MovieLens Datasets: History and Context. ACM Transactions on Interactive Intelligent Systems." }],
 			"recipe": {
-				"status": "not-fetchable",
-				"reason": "no download is in a form keepset reads yet (movielens: format movielens has a pipeline-specific parser with no declarative keepset form yet)"
+				"status": "fetchable",
+				"source": 0,
+				"archive": {
+					"kind": "zip",
+					"member": { "path": "u.data" }
+				},
+				"parser": {
+					"format": "user-item-ratings",
+					"encoding": "utf-8",
+					"delimiter": "tab",
+					"skipLines": 0,
+					"itemType": "movie",
+					"maxRating": 5
+				}
 			},
-			"crosswalk": { "file": "crosswalks/graph-v1/topology.json" },
+			"crosswalk": { "file": "crosswalks/graph-v1/rated.json" },
 			"expectedCounts": {
 				"edges": 1e5,
 				"nodes": 2625
@@ -11505,7 +11786,7 @@ var catalogue_default = {
 		{
 			"id": "movielens-10m",
 			"name": "MovieLens 10M User-Movie Ratings",
-			"description": "Bipartite user-movie rating network from the GroupLens research group. 10,000,054 ratings from 71,567 users on 10,681 movies. Edge weights are ratings normalised to [0, 1].",
+			"description": "Bipartite user-movie rating network from the GroupLens research group. 10,000,054 ratings from 69,878 users on 10,677 movies. Edge weights are ratings normalised to [0, 1].",
 			"tags": [],
 			"category": "graph/v1",
 			"sources": [{
@@ -11520,10 +11801,22 @@ var catalogue_default = {
 			},
 			"citations": [{ "text": "Harper, F. Maxwell, Konstan, Joseph A. (2016). The MovieLens Datasets: History and Context. ACM Transactions on Interactive Intelligent Systems." }],
 			"recipe": {
-				"status": "not-fetchable",
-				"reason": "no download is in a form keepset reads yet (movielens: format movielens has a pipeline-specific parser with no declarative keepset form yet)"
+				"status": "fetchable",
+				"source": 0,
+				"archive": {
+					"kind": "zip",
+					"member": { "path": "ratings.dat" }
+				},
+				"parser": {
+					"format": "user-item-ratings",
+					"encoding": "utf-8",
+					"delimiter": "double-colon",
+					"skipLines": 0,
+					"itemType": "movie",
+					"maxRating": 5
+				}
 			},
-			"crosswalk": { "file": "crosswalks/graph-v1/topology.json" },
+			"crosswalk": { "file": "crosswalks/graph-v1/rated.json" },
 			"expectedCounts": {
 				"edges": 10000054,
 				"nodes": 80555
@@ -11546,7 +11839,7 @@ var catalogue_default = {
 		{
 			"id": "movielens-1m",
 			"name": "MovieLens 1M User-Movie Ratings",
-			"description": "Bipartite user-movie rating network from the GroupLens research group. 1,000,209 ratings from 6,040 users on 3,900 movies. Edge weights are ratings normalised to [0, 1].",
+			"description": "Bipartite user-movie rating network from the GroupLens research group. 1,000,209 ratings from 6,040 users on 3,706 movies. Edge weights are ratings normalised to [0, 1].",
 			"tags": [],
 			"category": "graph/v1",
 			"sources": [{
@@ -11561,10 +11854,22 @@ var catalogue_default = {
 			},
 			"citations": [{ "text": "Harper, F. Maxwell, Konstan, Joseph A. (2016). The MovieLens Datasets: History and Context. ACM Transactions on Interactive Intelligent Systems." }],
 			"recipe": {
-				"status": "not-fetchable",
-				"reason": "no download is in a form keepset reads yet (movielens: format movielens has a pipeline-specific parser with no declarative keepset form yet)"
+				"status": "fetchable",
+				"source": 0,
+				"archive": {
+					"kind": "zip",
+					"member": { "path": "ratings.dat" }
+				},
+				"parser": {
+					"format": "user-item-ratings",
+					"encoding": "utf-8",
+					"delimiter": "double-colon",
+					"skipLines": 0,
+					"itemType": "movie",
+					"maxRating": 5
+				}
 			},
-			"crosswalk": { "file": "crosswalks/graph-v1/topology.json" },
+			"crosswalk": { "file": "crosswalks/graph-v1/rated.json" },
 			"expectedCounts": {
 				"edges": 1000209,
 				"nodes": 9746
@@ -11587,7 +11892,7 @@ var catalogue_default = {
 		{
 			"id": "movielens-25m",
 			"name": "MovieLens 25M User-Movie Ratings",
-			"description": "Bipartite user-movie rating network from the GroupLens research group. 25,000,095 ratings from 162,541 users on 62,423 movies. Edge weights are ratings normalised to [0, 1].",
+			"description": "Bipartite user-movie rating network from the GroupLens research group. 25,000,095 ratings from 162,541 users on 59,047 movies. Edge weights are ratings normalised to [0, 1].",
 			"tags": [],
 			"category": "graph/v1",
 			"sources": [{
@@ -11603,7 +11908,7 @@ var catalogue_default = {
 			"citations": [{ "text": "Harper, F. Maxwell, Konstan, Joseph A. (2016). The MovieLens Datasets: History and Context. ACM Transactions on Interactive Intelligent Systems." }],
 			"recipe": {
 				"status": "not-fetchable",
-				"reason": "no download is in a form keepset reads yet (movielens: format movielens has a pipeline-specific parser with no declarative keepset form yet)"
+				"reason": "no download is in a form keepset reads yet (movielens: the ratings file has more edges than one fetch can hold: the crosswalk step aborts on it with an allocation failure (ExaDev/crossmap#57), where ml-10m completes)"
 			},
 			"crosswalk": { "file": "crosswalks/graph-v1/topology.json" },
 			"expectedCounts": {