keepset 0.37.0 → 0.38.0

package/README.md

@@ -63,7 +63,7 @@ The catalogue itself is a manifest (`catalogue/manifest.json`: id, version, repo
 
 ## Categories and normalisation targets
 
-A category names a normalisation target: the shape every entry in that category resolves to, whatever its native shape. `graph/v1` is `{ meta, nodes, edges }` with unique node ids and edges whose endpoints name nodes; its entries are graph datasets taken from upstream collections such as SuiteSparse, Netzschleuder, SNAP, KONECT and OGB, read by one parser per format (delimited edge lists, Matrix Market, GML, Pajek, UCINet DL full matrices, Graph Drawing contest files, KONECT edge files, rating and count files, knowledge graph triples and Heterogeneous Graph Benchmark node and link files), each giving the graph's topology and, where the format states them, node and edge types, weights, times and the split each edge belongs to. `tasks/v1` is `{ meta, nodes }`, a set of tasks as the places or cases it offers to visit or serve (a routing benchmark, or an open data register of permits and complaints), each flat with optional coordinates, prize, prize probability, duration, travel time, skill, territory, lifecycle status and times, and deadline, read from tabular sources by the `csv-table` parser (a delimited file, a member of an archive, a sheet of an Excel workbook, or an open data portal read a page at a time) and from ArcGIS feature layers by the `geojson` parser. Its entries come from a survey of open operations-research datasets, imported with a curation that records, for each source, what its download gives and how its columns map onto the node; a dataset whose source has no usable table is imported without a recipe and says why. Any category can be fetched as a collection: a recipe that selects every matching archive member with `members` (by path, by the extensions its name ends with, or by a regular expression its whole path matches) resolves to `{ meta, instances }`, where each instance is a document of the entry's category under the path of the member it came from, the schema derived from the category's own, so a category needs nothing of its own to be collected. The parser reads each member, the crosswalk is applied to each, and a member that does not parse or does not validate fails the fetch and is named. Instance files are read by one parser per format (Solomon and TOPTW time window files, Chao team orienteering files, TSPLIB style orienteering files, VRP-REP XML, VeRoLog 2019 files and customer point lists), which gives each node the columns the file has and each instance a header of its own; a curation says which of them fill the `tasks/v1` node's fields, which pass through under their own names and which are dropped, so what an entry leaves out is written down, and a source whose time quantities are not seconds keeps them under the source's names with the unit recorded as the entry's `timeUnit`. A new category starts by defining its target schema in `src/targets/` and registering it in the category registry; an entry cannot name a category that does not exist. The statically generated site renders every entry with schema.org Dataset JSON-LD, so the catalogue surfaces in the dataset discovery layers.
+A category names a normalisation target: the shape every entry in that category resolves to, whatever its native shape. `graph/v1` is `{ meta, nodes, edges }` with unique node ids and edges whose endpoints name nodes; its entries are graph datasets taken from upstream collections such as SuiteSparse, Netzschleuder, SNAP, KONECT and OGB, read by one parser per format (delimited edge lists, which can also be a sheet of a spreadsheet, Matrix Market, GML, Pajek, UCINet DL full matrices, Graph Drawing contest files, Witvliet connectome synapse files, KONECT edge files, rating and count files, knowledge graph triples and Heterogeneous Graph Benchmark node and link files), each giving the graph's topology and, where the format states them, node and edge types, weights, times and the split each edge belongs to. `tasks/v1` is `{ meta, nodes }`, a set of tasks as the places or cases it offers to visit or serve (a routing benchmark, or an open data register of permits and complaints), each flat with optional coordinates, prize, prize probability, duration, travel time, skill, territory, lifecycle status and times, and deadline, read from tabular sources by the `csv-table` parser (a delimited file, a member of an archive, a sheet of an Excel workbook, a legacy binary xls workbook or an OpenDocument spreadsheet, or an open data portal read a page at a time) and from ArcGIS feature layers by the `geojson` parser. Its entries come from a survey of open operations-research datasets, imported with a curation that records, for each source, what its download gives and how its columns map onto the node; a dataset whose source has no usable table is imported without a recipe and says why. Any category can be fetched as a collection: a recipe that selects every matching archive member with `members` (by path, by the extensions its name ends with, or by a regular expression its whole path matches) resolves to `{ meta, instances }`, where each instance is a document of the entry's category under the path of the member it came from, the schema derived from the category's own, so a category needs nothing of its own to be collected. The parser reads each member, the crosswalk is applied to each, and a member that does not parse or does not validate fails the fetch and is named. Instance files are read by one parser per format (Solomon and TOPTW time window files, Chao team orienteering files, TSPLIB style orienteering files, VRP-REP XML, VeRoLog 2019 files and customer point lists), which gives each node the columns the file has and each instance a header of its own; a curation says which of them fill the `tasks/v1` node's fields, which pass through under their own names and which are dropped, so what an entry leaves out is written down, and a source whose time quantities are not seconds keeps them under the source's names with the unit recorded as the entry's `timeUnit`. A new category starts by defining its target schema in `src/targets/` and registering it in the category registry; an entry cannot name a category that does not exist. The statically generated site renders every entry with schema.org Dataset JSON-LD, so the catalogue surfaces in the dataset discovery layers.
 
 ## Licensing
 

package/dist/{bundled-CRr7GPD3.js → bundled-U2l4WT5T.js}

@@ -523,11 +523,24 @@ const CollectionArchiveSchema = z.object({
 		sheets: MemberPatternSchema.optional()
 	}).strict().optional()
 }).strict();
-/** How a member that is itself an archive unpacks into the file the parser reads: gunzipped, or one member of it selected. It nests one level, which is as deep as any source in the catalogue goes. */
-const InnerArchiveSchema = z.union([z.object({ kind: z.literal("gzip") }).strict(), z.object({
-	kind: FileArchiveKindSchema,
-	member: ArchiveMemberSchema
-}).strict()]);
+/** A spreadsheet read as the CSV of one of its sheets (the sheet's name, as the workbook gives it): an Excel workbook (`xlsx`), a legacy binary Excel 97 to 2003 workbook (`xls`, BIFF8) or an OpenDocument spreadsheet (`ods`, whose sheets are its tables). The three give the same text for the same cells. */
+const SheetArchiveSchema = z.object({
+	kind: z.enum([
+		"xlsx",
+		"xls",
+		"ods"
+	]),
+	sheet: z.string().min(1)
+}).strict();
+/** How a member that is itself an archive unpacks into the file the parser reads: gunzipped, one member of it selected, or one sheet of it read when it is a spreadsheet. It nests one level, which is as deep as any source in the catalogue goes. */
+const InnerArchiveSchema = z.union([
+	z.object({ kind: z.literal("gzip") }).strict(),
+	z.object({
+		kind: FileArchiveKindSchema,
+		member: ArchiveMemberSchema
+	}).strict(),
+	SheetArchiveSchema
+]);
 /** The name of a part of a document read from several files, which the parser gives its meaning: the split a triples file holds (`train`, `valid`, `test`), or which of an HGB dataset's files it is (`nodes`, `links`). */
 const PartNameSchema = z.string().regex(/^[a-z][a-z0-9]*$/, { message: "must be a lowercase name of letters and digits, such as train" });
 /** An archive one document is read from several files of: each part names the one member it is read from, and the parser reads the parts together in the order given. */
@@ -538,7 +551,7 @@ const PartsArchiveSchema = z.object({
 		member: ArchiveMemberSchema
 	}).strict()).min(1).refine((parts) => new Set(parts.map((part) => part.name)).size === parts.length, { message: "each part must have its own name" })
 }).strict();
-/** How the downloaded bytes unpack into the file the parser reads, the named files a parser reads together into one document (`parts`), or for a collection the files it reads one by one. A `members` selector gives every member it matches, at least one, in path order. `gzip` and `bzip2` are one compressed file, and `tar.gz` and `tar.bz2` a tar archive compressed with them. A member that is an archive in its turn (a contest bundle that ships its problems as a zip inside the zip) is unpacked by `inner`. A workbook (`xlsx`) is read as the CSV of its named sheet, with dates as ISO 8601 text, for the `csv-table` parser. A point shapefile (`shapefile`) is a zip whose `member` selects the `.shp`, read with the `.dbf`, `.prj` and `.cpg` of the same name beside it as the CSV of its attribute table with each point's stored coordinates and its WGS84 position, for the `csv-table` parser. */
+/** How the downloaded bytes unpack into the file the parser reads, the named files a parser reads together into one document (`parts`), or for a collection the files it reads one by one. A `members` selector gives every member it matches, at least one, in path order. `gzip` and `bzip2` are one compressed file, and `tar.gz` and `tar.bz2` a tar archive compressed with them. A member that is an archive in its turn (a contest bundle that ships its problems as a zip inside the zip, a spreadsheet inside a zip) is unpacked by `inner`. A spreadsheet (`xlsx`, `xls` or `ods`) is read as the CSV of its named sheet, with dates as ISO 8601 text, for the `csv-table` or `edge-list` parser. A point shapefile (`shapefile`) is a zip whose `member` selects the `.shp`, read with the `.dbf`, `.prj` and `.cpg` of the same name beside it as the CSV of its attribute table with each point's stored coordinates and its WGS84 position, for the `csv-table` parser. */
 const ArchiveSchema = z.union([
 	z.object({ kind: z.literal("none") }).strict(),
 	z.object({ kind: z.literal("gzip") }).strict(),
@@ -550,10 +563,7 @@ const ArchiveSchema = z.union([
 	}).strict(),
 	CollectionArchiveSchema,
 	PartsArchiveSchema,
-	z.object({
-		kind: z.literal("xlsx"),
-		sheet: z.string().min(1)
-	}).strict(),
+	SheetArchiveSchema,
 	z.object({
 		kind: z.literal("shapefile"),
 		member: ArchiveMemberSchema
@@ -579,10 +589,22 @@ const ParserSchema = z.discriminatedUnion("format", [
 		skipLines: z.int().min(0),
 		commentPrefixes: z.array(z.string().min(1)),
 		sourceColumn: ColumnSchema,
-		targetColumn: ColumnSchema
+		targetColumn: ColumnSchema,
+		/** Keep only the lines whose `column` holds one of `values`, so a table that lists several relations side by side (a connectome's synapse types) gives the graph of the ones named. */
+		keep: z.object({
+			column: ColumnSchema,
+			values: z.array(z.string().min(1)).min(1)
+		}).strict().optional(),
+		/** The column holding how many edges a line stands for, a whole number, for a table that lists each pair once with its count; a line that stands for none adds neither an edge nor a node. */
+		multiplicityColumn: ColumnSchema.optional(),
+		/** The table lists every undirected edge twice, once in each direction and with the same multiplicity: each pair's edges are emitted once, in the direction it is first listed, a self-loop's once, and a line whose mirror is missing is an error. graph/v1 records direction in `meta` and never by duplicating edges, so an undirected graph read from such a table needs this. */
+		mirrored: z.literal(true).optional()
 	}).strict().refine((parser) => parser.sourceColumn !== parser.targetColumn, {
 		message: "sourceColumn and targetColumn must differ",
 		path: ["targetColumn"]
+	}).refine((parser) => [parser.keep?.column, parser.multiplicityColumn].every((column) => column === void 0 || column !== parser.sourceColumn && column !== parser.targetColumn), {
+		message: "the keep and multiplicity columns must not be an endpoint column",
+		path: ["keep"]
 	}),
 	z.object({
 		format: z.literal("matrix-market"),
@@ -674,6 +696,10 @@ const ParserSchema = z.discriminatedUnion("format", [
 		format: z.literal("gd-contest"),
 		encoding: EncodingSchema
 	}).strict(),
+	z.object({
+		format: z.literal("witvliet-synapses"),
+		encoding: z.literal("utf-8")
+	}).strict(),
 	z.object({
 		format: z.literal("customer-points"),
 		encoding: EncodingSchema
@@ -1180,7 +1206,7 @@ var catalogue_default = {
 		"id": "keepset",
 		"name": "keepset",
 		"description": "The keepset catalogue: datasets with machine-readable recipes that fetch each one and normalise it into its category's target shape.",
-		"version": "1.28.0",
+		"version": "1.29.0",
 		"repository": "https://github.com/Mearman/keepset",
 		"namespaceAliases": {
 			"networkrepository": ["nr"],
@@ -6451,6 +6477,10 @@ var catalogue_default = {
 				"url": "https://environment.data.gov.uk/dataset/88bed270-d465-11e4-8669-f0def148f590",
 				"retrieved": "2026-10-19",
 				"status": "live"
+			}, {
+				"url": "https://environment.data.gov.uk/api/file/download?fileDataSetId=766cb094-b392-4bd6-a02e-f60e143f3213&fileName=Historic_Flood_Warnings.zip",
+				"retrieved": "2026-10-19",
+				"status": "live"
 			}],
 			"licence": {
 				"kind": "spdx",
@@ -6458,10 +6488,62 @@ var catalogue_default = {
 			},
 			"citations": [],
 			"recipe": {
-				"status": "not-fetchable",
-				"reason": "The download is a zip holding one OpenDocument spreadsheet whose member name changes every quarter, and keepset reads xlsx and not ods."
+				"status": "fetchable",
+				"source": 1,
+				"archive": {
+					"kind": "zip",
+					"member": { "extensions": [".ods"] },
+					"inner": {
+						"kind": "ods",
+						"sheet": "tblAllData"
+					}
+				},
+				"parser": {
+					"format": "csv-table",
+					"encoding": "utf-8",
+					"delimiter": "comma",
+					"skipLines": 0,
+					"idColumn": null,
+					"numericColumns": [],
+					"columns": [
+						"DATE",
+						"TYPE",
+						"AREA"
+					]
+				}
+			},
+			"crosswalk": {
+				"source": "csv-table",
+				"target": "tasks/v1",
+				"rules": [
+					{
+						"op": "move",
+						"from": "meta",
+						"to": "meta"
+					},
+					{
+						"op": "move",
+						"from": "nodes[].id",
+						"to": "nodes[].id"
+					},
+					{
+						"op": "move",
+						"from": "nodes[].DATE",
+						"to": "nodes[].opened"
+					},
+					{
+						"op": "move",
+						"from": "nodes[].TYPE",
+						"to": "nodes[].status"
+					},
+					{
+						"op": "move",
+						"from": "nodes[].AREA",
+						"to": "nodes[].territory"
+					}
+				],
+				"oneWay": []
 			},
-			"crosswalk": { "file": "crosswalks/tasks-v1/nodes.json" },
 			"expectedCounts": {},
 			"properties": { "surveyId": "or-120" }
 		},
@@ -8470,6 +8552,10 @@ var catalogue_default = {
 				"url": "https://github.com/Oberfichtner/Clustering_and_TSP_with_R",
 				"retrieved": "2026-10-19",
 				"status": "live"
+			}, {
+				"url": "https://raw.githubusercontent.com/Oberfichtner/Clustering_and_TSP_with_R/main/rawdataclear.xls",
+				"retrieved": "2026-10-19",
+				"status": "live"
 			}],
 			"licence": { "kind": "unrecorded" },
 			"citations": [{
@@ -8477,11 +8563,56 @@ var catalogue_default = {
 				"doi": "10.1007/s10479-022-04883-1"
 			}],
 			"recipe": {
-				"status": "not-fetchable",
-				"reason": "The only data file is an old binary xls workbook, and keepset reads only xlsx."
+				"status": "fetchable",
+				"source": 1,
+				"archive": {
+					"kind": "xls",
+					"sheet": "objects"
+				},
+				"parser": {
+					"format": "csv-table",
+					"encoding": "utf-8",
+					"delimiter": "comma",
+					"skipLines": 0,
+					"idColumn": null,
+					"numericColumns": [{
+						"column": "LATITUDE",
+						"factor": 1
+					}, {
+						"column": "LONGITUDE",
+						"factor": 1
+					}],
+					"columns": ["LATITUDE", "LONGITUDE"]
+				}
 			},
-			"crosswalk": { "file": "crosswalks/tasks-v1/nodes.json" },
-			"expectedCounts": {},
+			"crosswalk": {
+				"source": "csv-table",
+				"target": "tasks/v1",
+				"rules": [
+					{
+						"op": "move",
+						"from": "meta",
+						"to": "meta"
+					},
+					{
+						"op": "move",
+						"from": "nodes[].id",
+						"to": "nodes[].id"
+					},
+					{
+						"op": "move",
+						"from": "nodes[].LATITUDE",
+						"to": "nodes[].lat"
+					},
+					{
+						"op": "move",
+						"from": "nodes[].LONGITUDE",
+						"to": "nodes[].lon"
+					}
+				],
+				"oneWay": []
+			},
+			"expectedCounts": { "nodes": 237 },
 			"properties": { "surveyId": "or-38" }
 		},
 		{
@@ -63378,18 +63509,39 @@ var catalogue_default = {
 			"sources": [{
 				"url": "https://www.wormatlas.org/images/NeuronConnect.xls",
 				"retrieved": "2026-04-20",
-				"status": "live"
+				"status": "dead",
+				"snapshot": {
+					"url": "https://web.archive.org/web/20260829213511/https://www.wormatlas.org/images/NeuronConnect.xls",
+					"timestamp": "20260829213511"
+				}
 			}],
 			"licence": { "kind": "unrecorded" },
 			"citations": [{ "text": "White, J. G., Southgate, E., Thomson, J. N., Brenner, S. (1986). The Structure of the Nervous System of the Nematode Caenorhabditis elegans. Phil. Trans. R. Soc. Lond. B 314, 1-340." }],
 			"recipe": {
-				"status": "not-fetchable",
-				"reason": "no download is in a form keepset reads yet (xls: format xls has a pipeline-specific parser with no declarative keepset form yet)"
+				"status": "fetchable",
+				"source": 0,
+				"archive": {
+					"kind": "xls",
+					"sheet": "NeuronConnect.csv"
+				},
+				"parser": {
+					"format": "edge-list",
+					"encoding": "utf-8",
+					"delimiter": "comma",
+					"skipLines": 1,
+					"commentPrefixes": [],
+					"sourceColumn": 0,
+					"targetColumn": 1,
+					"keep": {
+						"column": 2,
+						"values": ["S", "Sp"]
+					}
+				}
 			},
 			"crosswalk": { "file": "crosswalks/graph-v1/topology.json" },
 			"expectedCounts": {
-				"edges": 5233,
-				"nodes": 281
+				"edges": 2575,
+				"nodes": 279
 			},
 			"properties": {
 				"directed": true,
@@ -63412,18 +63564,39 @@ var catalogue_default = {
 			"sources": [{
 				"url": "https://www.wormatlas.org/images/NeuronConnect.xls",
 				"retrieved": "2026-04-20",
-				"status": "live"
+				"status": "dead",
+				"snapshot": {
+					"url": "https://web.archive.org/web/20260829213511/https://www.wormatlas.org/images/NeuronConnect.xls",
+					"timestamp": "20260829213511"
+				}
 			}],
 			"licence": { "kind": "unrecorded" },
 			"citations": [{ "text": "White, J. G., Southgate, E., Thomson, J. N., Brenner, S. (1986). The Structure of the Nervous System of the Nematode Caenorhabditis elegans. Phil. Trans. R. Soc. Lond. B 314, 1-340." }],
 			"recipe": {
-				"status": "not-fetchable",
-				"reason": "no download is in a form keepset reads yet (xls: format xls has a pipeline-specific parser with no declarative keepset form yet)"
+				"status": "fetchable",
+				"source": 0,
+				"archive": {
+					"kind": "xls",
+					"sheet": "NeuronConnect.csv"
+				},
+				"parser": {
+					"format": "edge-list",
+					"encoding": "utf-8",
+					"delimiter": "comma",
+					"skipLines": 1,
+					"commentPrefixes": [],
+					"sourceColumn": 0,
+					"targetColumn": 1,
+					"keep": {
+						"column": 2,
+						"values": ["S", "Sp"]
+					}
+				}
 			},
 			"crosswalk": { "file": "crosswalks/graph-v1/topology.json" },
 			"expectedCounts": {
-				"edges": 5233,
-				"nodes": 281
+				"edges": 2575,
+				"nodes": 279
 			},
 			"properties": {
 				"directed": false,
@@ -63446,18 +63619,39 @@ var catalogue_default = {
 			"sources": [{
 				"url": "https://www.wormatlas.org/images/NeuronConnect.xls",
 				"retrieved": "2026-04-20",
-				"status": "live"
+				"status": "dead",
+				"snapshot": {
+					"url": "https://web.archive.org/web/20260829213511/https://www.wormatlas.org/images/NeuronConnect.xls",
+					"timestamp": "20260829213511"
+				}
 			}],
 			"licence": { "kind": "unrecorded" },
 			"citations": [{ "text": "White, J. G., Southgate, E., Thomson, J. N., Brenner, S. (1986). The Structure of the Nervous System of the Nematode Caenorhabditis elegans. Phil. Trans. R. Soc. Lond. B 314, 1-340." }],
 			"recipe": {
-				"status": "not-fetchable",
-				"reason": "no download is in a form keepset reads yet (xls: format xls has a pipeline-specific parser with no declarative keepset form yet)"
+				"status": "fetchable",
+				"source": 0,
+				"archive": {
+					"kind": "xls",
+					"sheet": "NeuronConnect.csv"
+				},
+				"parser": {
+					"format": "edge-list",
+					"encoding": "utf-8",
+					"delimiter": "comma",
+					"skipLines": 1,
+					"commentPrefixes": [],
+					"sourceColumn": 0,
+					"targetColumn": 1,
+					"keep": {
+						"column": 2,
+						"values": ["S", "Sp"]
+					}
+				}
 			},
 			"crosswalk": { "file": "crosswalks/graph-v1/topology.json" },
 			"expectedCounts": {
-				"edges": 5233,
-				"nodes": 281
+				"edges": 2575,
+				"nodes": 279
 			},
 			"properties": {
 				"directed": true,
@@ -63480,18 +63674,40 @@ var catalogue_default = {
 			"sources": [{
 				"url": "https://www.wormatlas.org/images/NeuronConnect.xls",
 				"retrieved": "2026-04-20",
-				"status": "live"
+				"status": "dead",
+				"snapshot": {
+					"url": "https://web.archive.org/web/20260829213511/https://www.wormatlas.org/images/NeuronConnect.xls",
+					"timestamp": "20260829213511"
+				}
 			}],
 			"licence": { "kind": "unrecorded" },
 			"citations": [{ "text": "White, J. G., Southgate, E., Thomson, J. N., Brenner, S. (1986). The Structure of the Nervous System of the Nematode Caenorhabditis elegans. Phil. Trans. R. Soc. Lond. B 314, 1-340." }],
 			"recipe": {
-				"status": "not-fetchable",
-				"reason": "no download is in a form keepset reads yet (xls: format xls has a pipeline-specific parser with no declarative keepset form yet)"
+				"status": "fetchable",
+				"source": 0,
+				"archive": {
+					"kind": "xls",
+					"sheet": "NeuronConnect.csv"
+				},
+				"parser": {
+					"format": "edge-list",
+					"encoding": "utf-8",
+					"delimiter": "comma",
+					"skipLines": 1,
+					"commentPrefixes": [],
+					"sourceColumn": 0,
+					"targetColumn": 1,
+					"keep": {
+						"column": 2,
+						"values": ["S", "Sp"]
+					},
+					"multiplicityColumn": 3
+				}
 			},
 			"crosswalk": { "file": "crosswalks/graph-v1/topology.json" },
 			"expectedCounts": {
-				"edges": 5233,
-				"nodes": 281
+				"edges": 6394,
+				"nodes": 279
 			},
 			"properties": {
 				"directed": true,
@@ -63514,18 +63730,44 @@ var catalogue_default = {
 			"sources": [{
 				"url": "https://www.wormatlas.org/images/NeuronConnect.xls",
 				"retrieved": "2026-04-20",
-				"status": "live"
+				"status": "dead",
+				"snapshot": {
+					"url": "https://web.archive.org/web/20260829213511/https://www.wormatlas.org/images/NeuronConnect.xls",
+					"timestamp": "20260829213511"
+				}
 			}],
 			"licence": { "kind": "unrecorded" },
 			"citations": [{ "text": "White, J. G., Southgate, E., Thomson, J. N., Brenner, S. (1986). The Structure of the Nervous System of the Nematode Caenorhabditis elegans. Phil. Trans. R. Soc. Lond. B 314, 1-340." }],
 			"recipe": {
-				"status": "not-fetchable",
-				"reason": "no download is in a form keepset reads yet (xls: format xls has a pipeline-specific parser with no declarative keepset form yet)"
+				"status": "fetchable",
+				"source": 0,
+				"archive": {
+					"kind": "xls",
+					"sheet": "NeuronConnect.csv"
+				},
+				"parser": {
+					"format": "edge-list",
+					"encoding": "utf-8",
+					"delimiter": "comma",
+					"skipLines": 1,
+					"commentPrefixes": [],
+					"sourceColumn": 0,
+					"targetColumn": 1,
+					"keep": {
+						"column": 2,
+						"values": [
+							"S",
+							"Sp",
+							"EJ",
+							"NMJ"
+						]
+					}
+				}
 			},
 			"crosswalk": { "file": "crosswalks/graph-v1/topology.json" },
 			"expectedCounts": {
-				"edges": 6417,
-				"nodes": 283
+				"edges": 3759,
+				"nodes": 281
 			},
 			"properties": {
 				"directed": true,
@@ -63548,17 +63790,39 @@ var catalogue_default = {
 			"sources": [{
 				"url": "https://www.wormatlas.org/images/NeuronConnect.xls",
 				"retrieved": "2026-04-20",
-				"status": "live"
+				"status": "dead",
+				"snapshot": {
+					"url": "https://web.archive.org/web/20260829213511/https://www.wormatlas.org/images/NeuronConnect.xls",
+					"timestamp": "20260829213511"
+				}
 			}],
 			"licence": { "kind": "unrecorded" },
 			"citations": [{ "text": "White, J. G., Southgate, E., Thomson, J. N., Brenner, S. (1986). The Structure of the Nervous System of the Nematode Caenorhabditis elegans. Phil. Trans. R. Soc. Lond. B 314, 1-340." }],
 			"recipe": {
-				"status": "not-fetchable",
-				"reason": "no download is in a form keepset reads yet (xls: format xls has a pipeline-specific parser with no declarative keepset form yet)"
+				"status": "fetchable",
+				"source": 0,
+				"archive": {
+					"kind": "xls",
+					"sheet": "NeuronConnect.csv"
+				},
+				"parser": {
+					"format": "edge-list",
+					"encoding": "utf-8",
+					"delimiter": "comma",
+					"skipLines": 1,
+					"commentPrefixes": [],
+					"sourceColumn": 0,
+					"targetColumn": 1,
+					"keep": {
+						"column": 2,
+						"values": ["EJ"]
+					},
+					"mirrored": true
+				}
 			},
 			"crosswalk": { "file": "crosswalks/graph-v1/topology.json" },
 			"expectedCounts": {
-				"edges": 1031,
+				"edges": 517,
 				"nodes": 253
 			},
 			"properties": {
@@ -63591,12 +63855,25 @@ var catalogue_default = {
 			"licence": { "kind": "unrecorded" },
 			"citations": [{ "text": "Bumbarger, Daniel J., Sommer, Ralf J. (2013). System-wide rewiring underlies behavioral differences in predatory and bacterial-feeding nematodes. Cell 152(1), 109-119." }],
 			"recipe": {
-				"status": "not-fetchable",
-				"reason": "no download is in a form keepset reads yet (bumbarger-consensus: format bumbarger-consensus has a pipeline-specific parser with no declarative keepset form yet)"
+				"status": "fetchable",
+				"source": 0,
+				"archive": {
+					"kind": "xlsx",
+					"sheet": "Sheet1"
+				},
+				"parser": {
+					"format": "edge-list",
+					"encoding": "utf-8",
+					"delimiter": "comma",
+					"skipLines": 2,
+					"commentPrefixes": [],
+					"sourceColumn": 0,
+					"targetColumn": 1
+				}
 			},
 			"crosswalk": { "file": "crosswalks/graph-v1/topology.json" },
 			"expectedCounts": {
-				"edges": 533,
+				"edges": 78,
 				"nodes": 29
 			},
 			"properties": {
@@ -63626,7 +63903,7 @@ var catalogue_default = {
 			"citations": [{ "text": "Witvliet, Daniel, et al. (2020). Connectomes across development reveal principles of brain maturation. Nature." }],
 			"recipe": {
 				"status": "not-fetchable",
-				"reason": "no download is in a form keepset reads yet (witvliet-json: format witvliet-json has a pipeline-specific parser with no declarative keepset form yet)"
+				"reason": "the graph joins the specimen's chemical synapse file with its gap junction file (Dataset1_gapjunctions.json beside it), and a recipe reads one download"
 			},
 			"crosswalk": { "file": "crosswalks/graph-v1/topology.json" },
 			"expectedCounts": {
@@ -63659,8 +63936,13 @@ var catalogue_default = {
 			"licence": { "kind": "unrecorded" },
 			"citations": [{ "text": "Witvliet, Daniel, Mulcahy, Ben, Mitchell, James K., Meirovitch, Yaron, Bender, Andrew, Garrett, Miranda, Holmyard, Dianne, Schwarz, Kathryn, Ackerman, David G., Bhatt, Dhaval S., Bhatt, Bharti, Bhatt, Heena, Bhatt, Gauri, Bhatt, Rajni, Bhatt, Arushi, Bhatt, Tanya, Bhatt, Prateek, Bhatt, Sanskriti, Bhatt, Ananya, Bhatt, Aanya (2020). Connectomes across development reveal principles of brain maturation. Nature." }],
 			"recipe": {
-				"status": "not-fetchable",
-				"reason": "no download is in a form keepset reads yet (witvliet-json: format witvliet-json has a pipeline-specific parser with no declarative keepset form yet)"
+				"status": "fetchable",
+				"source": 0,
+				"archive": { "kind": "none" },
+				"parser": {
+					"format": "witvliet-synapses",
+					"encoding": "utf-8"
+				}
 			},
 			"crosswalk": { "file": "crosswalks/graph-v1/topology.json" },
 			"expectedCounts": {
@@ -63694,7 +63976,7 @@ var catalogue_default = {
 			"citations": [{ "text": "Witvliet, Daniel, et al. (2020). Connectomes across development reveal principles of brain maturation. Nature." }],
 			"recipe": {
 				"status": "not-fetchable",
-				"reason": "no download is in a form keepset reads yet (witvliet-json: format witvliet-json has a pipeline-specific parser with no declarative keepset form yet)"
+				"reason": "the graph joins the specimen's chemical synapse file with its gap junction file (Dataset4_gapjunctions.json beside it), and a recipe reads one download"
 			},
 			"crosswalk": { "file": "crosswalks/graph-v1/topology.json" },
 			"expectedCounts": {
@@ -63727,8 +64009,13 @@ var catalogue_default = {
 			"licence": { "kind": "unrecorded" },
 			"citations": [{ "text": "Witvliet, Daniel, et al. (2020). Connectomes across development reveal principles of brain maturation. Nature." }],
 			"recipe": {
-				"status": "not-fetchable",
-				"reason": "no download is in a form keepset reads yet (witvliet-json: format witvliet-json has a pipeline-specific parser with no declarative keepset form yet)"
+				"status": "fetchable",
+				"source": 0,
+				"archive": { "kind": "none" },
+				"parser": {
+					"format": "witvliet-synapses",
+					"encoding": "utf-8"
+				}
 			},
 			"crosswalk": { "file": "crosswalks/graph-v1/topology.json" },
 			"expectedCounts": {
@@ -63761,8 +64048,13 @@ var catalogue_default = {
 			"licence": { "kind": "unrecorded" },
 			"citations": [{ "text": "Witvliet, Daniel, et al. (2020). Connectomes across development reveal principles of brain maturation. Nature." }],
 			"recipe": {
-				"status": "not-fetchable",
-				"reason": "no download is in a form keepset reads yet (witvliet-json: format witvliet-json has a pipeline-specific parser with no declarative keepset form yet)"
+				"status": "fetchable",
+				"source": 0,
+				"archive": { "kind": "none" },
+				"parser": {
+					"format": "witvliet-synapses",
+					"encoding": "utf-8"
+				}
 			},
 			"crosswalk": { "file": "crosswalks/graph-v1/topology.json" },
 			"expectedCounts": {
@@ -63795,8 +64087,13 @@ var catalogue_default = {
 			"licence": { "kind": "unrecorded" },
 			"citations": [{ "text": "Witvliet, Daniel, et al. (2020). Connectomes across development reveal principles of brain maturation. Nature." }],
 			"recipe": {
-				"status": "not-fetchable",
-				"reason": "no download is in a form keepset reads yet (witvliet-json: format witvliet-json has a pipeline-specific parser with no declarative keepset form yet)"
+				"status": "fetchable",
+				"source": 0,
+				"archive": { "kind": "none" },
+				"parser": {
+					"format": "witvliet-synapses",
+					"encoding": "utf-8"
+				}
 			},
 			"crosswalk": { "file": "crosswalks/graph-v1/topology.json" },
 			"expectedCounts": {