data-analyst-mcp 0.3.0 → 0.4.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +286 -262
- package/dist/adapters/bjs.d.ts +13 -0
- package/dist/adapters/bjs.js +28 -0
- package/dist/adapters/bjs.js.map +1 -0
- package/dist/adapters/cbp.d.ts +5 -0
- package/dist/adapters/cbp.js +64 -0
- package/dist/adapters/cbp.js.map +1 -0
- package/dist/adapters/cdc-wonder.d.ts +5 -0
- package/dist/adapters/cdc-wonder.js +68 -0
- package/dist/adapters/cdc-wonder.js.map +1 -0
- package/dist/adapters/cpsc.d.ts +4 -0
- package/dist/adapters/cpsc.js +125 -0
- package/dist/adapters/cpsc.js.map +1 -0
- package/dist/adapters/fhwa.d.ts +9 -0
- package/dist/adapters/fhwa.js +16 -0
- package/dist/adapters/fhwa.js.map +1 -0
- package/dist/adapters/foreign-assistance.d.ts +9 -0
- package/dist/adapters/foreign-assistance.js +42 -0
- package/dist/adapters/foreign-assistance.js.map +1 -0
- package/dist/adapters/hud-ahar.d.ts +3 -0
- package/dist/adapters/hud-ahar.js +80 -0
- package/dist/adapters/hud-ahar.js.map +1 -0
- package/dist/adapters/nces.d.ts +10 -0
- package/dist/adapters/nces.js +32 -0
- package/dist/adapters/nces.js.map +1 -0
- package/dist/adapters/nsf.d.ts +11 -0
- package/dist/adapters/nsf.js +25 -0
- package/dist/adapters/nsf.js.map +1 -0
- package/dist/adapters/onrr.d.ts +9 -0
- package/dist/adapters/onrr.js +35 -0
- package/dist/adapters/onrr.js.map +1 -0
- package/dist/adapters/sba.d.ts +10 -0
- package/dist/adapters/sba.js +134 -0
- package/dist/adapters/sba.js.map +1 -0
- package/dist/adapters/treasury-tic.d.ts +30 -0
- package/dist/adapters/treasury-tic.js +149 -0
- package/dist/adapters/treasury-tic.js.map +1 -0
- package/dist/adapters/uscourts.d.ts +8 -0
- package/dist/adapters/uscourts.js +8 -0
- package/dist/adapters/uscourts.js.map +1 -0
- package/dist/analysis/cite.d.ts +9 -1
- package/dist/analysis/cite.js +9 -2
- package/dist/analysis/cite.js.map +1 -1
- package/dist/bin/cli.d.ts +2 -0
- package/dist/bin/cli.js +17 -0
- package/dist/bin/cli.js.map +1 -1
- package/dist/core/generic-rest.js +42 -17
- package/dist/core/generic-rest.js.map +1 -1
- package/dist/core/guard.d.ts +32 -0
- package/dist/core/guard.js +176 -0
- package/dist/core/guard.js.map +1 -0
- package/dist/core/http.d.ts +10 -0
- package/dist/core/http.js +36 -7
- package/dist/core/http.js.map +1 -1
- package/dist/core/keys.d.ts +13 -3
- package/dist/core/keys.js +67 -7
- package/dist/core/keys.js.map +1 -1
- package/dist/core/package.d.ts +12 -3
- package/dist/core/package.js +56 -12
- package/dist/core/package.js.map +1 -1
- package/dist/core/secret_patterns.d.ts +6 -0
- package/dist/core/secret_patterns.js +20 -0
- package/dist/core/secret_patterns.js.map +1 -0
- package/dist/core/tabular.d.ts +43 -1
- package/dist/core/tabular.js +149 -6
- package/dist/core/tabular.js.map +1 -1
- package/dist/envelope.js +3 -1
- package/dist/envelope.js.map +1 -1
- package/dist/index.d.ts +29 -22
- package/dist/index.js +45 -46
- package/dist/index.js.map +1 -1
- package/dist/remote/app.js +87 -31
- package/dist/remote/app.js.map +1 -1
- package/dist/remote/oauth.js +8 -1
- package/dist/remote/oauth.js.map +1 -1
- package/dist/remote/pages.d.ts +3 -7
- package/dist/remote/pages.js +49 -19
- package/dist/remote/pages.js.map +1 -1
- package/dist/remote/sign.d.ts +7 -1
- package/dist/remote/sign.js +33 -7
- package/dist/remote/sign.js.map +1 -1
- package/dist/remote/store.js +14 -5
- package/dist/remote/store.js.map +1 -1
- package/dist/report/audit_report.js +29 -7
- package/dist/report/audit_report.js.map +1 -1
- package/dist/report/build_report.js +34 -4
- package/dist/report/build_report.js.map +1 -1
- package/dist/report/method_audit.js +10 -1
- package/dist/report/method_audit.js.map +1 -1
- package/dist/report/scan_secrets.d.ts +4 -1
- package/dist/report/scan_secrets.js +38 -18
- package/dist/report/scan_secrets.js.map +1 -1
- package/dist/server.d.ts +3 -1
- package/dist/server.js +46 -13
- package/dist/server.js.map +1 -1
- package/dist/tools.js +27 -6
- package/dist/tools.js.map +1 -1
- package/guide/WORKFLOW.md +134 -134
- package/guide/assets/disclaimer.txt +1 -1
- package/guide/assets/download_data.ps1 +164 -162
- package/guide/assets/download_data.sh +8 -2
- package/guide/assets/report_template.html +597 -597
- package/guide/references/routing.md +198 -171
- package/guide/references/style_guide.md +398 -398
- package/package.json +56 -56
- package/packs/acf/endpoints.json +114 -114
- package/packs/acf/policy.json +104 -104
- package/packs/actuaries/endpoints.json +82 -82
- package/packs/actuaries/policy.json +109 -109
- package/packs/bea/assets/download_bea.ps1 +182 -182
- package/packs/bea/docs/bea_api.md +461 -461
- package/packs/bea/docs/datasets.md +157 -157
- package/packs/bea/docs/report_patterns.md +112 -112
- package/packs/bea/policy.json +170 -170
- package/packs/bea/source.md +152 -152
- package/packs/bjs/endpoints.json +150 -0
- package/packs/bjs/policy.json +114 -0
- package/packs/bjs/source.md +98 -0
- package/packs/bls/assets/download_bls.ps1 +152 -152
- package/packs/bls/docs/analysis_patterns.md +108 -108
- package/packs/bls/docs/bls_api.md +73 -73
- package/packs/bls/docs/series_ids.md +149 -149
- package/packs/bls/policy.json +238 -238
- package/packs/bts/endpoints.json +346 -346
- package/packs/bts/policy.json +94 -94
- package/packs/cbp/endpoints.json +31 -0
- package/packs/cbp/policy.json +85 -0
- package/packs/cbp/source.md +57 -0
- package/packs/cdc/endpoints.json +197 -197
- package/packs/cdc/policy.json +83 -83
- package/packs/cdc/source.md +1 -1
- package/packs/cdc-wonder/endpoints.json +26 -0
- package/packs/cdc-wonder/policy.json +84 -0
- package/packs/cdc-wonder/source.md +53 -0
- package/packs/census/endpoints.json +99 -99
- package/packs/cfpb/endpoints.json +326 -326
- package/packs/cfpb/policy.json +119 -119
- package/packs/clinical-trials/endpoints.json +166 -166
- package/packs/clinical-trials/policy.json +84 -84
- package/packs/cms/endpoints.json +69 -69
- package/packs/cms/policy.json +96 -96
- package/packs/college-scorecard/endpoints.json +252 -252
- package/packs/college-scorecard/policy.json +106 -106
- package/packs/college-scorecard/source.md +1 -1
- package/packs/congress/endpoints.json +1701 -1701
- package/packs/congress/policy.json +117 -117
- package/packs/cpsc/endpoints.json +91 -0
- package/packs/cpsc/policy.json +91 -0
- package/packs/cpsc/source.md +76 -0
- package/packs/dhs-ohss/endpoints.json +66 -66
- package/packs/dhs-ohss/policy.json +107 -107
- package/packs/dhs-ohss/source.md +1 -1
- package/packs/doj-news/endpoints.json +59 -59
- package/packs/doj-news/policy.json +96 -96
- package/packs/doj-news/source.md +1 -1
- package/packs/dol/endpoints.json +817 -817
- package/packs/dol/policy.json +135 -135
- package/packs/eia/endpoints.json +717 -717
- package/packs/eia/policy.json +112 -112
- package/packs/epa/endpoints.json +291 -291
- package/packs/epa/policy.json +99 -99
- package/packs/epa-aqs/endpoints.json +173 -173
- package/packs/epa-aqs/policy.json +96 -96
- package/packs/fbi/endpoints.json +1841 -1841
- package/packs/fbi/policy.json +118 -118
- package/packs/fbi/source.md +3 -3
- package/packs/fda/endpoints.json +237 -237
- package/packs/fda/policy.json +121 -121
- package/packs/fdic/endpoints.json +416 -416
- package/packs/fdic/policy.json +83 -83
- package/packs/fec/endpoints.json +707 -707
- package/packs/fec/policy.json +93 -93
- package/packs/fed-board/endpoints.json +89 -89
- package/packs/fed-board/policy.json +136 -136
- package/packs/federal-register/endpoints.json +143 -143
- package/packs/federal-register/policy.json +86 -86
- package/packs/fema/endpoints.json +645 -645
- package/packs/fema/policy.json +103 -103
- package/packs/fhfa/endpoints.json +105 -105
- package/packs/fhfa/policy.json +109 -109
- package/packs/fhwa/endpoints.json +48 -0
- package/packs/fhwa/policy.json +91 -0
- package/packs/fhwa/source.md +59 -0
- package/packs/foreign-assistance/endpoints.json +166 -0
- package/packs/foreign-assistance/policy.json +80 -0
- package/packs/foreign-assistance/source.md +76 -0
- package/packs/fred/assets/download_fred.ps1 +122 -122
- package/packs/fred/docs/analysis_patterns.md +124 -124
- package/packs/fred/docs/fred_api.md +94 -94
- package/packs/fred/docs/series.md +188 -188
- package/packs/fred/policy.json +253 -253
- package/packs/fsa/endpoints.json +150 -150
- package/packs/fsa/policy.json +99 -99
- package/packs/fsa/source.md +1 -1
- package/packs/govinfo/endpoints.json +519 -519
- package/packs/gsa-calc/endpoints.json +93 -93
- package/packs/gsa-calc/policy.json +97 -97
- package/packs/hud/endpoints.json +146 -146
- package/packs/hud/policy.json +84 -84
- package/packs/hud/source.md +1 -1
- package/packs/hud-ahar/endpoints.json +92 -0
- package/packs/hud-ahar/policy.json +88 -0
- package/packs/hud-ahar/source.md +72 -0
- package/packs/ipums/docs/report_patterns.md +117 -117
- package/packs/irs-soi/endpoints.json +114 -114
- package/packs/irs-soi/policy.json +107 -107
- package/packs/medicaid/endpoints.json +412 -412
- package/packs/medicaid/policy.json +108 -108
- package/packs/naep/endpoints.json +217 -217
- package/packs/naep/policy.json +100 -100
- package/packs/naep/source.md +1 -1
- package/packs/nces/endpoints.json +101 -0
- package/packs/nces/policy.json +99 -0
- package/packs/nces/source.md +75 -0
- package/packs/nhtsa/endpoints.json +132 -132
- package/packs/nhtsa/policy.json +93 -93
- package/packs/nhtsa/source.md +1 -1
- package/packs/nih/endpoints.json +452 -452
- package/packs/nih/policy.json +86 -86
- package/packs/noaa/endpoints.json +431 -431
- package/packs/noaa/policy.json +95 -95
- package/packs/nrel/endpoints.json +327 -327
- package/packs/nrel/policy.json +96 -96
- package/packs/nsf/endpoints.json +33 -0
- package/packs/nsf/policy.json +83 -0
- package/packs/nsf/source.md +59 -0
- package/packs/nws/endpoints.json +271 -271
- package/packs/nws/policy.json +82 -82
- package/packs/nyfed/endpoints.json +80 -80
- package/packs/nyfed/policy.json +92 -92
- package/packs/omb/endpoints.json +460 -460
- package/packs/omb/policy.json +106 -106
- package/packs/onrr/endpoints.json +198 -0
- package/packs/onrr/policy.json +91 -0
- package/packs/onrr/source.md +55 -0
- package/packs/open-payments/endpoints.json +297 -297
- package/packs/open-payments/policy.json +101 -101
- package/packs/opm/assets/download_opm.ps1 +125 -125
- package/packs/opm/docs/fields.md +184 -184
- package/packs/opm/docs/opm_api.md +71 -71
- package/packs/opm/docs/report_patterns.md +83 -83
- package/packs/opm/lib/data_dictionary.csv +73 -73
- package/packs/pbgc/endpoints.json +483 -483
- package/packs/pbgc/policy.json +94 -94
- package/packs/philfed/endpoints.json +85 -85
- package/packs/philfed/policy.json +94 -94
- package/packs/port.json +65 -0
- package/packs/regulations/endpoints.json +287 -287
- package/packs/regulations/policy.json +86 -86
- package/packs/sba/endpoints.json +34 -0
- package/packs/sba/policy.json +86 -0
- package/packs/sba/source.md +60 -0
- package/packs/sec/endpoints.json +236 -236
- package/packs/sec/policy.json +86 -86
- package/packs/senate-lobbying/endpoints.json +553 -553
- package/packs/senate-lobbying/policy.json +99 -99
- package/packs/snapqc/endpoints.json +1426 -1426
- package/packs/snapqc/policy.json +92 -92
- package/packs/treasury/catalog.json +2267 -2267
- package/packs/treasury/docs/api_guide.md +245 -245
- package/packs/treasury/docs/datasets.md +56 -56
- package/packs/treasury/docs/report_patterns.md +126 -126
- package/packs/treasury/policy.json +159 -159
- package/packs/treasury/source.md +170 -165
- package/packs/treasury-tic/endpoints.json +77 -0
- package/packs/treasury-tic/policy.json +89 -0
- package/packs/treasury-tic/source.md +80 -0
- package/packs/treasury-yields/endpoints.json +226 -226
- package/packs/treasury-yields/policy.json +86 -86
- package/packs/usaspending/endpoints.json +1315 -1315
- package/packs/usaspending/policy.json +109 -109
- package/packs/uscourts/endpoints.json +22 -0
- package/packs/uscourts/policy.json +87 -0
- package/packs/uscourts/source.md +56 -0
- package/packs/usda-fna/policy.json +133 -133
- package/packs/usda-fooddata/endpoints.json +180 -180
- package/packs/usda-fooddata/policy.json +94 -94
- package/packs/usda-nass/endpoints.json +323 -323
- package/packs/usda-nass/policy.json +95 -95
- package/packs/usda-outlook/endpoints.json +86 -86
- package/packs/usda-outlook/policy.json +109 -109
- package/packs/usgs/endpoints.json +313 -313
- package/packs/usgs/policy.json +95 -95
- package/packs/usitc/endpoints.json +74 -74
- package/packs/usitc/policy.json +111 -111
- package/packs/uspto/endpoints.json +141 -141
- package/packs/uspto/policy.json +95 -95
- package/packs/uspto/source.md +1 -1
- package/packs/va/endpoints.json +414 -414
- package/packs/va/policy.json +101 -101
- package/packs/world-bank/endpoints.json +122 -122
- package/packs/world-bank/policy.json +101 -101
|
@@ -1,86 +1,86 @@
|
|
|
1
|
-
{
|
|
2
|
-
"id": "regulations",
|
|
3
|
-
"title": "Regulations.gov (API v4)",
|
|
4
|
-
"agency": "General Services Administration (eRulemaking Program), for participating federal agencies",
|
|
5
|
-
"depth": "standard",
|
|
6
|
-
"domains": [
|
|
7
|
-
"legislation",
|
|
8
|
-
"regulation",
|
|
9
|
-
"rulemaking"
|
|
10
|
-
],
|
|
11
|
-
"keywords": [
|
|
12
|
-
"regulations.gov",
|
|
13
|
-
"public comment",
|
|
14
|
-
"public comments",
|
|
15
|
-
"comments",
|
|
16
|
-
"docket",
|
|
17
|
-
"dockets",
|
|
18
|
-
"rulemaking",
|
|
19
|
-
"proposed rule",
|
|
20
|
-
"final rule",
|
|
21
|
-
"comment period",
|
|
22
|
-
"notice and comment",
|
|
23
|
-
"erulemaking"
|
|
24
|
-
],
|
|
25
|
-
"questions": [
|
|
26
|
-
"how many public comments did a proposed rule receive",
|
|
27
|
-
"proposed rules open for comment at EPA",
|
|
28
|
-
"dockets an agency opened this year",
|
|
29
|
-
"comments on a docket over time"
|
|
30
|
-
],
|
|
31
|
-
"homepage": "https://www.regulations.gov/",
|
|
32
|
-
"terms_url": "https://open.gsa.gov/api/regulationsgov/",
|
|
33
|
-
"auth": {
|
|
34
|
-
"env": "DATA_GOV_API_KEY",
|
|
35
|
-
"required": "optional",
|
|
36
|
-
"placement": "query",
|
|
37
|
-
"param": "api_key",
|
|
38
|
-
"home": "data-gov",
|
|
39
|
-
"signup_url": "https://api.data.gov/signup/",
|
|
40
|
-
"echoes_key": false,
|
|
41
|
-
"demo_key": "DEMO_KEY",
|
|
42
|
-
"key_only": [
|
|
43
|
-
"more than about 10 requests an hour (DEMO_KEY limit); a free key allows 1,000 an hour"
|
|
44
|
-
]
|
|
45
|
-
},
|
|
46
|
-
"limits": {
|
|
47
|
-
"rps": 1,
|
|
48
|
-
"burst": 4,
|
|
49
|
-
"daily_quota": null,
|
|
50
|
-
"max_rows": 10000
|
|
51
|
-
},
|
|
52
|
-
"routes": {
|
|
53
|
-
"api": {
|
|
54
|
-
"base": "https://api.regulations.gov/v4",
|
|
55
|
-
"probe": "https://api.regulations.gov/v4/documents?page%5Bsize%5D=5",
|
|
56
|
-
"hosts": [
|
|
57
|
-
"api.regulations.gov"
|
|
58
|
-
]
|
|
59
|
-
},
|
|
60
|
-
"manual": {
|
|
61
|
-
"how": "Open each link in INSTRUCTIONS.md in a browser (they carry the public DEMO_KEY, about 10 requests an hour; put your own api.data.gov key in its place for more) and save the JSON under the given name; or search on https://www.regulations.gov, open the docket's 'Browse Comments' or 'Browse Documents' list, use 'Download' (CSV export of up to the first results), and upload the file."
|
|
62
|
-
}
|
|
63
|
-
},
|
|
64
|
-
"cache": {
|
|
65
|
-
"mode": "run_only",
|
|
66
|
-
"ttl_hours": null,
|
|
67
|
-
"why": "Dockets gain documents and comments daily; data/ is reused within a run."
|
|
68
|
-
},
|
|
69
|
-
"redistribution": {
|
|
70
|
-
"mode": "allowed",
|
|
71
|
-
"why": "Federal agency documents and the metadata are U.S. government works (17 U.S.C. 105). Public submissions are posted as received: attachments can contain third-party copyrighted material and personal information the submitter chose to include; share counts and metadata, and quote comment text sparingly."
|
|
72
|
-
},
|
|
73
|
-
"notices": [
|
|
74
|
-
"Public comments on Regulations.gov are posted by the agencies as received; posted counts can differ from comments received (agencies may withhold duplicates, mass-mail campaigns or sensitive submissions)."
|
|
75
|
-
],
|
|
76
|
-
"retention": null,
|
|
77
|
-
"citation": "Regulations.gov API v4 (eRulemaking Program, GSA), {dataset}, api.regulations.gov, retrieved {retrieved_long}.",
|
|
78
|
-
"audit_hooks": [],
|
|
79
|
-
"clarify": [
|
|
80
|
-
"Comments posted or comments received? The API counts posted comments only; agencies may post a sample or one copy of a mass-mail campaign.",
|
|
81
|
-
"Which document or docket? Comments filed on a docket (filter[docketId]) include every document in it; on one document use filter[commentOnId] with its objectId."
|
|
82
|
-
],
|
|
83
|
-
"formats": [
|
|
84
|
-
"json"
|
|
85
|
-
]
|
|
86
|
-
}
|
|
1
|
+
{
|
|
2
|
+
"id": "regulations",
|
|
3
|
+
"title": "Regulations.gov (API v4)",
|
|
4
|
+
"agency": "General Services Administration (eRulemaking Program), for participating federal agencies",
|
|
5
|
+
"depth": "standard",
|
|
6
|
+
"domains": [
|
|
7
|
+
"legislation",
|
|
8
|
+
"regulation",
|
|
9
|
+
"rulemaking"
|
|
10
|
+
],
|
|
11
|
+
"keywords": [
|
|
12
|
+
"regulations.gov",
|
|
13
|
+
"public comment",
|
|
14
|
+
"public comments",
|
|
15
|
+
"comments",
|
|
16
|
+
"docket",
|
|
17
|
+
"dockets",
|
|
18
|
+
"rulemaking",
|
|
19
|
+
"proposed rule",
|
|
20
|
+
"final rule",
|
|
21
|
+
"comment period",
|
|
22
|
+
"notice and comment",
|
|
23
|
+
"erulemaking"
|
|
24
|
+
],
|
|
25
|
+
"questions": [
|
|
26
|
+
"how many public comments did a proposed rule receive",
|
|
27
|
+
"proposed rules open for comment at EPA",
|
|
28
|
+
"dockets an agency opened this year",
|
|
29
|
+
"comments on a docket over time"
|
|
30
|
+
],
|
|
31
|
+
"homepage": "https://www.regulations.gov/",
|
|
32
|
+
"terms_url": "https://open.gsa.gov/api/regulationsgov/",
|
|
33
|
+
"auth": {
|
|
34
|
+
"env": "DATA_GOV_API_KEY",
|
|
35
|
+
"required": "optional",
|
|
36
|
+
"placement": "query",
|
|
37
|
+
"param": "api_key",
|
|
38
|
+
"home": "data-gov",
|
|
39
|
+
"signup_url": "https://api.data.gov/signup/",
|
|
40
|
+
"echoes_key": false,
|
|
41
|
+
"demo_key": "DEMO_KEY",
|
|
42
|
+
"key_only": [
|
|
43
|
+
"more than about 10 requests an hour (DEMO_KEY limit); a free key allows 1,000 an hour"
|
|
44
|
+
]
|
|
45
|
+
},
|
|
46
|
+
"limits": {
|
|
47
|
+
"rps": 1,
|
|
48
|
+
"burst": 4,
|
|
49
|
+
"daily_quota": null,
|
|
50
|
+
"max_rows": 10000
|
|
51
|
+
},
|
|
52
|
+
"routes": {
|
|
53
|
+
"api": {
|
|
54
|
+
"base": "https://api.regulations.gov/v4",
|
|
55
|
+
"probe": "https://api.regulations.gov/v4/documents?page%5Bsize%5D=5",
|
|
56
|
+
"hosts": [
|
|
57
|
+
"api.regulations.gov"
|
|
58
|
+
]
|
|
59
|
+
},
|
|
60
|
+
"manual": {
|
|
61
|
+
"how": "Open each link in INSTRUCTIONS.md in a browser (they carry the public DEMO_KEY, about 10 requests an hour; put your own api.data.gov key in its place for more) and save the JSON under the given name; or search on https://www.regulations.gov, open the docket's 'Browse Comments' or 'Browse Documents' list, use 'Download' (CSV export of up to the first results), and upload the file."
|
|
62
|
+
}
|
|
63
|
+
},
|
|
64
|
+
"cache": {
|
|
65
|
+
"mode": "run_only",
|
|
66
|
+
"ttl_hours": null,
|
|
67
|
+
"why": "Dockets gain documents and comments daily; data/ is reused within a run."
|
|
68
|
+
},
|
|
69
|
+
"redistribution": {
|
|
70
|
+
"mode": "allowed",
|
|
71
|
+
"why": "Federal agency documents and the metadata are U.S. government works (17 U.S.C. 105). Public submissions are posted as received: attachments can contain third-party copyrighted material and personal information the submitter chose to include; share counts and metadata, and quote comment text sparingly."
|
|
72
|
+
},
|
|
73
|
+
"notices": [
|
|
74
|
+
"Public comments on Regulations.gov are posted by the agencies as received; posted counts can differ from comments received (agencies may withhold duplicates, mass-mail campaigns or sensitive submissions)."
|
|
75
|
+
],
|
|
76
|
+
"retention": null,
|
|
77
|
+
"citation": "Regulations.gov API v4 (eRulemaking Program, GSA), {dataset}, api.regulations.gov, retrieved {retrieved_long}.",
|
|
78
|
+
"audit_hooks": [],
|
|
79
|
+
"clarify": [
|
|
80
|
+
"Comments posted or comments received? The API counts posted comments only; agencies may post a sample or one copy of a mass-mail campaign.",
|
|
81
|
+
"Which document or docket? Comments filed on a docket (filter[docketId]) include every document in it; on one document use filter[commentOnId] with its objectId."
|
|
82
|
+
],
|
|
83
|
+
"formats": [
|
|
84
|
+
"json"
|
|
85
|
+
]
|
|
86
|
+
}
|
|
@@ -0,0 +1,34 @@
|
|
|
1
|
+
{
|
|
2
|
+
"base_url": "https://data.sba.gov",
|
|
3
|
+
"timeout": 600,
|
|
4
|
+
"catalog_path": "/data.json",
|
|
5
|
+
"endpoints": {
|
|
6
|
+
"list_files": {
|
|
7
|
+
"path": "/data.json",
|
|
8
|
+
"method": "GET",
|
|
9
|
+
"description": "The loan data files SBA currently publishes (from data.sba.gov's catalog): 7(a) and 504 FOIA loan-level CSVs (file names carry the as-of date), activity reports, disaster loan workbooks. One row per file with the path for the foia request.",
|
|
10
|
+
"params": {
|
|
11
|
+
"search": {"in": "spec", "desc": "keep files whose dataset or file title contains this (e.g. FOIA, 504, Disaster)"}
|
|
12
|
+
},
|
|
13
|
+
"records": "",
|
|
14
|
+
"paging": {"type": "none"},
|
|
15
|
+
"max_rows": 5000
|
|
16
|
+
},
|
|
17
|
+
"foia": {
|
|
18
|
+
"path": "/sites/default/files/{file}.csv",
|
|
19
|
+
"method": "GET",
|
|
20
|
+
"description": "SBA 7(a) or 504 loan-level FOIA data: one row per approved loan with borrower, lender (or CDC), amount, approval date and fiscal year, NAICS industry, project state and county, congressional district, loan status, charge-off. Read streaming and filtered: give at least one of state, fiscal_year, from, naics.",
|
|
21
|
+
"params": {
|
|
22
|
+
"file": {"in": "path", "raw": true, "required": true, "desc": "the file's path under /sites/default/files without .csv, from list_files, e.g. uploaded_resources/FOIA_504_FY2010_Present_asof_260930"},
|
|
23
|
+
"state": {"in": "spec", "desc": "keep loans with this ProjectState (two letters; a list works)"},
|
|
24
|
+
"fiscal_year": {"in": "spec", "desc": "keep these ApprovalFY values (a year or a list)"},
|
|
25
|
+
"from": {"in": "spec", "desc": "first ApprovalFY to keep"},
|
|
26
|
+
"to": {"in": "spec", "desc": "last ApprovalFY to keep"},
|
|
27
|
+
"naics": {"in": "spec", "desc": "keep NaicsCode values starting with these digits (e.g. 72; a list works)"}
|
|
28
|
+
},
|
|
29
|
+
"records": "$csv",
|
|
30
|
+
"paging": {"type": "none"},
|
|
31
|
+
"max_rows": 1000000
|
|
32
|
+
}
|
|
33
|
+
}
|
|
34
|
+
}
|
|
@@ -0,0 +1,86 @@
|
|
|
1
|
+
{
|
|
2
|
+
"id": "sba",
|
|
3
|
+
"title": "SBA loan data: 7(a) and 504 loans (FOIA loan-level files), activity reports, disaster loans",
|
|
4
|
+
"agency": "U.S. Small Business Administration",
|
|
5
|
+
"depth": "standard",
|
|
6
|
+
"domains": [
|
|
7
|
+
"small business",
|
|
8
|
+
"federal lending",
|
|
9
|
+
"federal spending"
|
|
10
|
+
],
|
|
11
|
+
"keywords": [
|
|
12
|
+
"sba",
|
|
13
|
+
"small business administration",
|
|
14
|
+
"sba loans",
|
|
15
|
+
"7(a) loans",
|
|
16
|
+
"7a loans",
|
|
17
|
+
"504 loans",
|
|
18
|
+
"sba lenders",
|
|
19
|
+
"certified development company",
|
|
20
|
+
"small business lending",
|
|
21
|
+
"loan charge-offs",
|
|
22
|
+
"sba loans by state",
|
|
23
|
+
"sba loans by industry",
|
|
24
|
+
"disaster loans"
|
|
25
|
+
],
|
|
26
|
+
"questions": [
|
|
27
|
+
"SBA 7(a) loans approved in a state by fiscal year",
|
|
28
|
+
"504 loans by industry (NAICS)",
|
|
29
|
+
"largest SBA lenders",
|
|
30
|
+
"charge-off rate of SBA loans",
|
|
31
|
+
"SBA loans to restaurants in a state"
|
|
32
|
+
],
|
|
33
|
+
"homepage": "https://data.sba.gov/",
|
|
34
|
+
"terms_url": "https://data.sba.gov/",
|
|
35
|
+
"auth": {
|
|
36
|
+
"env": null,
|
|
37
|
+
"required": "none",
|
|
38
|
+
"placement": "none",
|
|
39
|
+
"signup_url": null,
|
|
40
|
+
"echoes_key": false
|
|
41
|
+
},
|
|
42
|
+
"limits": {
|
|
43
|
+
"rps": 1,
|
|
44
|
+
"burst": 2,
|
|
45
|
+
"max_rows": 1000000
|
|
46
|
+
},
|
|
47
|
+
"routes": {
|
|
48
|
+
"api": {
|
|
49
|
+
"base": "https://data.sba.gov",
|
|
50
|
+
"probe": "https://data.sba.gov/data.json",
|
|
51
|
+
"hosts": [
|
|
52
|
+
"data.sba.gov"
|
|
53
|
+
]
|
|
54
|
+
},
|
|
55
|
+
"manual": {
|
|
56
|
+
"how": "Open https://data.sba.gov/, find '7(a) & 504 FOIA', download the CSV (FOIA - 7(a) or 504, by period) and upload it with ingest; the filters apply to the uploaded file."
|
|
57
|
+
}
|
|
58
|
+
},
|
|
59
|
+
"cache": {
|
|
60
|
+
"mode": "run_only",
|
|
61
|
+
"ttl_hours": null,
|
|
62
|
+
"why": "Files are replaced quarterly (the as-of date is in the file name)."
|
|
63
|
+
},
|
|
64
|
+
"redistribution": {
|
|
65
|
+
"mode": "allowed",
|
|
66
|
+
"why": "SBA publishes these loan records under FOIA as public data; U.S. government works (17 U.S.C. 105)."
|
|
67
|
+
},
|
|
68
|
+
"notices": [],
|
|
69
|
+
"retention": null,
|
|
70
|
+
"citation": "U.S. Small Business Administration, {dataset}, data.sba.gov, retrieved {retrieved_long}.",
|
|
71
|
+
"audit_hooks": [],
|
|
72
|
+
"clarify": [
|
|
73
|
+
"Which program? 7(a) (lender loans with an SBA guaranty) or 504 (CDC loans for real estate and equipment, with a third-party lender part): they are different files and different dollars. Default: 7(a), said as such.",
|
|
74
|
+
"Approvals or outcomes? GrossApproval is the approved amount (504: the CDC's part; ThirdPartyDollars is the lender's); LoanStatus and GrossChargeOffAmount describe outcomes as of the file's date. Default: count and dollars approved by ApprovalFY."
|
|
75
|
+
],
|
|
76
|
+
"formats": [
|
|
77
|
+
"csv",
|
|
78
|
+
"json"
|
|
79
|
+
],
|
|
80
|
+
"aliases": [
|
|
81
|
+
"SBA",
|
|
82
|
+
"Small Business Administration",
|
|
83
|
+
"7(a)",
|
|
84
|
+
"504"
|
|
85
|
+
]
|
|
86
|
+
}
|
|
@@ -0,0 +1,60 @@
|
|
|
1
|
+
# SBA loan data: 7(a) and 504 loans (FOIA loan-level files), activity reports, disaster loans
|
|
2
|
+
Depth: standard. Key: none. The U.S. Small Business Administration's loan data on data.sba.gov:
|
|
3
|
+
- the 7(a) and 504 FOIA files: one row per approved loan since FY1991, with borrower, lender or Certified
|
|
4
|
+
Development Company, amount, dates, industry, location and status;
|
|
5
|
+
- through the catalog, the activity reports and disaster loan workbooks.
|
|
6
|
+
|
|
7
|
+
## When to use
|
|
8
|
+
- SBA 7(a) or 504 loans by state, county, congressional district, industry (NAICS), lender, fiscal year; loan
|
|
9
|
+
sizes; charge-offs and paid-in-full status; franchise loans.
|
|
10
|
+
- Not here: all federal loans and grants by recipient (usaspending); PPP loans (not in these files); bank
|
|
11
|
+
lending in general (fdic, fed-board); business counts (census CBP).
|
|
12
|
+
|
|
13
|
+
## Endpoints
|
|
14
|
+
| Endpoint | Returns | Parameters |
|
|
15
|
+
|---|---|---|
|
|
16
|
+
| `list_files` | every file in data.sba.gov's catalog: `dataset`, `title`, `format`, `file` (the path for `foia`, CSVs only), `url`, `modified` | `search` (e.g. `7(a) & 504 FOIA`) |
|
|
17
|
+
| `foia` | the loans of one FOIA file that pass the filters, columns as published | `file` (from `list_files`), and at least one of `state` (ProjectState), `fiscal_year`, `from`/`to` (ApprovalFY), `naics` (prefix) |
|
|
18
|
+
|
|
19
|
+
Files of 2026-11-07 (as of September 30, 2026): `uploaded_resources/FOIA_7a_FY1991_FY1999_asof_260930`,
|
|
20
|
+
`..._FY2000_FY2009_...`, `..._FY2010_FY2019_...`, `..._FY2020_Present_...`, `uploaded_resources/FOIA_504_FY1991_FY2009_asof_260930`,
|
|
21
|
+
`..._504_FY2010_Present_...`. The as-of part changes each quarter: run `list_files` first.
|
|
22
|
+
|
|
23
|
+
## Spec example
|
|
24
|
+
```json
|
|
25
|
+
{"description": "504 loans in Vermont approved FY2024-2025",
|
|
26
|
+
"requests": [{"name": "files", "endpoint": "list_files", "params": {"search": "7(a) & 504 FOIA"}},
|
|
27
|
+
{"name": "vt_504", "endpoint": "foia", "params": {"file": "uploaded_resources/FOIA_504_FY2010_Present_asof_260930",
|
|
28
|
+
"state": "VT", "from": "2024", "to": "2025"}}]}
|
|
29
|
+
```
|
|
30
|
+
|
|
31
|
+
## Data format and traps
|
|
32
|
+
- 504 columns (FOIA_504): AsOfDate, Program, LocationID, BorrName, BorrStreet, BorrCity, BorrState, BorrZip, CDC_Name ...,
|
|
33
|
+
ThirdPartyLender_Name, ThirdPartyLender_City, ThirdPartyLender_State, ThirdPartyDollars, GrossApproval,
|
|
34
|
+
ApprovalDate, ApprovalFY, FirstDisbursementDate, ProcessingMethod, TermInMonths, NaicsCode, NaicsDescription,
|
|
35
|
+
FranchiseCode, FranchiseName, ProjectCounty, ProjectState, SBADistrictOffice, CongressionalDistrict,
|
|
36
|
+
BusinessType, BusinessAge, LoanStatus, PaidInFullDate, ChargeOffDate, GrossChargeOffAmount, JobsSupported,
|
|
37
|
+
CollateralInd. 7(a) files have the lender instead of CDC and third-party columns (BankName, BankFDICNumber,
|
|
38
|
+
BankNCUANumber, BankStreet, BankCity, BankState, BankZip), plus SBAGuaranteedApproval, InitialInterestRate,
|
|
39
|
+
FixedorVariableInterestInd, RevolverStatus and SoldSecMrktInd. Read the data dictionary in `list_files`
|
|
40
|
+
(7a_504_foia_data_dictionary.xlsx) before use.
|
|
41
|
+
- `state` filters `ProjectState` (where the project is), not `BorrState`. ApprovalFY is the federal fiscal
|
|
42
|
+
year (October-September).
|
|
43
|
+
- Dollars are text with a decimal (`263000.0`). In 504 loans, `GrossApproval` is the CDC/SBA debenture and
|
|
44
|
+
`ThirdPartyDollars` the private lender's first lien: the project is larger than either. In 7(a),
|
|
45
|
+
`SBAGuaranteedApproval` is SBA's guaranteed part of `GrossApproval`: say which you sum.
|
|
46
|
+
- `LoanStatus` and charge-off fields are as of the file's `AsOfDate`: recent loans have had little time to
|
|
47
|
+
default. Compare charge-off rates by approval cohort, not across all years.
|
|
48
|
+
- Borrowers are named businesses (sometimes sole proprietors with a home address). Analyse in aggregate; do not
|
|
49
|
+
single out individuals.
|
|
50
|
+
- Size: the files are 60 to 255 MB. `fetch` streams them and keeps only the rows that pass the filters
|
|
51
|
+
(Vermont 504 FY2024-2025: 35 loans, about 7 s, on 2026-11-07).
|
|
52
|
+
|
|
53
|
+
## Access
|
|
54
|
+
No key. `fetch` uses data.sba.gov (`/data.json` for the catalog, `/sites/default/files/...` for files; the CKAN API
|
|
55
|
+
answers 404; verified 2026-11-07). Manual: download the CSV from data.sba.gov ("7(a) & 504 FOIA"), then `ingest`
|
|
56
|
+
with the same filters.
|
|
57
|
+
|
|
58
|
+
## Citation and terms
|
|
59
|
+
"U.S. Small Business Administration, 7(a) & 504 FOIA, <file> (as of <date>), data.sba.gov, retrieved <date>."
|
|
60
|
+
Public data released by SBA under FOIA.
|