data-analyst-mcp 0.3.0 → 0.4.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (292) hide show
  1. package/README.md +286 -262
  2. package/dist/adapters/bjs.d.ts +13 -0
  3. package/dist/adapters/bjs.js +28 -0
  4. package/dist/adapters/bjs.js.map +1 -0
  5. package/dist/adapters/cbp.d.ts +5 -0
  6. package/dist/adapters/cbp.js +64 -0
  7. package/dist/adapters/cbp.js.map +1 -0
  8. package/dist/adapters/cdc-wonder.d.ts +5 -0
  9. package/dist/adapters/cdc-wonder.js +68 -0
  10. package/dist/adapters/cdc-wonder.js.map +1 -0
  11. package/dist/adapters/cpsc.d.ts +4 -0
  12. package/dist/adapters/cpsc.js +125 -0
  13. package/dist/adapters/cpsc.js.map +1 -0
  14. package/dist/adapters/fhwa.d.ts +9 -0
  15. package/dist/adapters/fhwa.js +16 -0
  16. package/dist/adapters/fhwa.js.map +1 -0
  17. package/dist/adapters/foreign-assistance.d.ts +9 -0
  18. package/dist/adapters/foreign-assistance.js +42 -0
  19. package/dist/adapters/foreign-assistance.js.map +1 -0
  20. package/dist/adapters/hud-ahar.d.ts +3 -0
  21. package/dist/adapters/hud-ahar.js +80 -0
  22. package/dist/adapters/hud-ahar.js.map +1 -0
  23. package/dist/adapters/nces.d.ts +10 -0
  24. package/dist/adapters/nces.js +32 -0
  25. package/dist/adapters/nces.js.map +1 -0
  26. package/dist/adapters/nsf.d.ts +11 -0
  27. package/dist/adapters/nsf.js +25 -0
  28. package/dist/adapters/nsf.js.map +1 -0
  29. package/dist/adapters/onrr.d.ts +9 -0
  30. package/dist/adapters/onrr.js +35 -0
  31. package/dist/adapters/onrr.js.map +1 -0
  32. package/dist/adapters/sba.d.ts +10 -0
  33. package/dist/adapters/sba.js +134 -0
  34. package/dist/adapters/sba.js.map +1 -0
  35. package/dist/adapters/treasury-tic.d.ts +30 -0
  36. package/dist/adapters/treasury-tic.js +149 -0
  37. package/dist/adapters/treasury-tic.js.map +1 -0
  38. package/dist/adapters/uscourts.d.ts +8 -0
  39. package/dist/adapters/uscourts.js +8 -0
  40. package/dist/adapters/uscourts.js.map +1 -0
  41. package/dist/analysis/cite.d.ts +9 -1
  42. package/dist/analysis/cite.js +9 -2
  43. package/dist/analysis/cite.js.map +1 -1
  44. package/dist/bin/cli.d.ts +2 -0
  45. package/dist/bin/cli.js +17 -0
  46. package/dist/bin/cli.js.map +1 -1
  47. package/dist/core/generic-rest.js +42 -17
  48. package/dist/core/generic-rest.js.map +1 -1
  49. package/dist/core/guard.d.ts +32 -0
  50. package/dist/core/guard.js +176 -0
  51. package/dist/core/guard.js.map +1 -0
  52. package/dist/core/http.d.ts +10 -0
  53. package/dist/core/http.js +36 -7
  54. package/dist/core/http.js.map +1 -1
  55. package/dist/core/keys.d.ts +13 -3
  56. package/dist/core/keys.js +67 -7
  57. package/dist/core/keys.js.map +1 -1
  58. package/dist/core/package.d.ts +12 -3
  59. package/dist/core/package.js +56 -12
  60. package/dist/core/package.js.map +1 -1
  61. package/dist/core/secret_patterns.d.ts +6 -0
  62. package/dist/core/secret_patterns.js +20 -0
  63. package/dist/core/secret_patterns.js.map +1 -0
  64. package/dist/core/tabular.d.ts +43 -1
  65. package/dist/core/tabular.js +149 -6
  66. package/dist/core/tabular.js.map +1 -1
  67. package/dist/envelope.js +3 -1
  68. package/dist/envelope.js.map +1 -1
  69. package/dist/index.d.ts +29 -22
  70. package/dist/index.js +45 -46
  71. package/dist/index.js.map +1 -1
  72. package/dist/remote/app.js +87 -31
  73. package/dist/remote/app.js.map +1 -1
  74. package/dist/remote/oauth.js +8 -1
  75. package/dist/remote/oauth.js.map +1 -1
  76. package/dist/remote/pages.d.ts +3 -7
  77. package/dist/remote/pages.js +49 -19
  78. package/dist/remote/pages.js.map +1 -1
  79. package/dist/remote/sign.d.ts +7 -1
  80. package/dist/remote/sign.js +33 -7
  81. package/dist/remote/sign.js.map +1 -1
  82. package/dist/remote/store.js +14 -5
  83. package/dist/remote/store.js.map +1 -1
  84. package/dist/report/audit_report.js +29 -7
  85. package/dist/report/audit_report.js.map +1 -1
  86. package/dist/report/build_report.js +34 -4
  87. package/dist/report/build_report.js.map +1 -1
  88. package/dist/report/method_audit.js +10 -1
  89. package/dist/report/method_audit.js.map +1 -1
  90. package/dist/report/scan_secrets.d.ts +4 -1
  91. package/dist/report/scan_secrets.js +38 -18
  92. package/dist/report/scan_secrets.js.map +1 -1
  93. package/dist/server.d.ts +3 -1
  94. package/dist/server.js +46 -13
  95. package/dist/server.js.map +1 -1
  96. package/dist/tools.js +27 -6
  97. package/dist/tools.js.map +1 -1
  98. package/guide/WORKFLOW.md +134 -134
  99. package/guide/assets/disclaimer.txt +1 -1
  100. package/guide/assets/download_data.ps1 +164 -162
  101. package/guide/assets/download_data.sh +8 -2
  102. package/guide/assets/report_template.html +597 -597
  103. package/guide/references/routing.md +198 -171
  104. package/guide/references/style_guide.md +398 -398
  105. package/package.json +56 -56
  106. package/packs/acf/endpoints.json +114 -114
  107. package/packs/acf/policy.json +104 -104
  108. package/packs/actuaries/endpoints.json +82 -82
  109. package/packs/actuaries/policy.json +109 -109
  110. package/packs/bea/assets/download_bea.ps1 +182 -182
  111. package/packs/bea/docs/bea_api.md +461 -461
  112. package/packs/bea/docs/datasets.md +157 -157
  113. package/packs/bea/docs/report_patterns.md +112 -112
  114. package/packs/bea/policy.json +170 -170
  115. package/packs/bea/source.md +152 -152
  116. package/packs/bjs/endpoints.json +150 -0
  117. package/packs/bjs/policy.json +114 -0
  118. package/packs/bjs/source.md +98 -0
  119. package/packs/bls/assets/download_bls.ps1 +152 -152
  120. package/packs/bls/docs/analysis_patterns.md +108 -108
  121. package/packs/bls/docs/bls_api.md +73 -73
  122. package/packs/bls/docs/series_ids.md +149 -149
  123. package/packs/bls/policy.json +238 -238
  124. package/packs/bts/endpoints.json +346 -346
  125. package/packs/bts/policy.json +94 -94
  126. package/packs/cbp/endpoints.json +31 -0
  127. package/packs/cbp/policy.json +85 -0
  128. package/packs/cbp/source.md +57 -0
  129. package/packs/cdc/endpoints.json +197 -197
  130. package/packs/cdc/policy.json +83 -83
  131. package/packs/cdc/source.md +1 -1
  132. package/packs/cdc-wonder/endpoints.json +26 -0
  133. package/packs/cdc-wonder/policy.json +84 -0
  134. package/packs/cdc-wonder/source.md +53 -0
  135. package/packs/census/endpoints.json +99 -99
  136. package/packs/cfpb/endpoints.json +326 -326
  137. package/packs/cfpb/policy.json +119 -119
  138. package/packs/clinical-trials/endpoints.json +166 -166
  139. package/packs/clinical-trials/policy.json +84 -84
  140. package/packs/cms/endpoints.json +69 -69
  141. package/packs/cms/policy.json +96 -96
  142. package/packs/college-scorecard/endpoints.json +252 -252
  143. package/packs/college-scorecard/policy.json +106 -106
  144. package/packs/college-scorecard/source.md +1 -1
  145. package/packs/congress/endpoints.json +1701 -1701
  146. package/packs/congress/policy.json +117 -117
  147. package/packs/cpsc/endpoints.json +91 -0
  148. package/packs/cpsc/policy.json +91 -0
  149. package/packs/cpsc/source.md +76 -0
  150. package/packs/dhs-ohss/endpoints.json +66 -66
  151. package/packs/dhs-ohss/policy.json +107 -107
  152. package/packs/dhs-ohss/source.md +1 -1
  153. package/packs/doj-news/endpoints.json +59 -59
  154. package/packs/doj-news/policy.json +96 -96
  155. package/packs/doj-news/source.md +1 -1
  156. package/packs/dol/endpoints.json +817 -817
  157. package/packs/dol/policy.json +135 -135
  158. package/packs/eia/endpoints.json +717 -717
  159. package/packs/eia/policy.json +112 -112
  160. package/packs/epa/endpoints.json +291 -291
  161. package/packs/epa/policy.json +99 -99
  162. package/packs/epa-aqs/endpoints.json +173 -173
  163. package/packs/epa-aqs/policy.json +96 -96
  164. package/packs/fbi/endpoints.json +1841 -1841
  165. package/packs/fbi/policy.json +118 -118
  166. package/packs/fbi/source.md +3 -3
  167. package/packs/fda/endpoints.json +237 -237
  168. package/packs/fda/policy.json +121 -121
  169. package/packs/fdic/endpoints.json +416 -416
  170. package/packs/fdic/policy.json +83 -83
  171. package/packs/fec/endpoints.json +707 -707
  172. package/packs/fec/policy.json +93 -93
  173. package/packs/fed-board/endpoints.json +89 -89
  174. package/packs/fed-board/policy.json +136 -136
  175. package/packs/federal-register/endpoints.json +143 -143
  176. package/packs/federal-register/policy.json +86 -86
  177. package/packs/fema/endpoints.json +645 -645
  178. package/packs/fema/policy.json +103 -103
  179. package/packs/fhfa/endpoints.json +105 -105
  180. package/packs/fhfa/policy.json +109 -109
  181. package/packs/fhwa/endpoints.json +48 -0
  182. package/packs/fhwa/policy.json +91 -0
  183. package/packs/fhwa/source.md +59 -0
  184. package/packs/foreign-assistance/endpoints.json +166 -0
  185. package/packs/foreign-assistance/policy.json +80 -0
  186. package/packs/foreign-assistance/source.md +76 -0
  187. package/packs/fred/assets/download_fred.ps1 +122 -122
  188. package/packs/fred/docs/analysis_patterns.md +124 -124
  189. package/packs/fred/docs/fred_api.md +94 -94
  190. package/packs/fred/docs/series.md +188 -188
  191. package/packs/fred/policy.json +253 -253
  192. package/packs/fsa/endpoints.json +150 -150
  193. package/packs/fsa/policy.json +99 -99
  194. package/packs/fsa/source.md +1 -1
  195. package/packs/govinfo/endpoints.json +519 -519
  196. package/packs/gsa-calc/endpoints.json +93 -93
  197. package/packs/gsa-calc/policy.json +97 -97
  198. package/packs/hud/endpoints.json +146 -146
  199. package/packs/hud/policy.json +84 -84
  200. package/packs/hud/source.md +1 -1
  201. package/packs/hud-ahar/endpoints.json +92 -0
  202. package/packs/hud-ahar/policy.json +88 -0
  203. package/packs/hud-ahar/source.md +72 -0
  204. package/packs/ipums/docs/report_patterns.md +117 -117
  205. package/packs/irs-soi/endpoints.json +114 -114
  206. package/packs/irs-soi/policy.json +107 -107
  207. package/packs/medicaid/endpoints.json +412 -412
  208. package/packs/medicaid/policy.json +108 -108
  209. package/packs/naep/endpoints.json +217 -217
  210. package/packs/naep/policy.json +100 -100
  211. package/packs/naep/source.md +1 -1
  212. package/packs/nces/endpoints.json +101 -0
  213. package/packs/nces/policy.json +99 -0
  214. package/packs/nces/source.md +75 -0
  215. package/packs/nhtsa/endpoints.json +132 -132
  216. package/packs/nhtsa/policy.json +93 -93
  217. package/packs/nhtsa/source.md +1 -1
  218. package/packs/nih/endpoints.json +452 -452
  219. package/packs/nih/policy.json +86 -86
  220. package/packs/noaa/endpoints.json +431 -431
  221. package/packs/noaa/policy.json +95 -95
  222. package/packs/nrel/endpoints.json +327 -327
  223. package/packs/nrel/policy.json +96 -96
  224. package/packs/nsf/endpoints.json +33 -0
  225. package/packs/nsf/policy.json +83 -0
  226. package/packs/nsf/source.md +59 -0
  227. package/packs/nws/endpoints.json +271 -271
  228. package/packs/nws/policy.json +82 -82
  229. package/packs/nyfed/endpoints.json +80 -80
  230. package/packs/nyfed/policy.json +92 -92
  231. package/packs/omb/endpoints.json +460 -460
  232. package/packs/omb/policy.json +106 -106
  233. package/packs/onrr/endpoints.json +198 -0
  234. package/packs/onrr/policy.json +91 -0
  235. package/packs/onrr/source.md +55 -0
  236. package/packs/open-payments/endpoints.json +297 -297
  237. package/packs/open-payments/policy.json +101 -101
  238. package/packs/opm/assets/download_opm.ps1 +125 -125
  239. package/packs/opm/docs/fields.md +184 -184
  240. package/packs/opm/docs/opm_api.md +71 -71
  241. package/packs/opm/docs/report_patterns.md +83 -83
  242. package/packs/opm/lib/data_dictionary.csv +73 -73
  243. package/packs/pbgc/endpoints.json +483 -483
  244. package/packs/pbgc/policy.json +94 -94
  245. package/packs/philfed/endpoints.json +85 -85
  246. package/packs/philfed/policy.json +94 -94
  247. package/packs/port.json +65 -0
  248. package/packs/regulations/endpoints.json +287 -287
  249. package/packs/regulations/policy.json +86 -86
  250. package/packs/sba/endpoints.json +34 -0
  251. package/packs/sba/policy.json +86 -0
  252. package/packs/sba/source.md +60 -0
  253. package/packs/sec/endpoints.json +236 -236
  254. package/packs/sec/policy.json +86 -86
  255. package/packs/senate-lobbying/endpoints.json +553 -553
  256. package/packs/senate-lobbying/policy.json +99 -99
  257. package/packs/snapqc/endpoints.json +1426 -1426
  258. package/packs/snapqc/policy.json +92 -92
  259. package/packs/treasury/catalog.json +2267 -2267
  260. package/packs/treasury/docs/api_guide.md +245 -245
  261. package/packs/treasury/docs/datasets.md +56 -56
  262. package/packs/treasury/docs/report_patterns.md +126 -126
  263. package/packs/treasury/policy.json +159 -159
  264. package/packs/treasury/source.md +170 -165
  265. package/packs/treasury-tic/endpoints.json +77 -0
  266. package/packs/treasury-tic/policy.json +89 -0
  267. package/packs/treasury-tic/source.md +80 -0
  268. package/packs/treasury-yields/endpoints.json +226 -226
  269. package/packs/treasury-yields/policy.json +86 -86
  270. package/packs/usaspending/endpoints.json +1315 -1315
  271. package/packs/usaspending/policy.json +109 -109
  272. package/packs/uscourts/endpoints.json +22 -0
  273. package/packs/uscourts/policy.json +87 -0
  274. package/packs/uscourts/source.md +56 -0
  275. package/packs/usda-fna/policy.json +133 -133
  276. package/packs/usda-fooddata/endpoints.json +180 -180
  277. package/packs/usda-fooddata/policy.json +94 -94
  278. package/packs/usda-nass/endpoints.json +323 -323
  279. package/packs/usda-nass/policy.json +95 -95
  280. package/packs/usda-outlook/endpoints.json +86 -86
  281. package/packs/usda-outlook/policy.json +109 -109
  282. package/packs/usgs/endpoints.json +313 -313
  283. package/packs/usgs/policy.json +95 -95
  284. package/packs/usitc/endpoints.json +74 -74
  285. package/packs/usitc/policy.json +111 -111
  286. package/packs/uspto/endpoints.json +141 -141
  287. package/packs/uspto/policy.json +95 -95
  288. package/packs/uspto/source.md +1 -1
  289. package/packs/va/endpoints.json +414 -414
  290. package/packs/va/policy.json +101 -101
  291. package/packs/world-bank/endpoints.json +122 -122
  292. package/packs/world-bank/policy.json +101 -101
@@ -1,86 +1,86 @@
1
- {
2
- "id": "regulations",
3
- "title": "Regulations.gov (API v4)",
4
- "agency": "General Services Administration (eRulemaking Program), for participating federal agencies",
5
- "depth": "standard",
6
- "domains": [
7
- "legislation",
8
- "regulation",
9
- "rulemaking"
10
- ],
11
- "keywords": [
12
- "regulations.gov",
13
- "public comment",
14
- "public comments",
15
- "comments",
16
- "docket",
17
- "dockets",
18
- "rulemaking",
19
- "proposed rule",
20
- "final rule",
21
- "comment period",
22
- "notice and comment",
23
- "erulemaking"
24
- ],
25
- "questions": [
26
- "how many public comments did a proposed rule receive",
27
- "proposed rules open for comment at EPA",
28
- "dockets an agency opened this year",
29
- "comments on a docket over time"
30
- ],
31
- "homepage": "https://www.regulations.gov/",
32
- "terms_url": "https://open.gsa.gov/api/regulationsgov/",
33
- "auth": {
34
- "env": "DATA_GOV_API_KEY",
35
- "required": "optional",
36
- "placement": "query",
37
- "param": "api_key",
38
- "home": "data-gov",
39
- "signup_url": "https://api.data.gov/signup/",
40
- "echoes_key": false,
41
- "demo_key": "DEMO_KEY",
42
- "key_only": [
43
- "more than about 10 requests an hour (DEMO_KEY limit); a free key allows 1,000 an hour"
44
- ]
45
- },
46
- "limits": {
47
- "rps": 1,
48
- "burst": 4,
49
- "daily_quota": null,
50
- "max_rows": 10000
51
- },
52
- "routes": {
53
- "api": {
54
- "base": "https://api.regulations.gov/v4",
55
- "probe": "https://api.regulations.gov/v4/documents?page%5Bsize%5D=5",
56
- "hosts": [
57
- "api.regulations.gov"
58
- ]
59
- },
60
- "manual": {
61
- "how": "Open each link in INSTRUCTIONS.md in a browser (they carry the public DEMO_KEY, about 10 requests an hour; put your own api.data.gov key in its place for more) and save the JSON under the given name; or search on https://www.regulations.gov, open the docket's 'Browse Comments' or 'Browse Documents' list, use 'Download' (CSV export of up to the first results), and upload the file."
62
- }
63
- },
64
- "cache": {
65
- "mode": "run_only",
66
- "ttl_hours": null,
67
- "why": "Dockets gain documents and comments daily; data/ is reused within a run."
68
- },
69
- "redistribution": {
70
- "mode": "allowed",
71
- "why": "Federal agency documents and the metadata are U.S. government works (17 U.S.C. 105). Public submissions are posted as received: attachments can contain third-party copyrighted material and personal information the submitter chose to include; share counts and metadata, and quote comment text sparingly."
72
- },
73
- "notices": [
74
- "Public comments on Regulations.gov are posted by the agencies as received; posted counts can differ from comments received (agencies may withhold duplicates, mass-mail campaigns or sensitive submissions)."
75
- ],
76
- "retention": null,
77
- "citation": "Regulations.gov API v4 (eRulemaking Program, GSA), {dataset}, api.regulations.gov, retrieved {retrieved_long}.",
78
- "audit_hooks": [],
79
- "clarify": [
80
- "Comments posted or comments received? The API counts posted comments only; agencies may post a sample or one copy of a mass-mail campaign.",
81
- "Which document or docket? Comments filed on a docket (filter[docketId]) include every document in it; on one document use filter[commentOnId] with its objectId."
82
- ],
83
- "formats": [
84
- "json"
85
- ]
86
- }
1
+ {
2
+ "id": "regulations",
3
+ "title": "Regulations.gov (API v4)",
4
+ "agency": "General Services Administration (eRulemaking Program), for participating federal agencies",
5
+ "depth": "standard",
6
+ "domains": [
7
+ "legislation",
8
+ "regulation",
9
+ "rulemaking"
10
+ ],
11
+ "keywords": [
12
+ "regulations.gov",
13
+ "public comment",
14
+ "public comments",
15
+ "comments",
16
+ "docket",
17
+ "dockets",
18
+ "rulemaking",
19
+ "proposed rule",
20
+ "final rule",
21
+ "comment period",
22
+ "notice and comment",
23
+ "erulemaking"
24
+ ],
25
+ "questions": [
26
+ "how many public comments did a proposed rule receive",
27
+ "proposed rules open for comment at EPA",
28
+ "dockets an agency opened this year",
29
+ "comments on a docket over time"
30
+ ],
31
+ "homepage": "https://www.regulations.gov/",
32
+ "terms_url": "https://open.gsa.gov/api/regulationsgov/",
33
+ "auth": {
34
+ "env": "DATA_GOV_API_KEY",
35
+ "required": "optional",
36
+ "placement": "query",
37
+ "param": "api_key",
38
+ "home": "data-gov",
39
+ "signup_url": "https://api.data.gov/signup/",
40
+ "echoes_key": false,
41
+ "demo_key": "DEMO_KEY",
42
+ "key_only": [
43
+ "more than about 10 requests an hour (DEMO_KEY limit); a free key allows 1,000 an hour"
44
+ ]
45
+ },
46
+ "limits": {
47
+ "rps": 1,
48
+ "burst": 4,
49
+ "daily_quota": null,
50
+ "max_rows": 10000
51
+ },
52
+ "routes": {
53
+ "api": {
54
+ "base": "https://api.regulations.gov/v4",
55
+ "probe": "https://api.regulations.gov/v4/documents?page%5Bsize%5D=5",
56
+ "hosts": [
57
+ "api.regulations.gov"
58
+ ]
59
+ },
60
+ "manual": {
61
+ "how": "Open each link in INSTRUCTIONS.md in a browser (they carry the public DEMO_KEY, about 10 requests an hour; put your own api.data.gov key in its place for more) and save the JSON under the given name; or search on https://www.regulations.gov, open the docket's 'Browse Comments' or 'Browse Documents' list, use 'Download' (CSV export of up to the first results), and upload the file."
62
+ }
63
+ },
64
+ "cache": {
65
+ "mode": "run_only",
66
+ "ttl_hours": null,
67
+ "why": "Dockets gain documents and comments daily; data/ is reused within a run."
68
+ },
69
+ "redistribution": {
70
+ "mode": "allowed",
71
+ "why": "Federal agency documents and the metadata are U.S. government works (17 U.S.C. 105). Public submissions are posted as received: attachments can contain third-party copyrighted material and personal information the submitter chose to include; share counts and metadata, and quote comment text sparingly."
72
+ },
73
+ "notices": [
74
+ "Public comments on Regulations.gov are posted by the agencies as received; posted counts can differ from comments received (agencies may withhold duplicates, mass-mail campaigns or sensitive submissions)."
75
+ ],
76
+ "retention": null,
77
+ "citation": "Regulations.gov API v4 (eRulemaking Program, GSA), {dataset}, api.regulations.gov, retrieved {retrieved_long}.",
78
+ "audit_hooks": [],
79
+ "clarify": [
80
+ "Comments posted or comments received? The API counts posted comments only; agencies may post a sample or one copy of a mass-mail campaign.",
81
+ "Which document or docket? Comments filed on a docket (filter[docketId]) include every document in it; on one document use filter[commentOnId] with its objectId."
82
+ ],
83
+ "formats": [
84
+ "json"
85
+ ]
86
+ }
@@ -0,0 +1,34 @@
1
+ {
2
+ "base_url": "https://data.sba.gov",
3
+ "timeout": 600,
4
+ "catalog_path": "/data.json",
5
+ "endpoints": {
6
+ "list_files": {
7
+ "path": "/data.json",
8
+ "method": "GET",
9
+ "description": "The loan data files SBA currently publishes (from data.sba.gov's catalog): 7(a) and 504 FOIA loan-level CSVs (file names carry the as-of date), activity reports, disaster loan workbooks. One row per file with the path for the foia request.",
10
+ "params": {
11
+ "search": {"in": "spec", "desc": "keep files whose dataset or file title contains this (e.g. FOIA, 504, Disaster)"}
12
+ },
13
+ "records": "",
14
+ "paging": {"type": "none"},
15
+ "max_rows": 5000
16
+ },
17
+ "foia": {
18
+ "path": "/sites/default/files/{file}.csv",
19
+ "method": "GET",
20
+ "description": "SBA 7(a) or 504 loan-level FOIA data: one row per approved loan with borrower, lender (or CDC), amount, approval date and fiscal year, NAICS industry, project state and county, congressional district, loan status, charge-off. Read streaming and filtered: give at least one of state, fiscal_year, from, naics.",
21
+ "params": {
22
+ "file": {"in": "path", "raw": true, "required": true, "desc": "the file's path under /sites/default/files without .csv, from list_files, e.g. uploaded_resources/FOIA_504_FY2010_Present_asof_260930"},
23
+ "state": {"in": "spec", "desc": "keep loans with this ProjectState (two letters; a list works)"},
24
+ "fiscal_year": {"in": "spec", "desc": "keep these ApprovalFY values (a year or a list)"},
25
+ "from": {"in": "spec", "desc": "first ApprovalFY to keep"},
26
+ "to": {"in": "spec", "desc": "last ApprovalFY to keep"},
27
+ "naics": {"in": "spec", "desc": "keep NaicsCode values starting with these digits (e.g. 72; a list works)"}
28
+ },
29
+ "records": "$csv",
30
+ "paging": {"type": "none"},
31
+ "max_rows": 1000000
32
+ }
33
+ }
34
+ }
@@ -0,0 +1,86 @@
1
+ {
2
+ "id": "sba",
3
+ "title": "SBA loan data: 7(a) and 504 loans (FOIA loan-level files), activity reports, disaster loans",
4
+ "agency": "U.S. Small Business Administration",
5
+ "depth": "standard",
6
+ "domains": [
7
+ "small business",
8
+ "federal lending",
9
+ "federal spending"
10
+ ],
11
+ "keywords": [
12
+ "sba",
13
+ "small business administration",
14
+ "sba loans",
15
+ "7(a) loans",
16
+ "7a loans",
17
+ "504 loans",
18
+ "sba lenders",
19
+ "certified development company",
20
+ "small business lending",
21
+ "loan charge-offs",
22
+ "sba loans by state",
23
+ "sba loans by industry",
24
+ "disaster loans"
25
+ ],
26
+ "questions": [
27
+ "SBA 7(a) loans approved in a state by fiscal year",
28
+ "504 loans by industry (NAICS)",
29
+ "largest SBA lenders",
30
+ "charge-off rate of SBA loans",
31
+ "SBA loans to restaurants in a state"
32
+ ],
33
+ "homepage": "https://data.sba.gov/",
34
+ "terms_url": "https://data.sba.gov/",
35
+ "auth": {
36
+ "env": null,
37
+ "required": "none",
38
+ "placement": "none",
39
+ "signup_url": null,
40
+ "echoes_key": false
41
+ },
42
+ "limits": {
43
+ "rps": 1,
44
+ "burst": 2,
45
+ "max_rows": 1000000
46
+ },
47
+ "routes": {
48
+ "api": {
49
+ "base": "https://data.sba.gov",
50
+ "probe": "https://data.sba.gov/data.json",
51
+ "hosts": [
52
+ "data.sba.gov"
53
+ ]
54
+ },
55
+ "manual": {
56
+ "how": "Open https://data.sba.gov/, find '7(a) & 504 FOIA', download the CSV (FOIA - 7(a) or 504, by period) and upload it with ingest; the filters apply to the uploaded file."
57
+ }
58
+ },
59
+ "cache": {
60
+ "mode": "run_only",
61
+ "ttl_hours": null,
62
+ "why": "Files are replaced quarterly (the as-of date is in the file name)."
63
+ },
64
+ "redistribution": {
65
+ "mode": "allowed",
66
+ "why": "SBA publishes these loan records under FOIA as public data; U.S. government works (17 U.S.C. 105)."
67
+ },
68
+ "notices": [],
69
+ "retention": null,
70
+ "citation": "U.S. Small Business Administration, {dataset}, data.sba.gov, retrieved {retrieved_long}.",
71
+ "audit_hooks": [],
72
+ "clarify": [
73
+ "Which program? 7(a) (lender loans with an SBA guaranty) or 504 (CDC loans for real estate and equipment, with a third-party lender part): they are different files and different dollars. Default: 7(a), said as such.",
74
+ "Approvals or outcomes? GrossApproval is the approved amount (504: the CDC's part; ThirdPartyDollars is the lender's); LoanStatus and GrossChargeOffAmount describe outcomes as of the file's date. Default: count and dollars approved by ApprovalFY."
75
+ ],
76
+ "formats": [
77
+ "csv",
78
+ "json"
79
+ ],
80
+ "aliases": [
81
+ "SBA",
82
+ "Small Business Administration",
83
+ "7(a)",
84
+ "504"
85
+ ]
86
+ }
@@ -0,0 +1,60 @@
1
+ # SBA loan data: 7(a) and 504 loans (FOIA loan-level files), activity reports, disaster loans
2
+ Depth: standard. Key: none. The U.S. Small Business Administration's loan data on data.sba.gov:
3
+ - the 7(a) and 504 FOIA files: one row per approved loan since FY1991, with borrower, lender or Certified
4
+ Development Company, amount, dates, industry, location and status;
5
+ - through the catalog, the activity reports and disaster loan workbooks.
6
+
7
+ ## When to use
8
+ - SBA 7(a) or 504 loans by state, county, congressional district, industry (NAICS), lender, fiscal year; loan
9
+ sizes; charge-offs and paid-in-full status; franchise loans.
10
+ - Not here: all federal loans and grants by recipient (usaspending); PPP loans (not in these files); bank
11
+ lending in general (fdic, fed-board); business counts (census CBP).
12
+
13
+ ## Endpoints
14
+ | Endpoint | Returns | Parameters |
15
+ |---|---|---|
16
+ | `list_files` | every file in data.sba.gov's catalog: `dataset`, `title`, `format`, `file` (the path for `foia`, CSVs only), `url`, `modified` | `search` (e.g. `7(a) & 504 FOIA`) |
17
+ | `foia` | the loans of one FOIA file that pass the filters, columns as published | `file` (from `list_files`), and at least one of `state` (ProjectState), `fiscal_year`, `from`/`to` (ApprovalFY), `naics` (prefix) |
18
+
19
+ Files of 2026-11-07 (as of September 30, 2026): `uploaded_resources/FOIA_7a_FY1991_FY1999_asof_260930`,
20
+ `..._FY2000_FY2009_...`, `..._FY2010_FY2019_...`, `..._FY2020_Present_...`, `uploaded_resources/FOIA_504_FY1991_FY2009_asof_260930`,
21
+ `..._504_FY2010_Present_...`. The as-of part changes each quarter: run `list_files` first.
22
+
23
+ ## Spec example
24
+ ```json
25
+ {"description": "504 loans in Vermont approved FY2024-2025",
26
+ "requests": [{"name": "files", "endpoint": "list_files", "params": {"search": "7(a) & 504 FOIA"}},
27
+ {"name": "vt_504", "endpoint": "foia", "params": {"file": "uploaded_resources/FOIA_504_FY2010_Present_asof_260930",
28
+ "state": "VT", "from": "2024", "to": "2025"}}]}
29
+ ```
30
+
31
+ ## Data format and traps
32
+ - 504 columns (FOIA_504): AsOfDate, Program, LocationID, BorrName, BorrStreet, BorrCity, BorrState, BorrZip, CDC_Name ...,
33
+ ThirdPartyLender_Name, ThirdPartyLender_City, ThirdPartyLender_State, ThirdPartyDollars, GrossApproval,
34
+ ApprovalDate, ApprovalFY, FirstDisbursementDate, ProcessingMethod, TermInMonths, NaicsCode, NaicsDescription,
35
+ FranchiseCode, FranchiseName, ProjectCounty, ProjectState, SBADistrictOffice, CongressionalDistrict,
36
+ BusinessType, BusinessAge, LoanStatus, PaidInFullDate, ChargeOffDate, GrossChargeOffAmount, JobsSupported,
37
+ CollateralInd. 7(a) files have the lender instead of CDC and third-party columns (BankName, BankFDICNumber,
38
+ BankNCUANumber, BankStreet, BankCity, BankState, BankZip), plus SBAGuaranteedApproval, InitialInterestRate,
39
+ FixedorVariableInterestInd, RevolverStatus and SoldSecMrktInd. Read the data dictionary in `list_files`
40
+ (7a_504_foia_data_dictionary.xlsx) before use.
41
+ - `state` filters `ProjectState` (where the project is), not `BorrState`. ApprovalFY is the federal fiscal
42
+ year (October-September).
43
+ - Dollars are text with a decimal (`263000.0`). In 504 loans, `GrossApproval` is the CDC/SBA debenture and
44
+ `ThirdPartyDollars` the private lender's first lien: the project is larger than either. In 7(a),
45
+ `SBAGuaranteedApproval` is SBA's guaranteed part of `GrossApproval`: say which you sum.
46
+ - `LoanStatus` and charge-off fields are as of the file's `AsOfDate`: recent loans have had little time to
47
+ default. Compare charge-off rates by approval cohort, not across all years.
48
+ - Borrowers are named businesses (sometimes sole proprietors with a home address). Analyse in aggregate; do not
49
+ single out individuals.
50
+ - Size: the files are 60 to 255 MB. `fetch` streams them and keeps only the rows that pass the filters
51
+ (Vermont 504 FY2024-2025: 35 loans, about 7 s, on 2026-11-07).
52
+
53
+ ## Access
54
+ No key. `fetch` uses data.sba.gov (`/data.json` for the catalog, `/sites/default/files/...` for files; the CKAN API
55
+ answers 404; verified 2026-11-07). Manual: download the CSV from data.sba.gov ("7(a) & 504 FOIA"), then `ingest`
56
+ with the same filters.
57
+
58
+ ## Citation and terms
59
+ "U.S. Small Business Administration, 7(a) & 504 FOIA, <file> (as of <date>), data.sba.gov, retrieved <date>."
60
+ Public data released by SBA under FOIA.