LSMS_Library 0.2.9.dev0__py3-none-any.whl → 0.2.10.dev0__py3-none-any.whl

lsms_library-0.2.10.dev0.dist-info/METADATA

@@ -0,0 +1,290 @@
+Metadata-Version: 2.3
+Name: LSMS_Library
+Version: 0.2.10.dev0
+Summary: Abstraction layer for Living Standards Measurement Survey data
+License: CC-BY-4.0
+Author: Ethan Ligon
+Author-email: ligon@berkeley.edu
+Requires-Python: >=3.11, <4.0
+Classifier: License :: Other/Proprietary License
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Programming Language :: Python :: 3.13
+Requires-Dist: CFEDemands (>=0.7.0)
+Requires-Dist: PyYAML
+Requires-Dist: dvc[s3] (>=3.61.0,<4.0.0)
+Requires-Dist: ligonlibrary (>=0.1.1,<0.2.0)
+Requires-Dist: lsms (>=0.4.7,<0.5.0)
+Requires-Dist: openai (>=1.99.5,<2.0.0)
+Requires-Dist: pandas (>=2.2,<3.0)
+Requires-Dist: pyarrow (>=21.0.0,<22.0.0)
+Requires-Dist: pyreadstat (>=1.3.0,<2.0.0)
+Requires-Dist: python-gnupg
+Requires-Dist: scikit-learn (>=1.7.0,<2.0.0)
+Requires-Dist: xarray (>=2025.7.1,<2026.0.0)
+Description-Content-Type: text/plain
+
+#+TITLE: LSMS_Library
+#+AUTHOR: Ethan Ligon
+#+OPTIONS: toc:nil
+
+[[https://doi.org/10.5281/zenodo.17258079][https://zenodo.org/badge/796958546.svg]]
+
+A Python library providing a uniform interface to Living Standards Measurement Study (LSMS) household surveys from multiple countries and years, without the data loss typical of traditional harmonization approaches.
+
+* The Problem
+
+LSMS datasets are invaluable for studying poverty, consumption, and household welfare across developing countries. However, each country's survey uses different:
+- Variable names and encodings
+- Food classification systems
+- Questionnaire structures
+- File formats and organization
+
+Researchers typically spend weeks learning each new dataset's idiosyncrasies or use pre-harmonized datasets that sacrifice detail and comparability. Cross-country or longitudinal analyses become prohibitively time-consuming.
+
+* The Solution
+
+LSMS_Library provides an *abstraction layer* that gives you a consistent interface to work with any supported LSMS dataset. Instead of harmonizing the data itself (which loses information), we harmonize the /way you access/ the data.
+
+This means you can:
+- Write analysis code once and apply it to multiple countries/years
+- Switch between datasets without rewriting your code
+- Preserve the full detail and structure of the original surveys
+- Extend support to new surveys by writing simple YAML configuration files
+
+* Quick Start
+
+#+begin_src python
+import lsms_library as ll
+
+# Load a country's LSMS data
+uga = ll.Country('Uganda')
+
+# See available survey waves
+print(uga.waves)
+# ['2005-06', '2009-10', '2010-11', '2011-12', '2013-14', '2015-16', '2018-19', '2019-20']
+
+# See available standardized data types
+print(uga.data_scheme)
+# ['people_last7days', 'food_acquired', 'food_expenditures', 'food_prices', 
+#  'household_characteristics', 'income', 'nutrition', ...]
+
+# Access standardized food expenditure data across all waves
+food_exp = uga.food_expenditures()
+# Returns a multi-indexed DataFrame with household, time, region, and food item
+#+end_src
+
+* Key Features
+
+- *Uniform Interface*: Access variables using consistent names across countries (e.g., =food_expenditures()=, =household_characteristics()=)
+- *Multi-Wave Panel Support*: For countries with panel surveys, household IDs are automatically standardized across waves, enabling longitudinal analysis without manual matching
+- *Zero Data Loss*: Original data structure and detail preserved; access raw data through the same interface
+- *Standardized Data Schemes*: Common data types (=food_prices=, =nutrition=, =income=, etc.) mapped across all countries
+- *DVC Integration*: Stream data from remote storage without filling your disk
+- *Extensible*: Add new surveys by creating YAML configuration files (no Python required)
+- *Multiple Countries*: Supports LSMS surveys from Nigeria, Tanzania, Uganda, Ethiopia, Malawi, and more
+
+* Installation
+
+#+begin_src bash
+pip install LSMS_Library
+#+end_src
+
+** Data Access
+
+The library uses DVC (Data Version Control) to manage data stored in remote S3 buckets. To access the data, you'll need credentials:
+
+- *Read access*: Contact ligon@berkeley.edu for read-only credentials to access the data
+- *Write access (contributors)*: To contribute new datasets, contact ligon@berkeley.edu for write credentials. You'll need to establish [[https://docs.github.com/en/authentication/managing-commit-signature-verification/generating-a-new-gpg-key][GPG/PGP credentials]] for secure access.
+
+Once you have credentials, the library will handle data streaming automatically.
+
+* Usage Examples
+
+** Working with Food Consumption Data
+
+#+begin_src python
+import lsms_library as ll
+
+# Load country data
+uga = ll.Country('Uganda')
+tza = ll.Country('Tanzania')
+
+# Access food expenditure data with consistent structure
+uga_food = uga.food_expenditures()
+tza_food = tza.food_expenditures()
+
+# Both return DataFrames with the same multi-index structure:
+# Index: (household_id, time, region, food_item)
+# Even though the original surveys have completely different formats
+
+# Access other standardized data types
+prices = uga.food_prices()
+nutrition = uga.nutrition()
+income = uga.income()
+#+end_src
+
+** Cross-Country Comparison
+
+#+begin_src python
+import lsms_library as ll
+import pandas as pd
+
+# Load multiple countries
+countries = {
+    'Uganda': ll.Country('Uganda'),
+    'Tanzania': ll.Country('Tanzania'),
+    'Nigeria': ll.Country('Nigeria')
+}
+
+# Collect food expenditure data from all countries
+expenditure_data = {}
+for name, country in countries.items():
+    df = country.food_expenditures()
+    df['country'] = name
+    expenditure_data[name] = df
+
+# Combine into a single DataFrame for analysis
+combined = pd.concat(expenditure_data.values(), ignore_index=False)
+
+# Now you can analyze across countries with consistent variable names
+# e.g., compare rice prices, consumption patterns, etc.
+#+end_src
+
+** Panel Data Analysis
+
+For countries with panel surveys, household IDs are already harmonized across waves:
+
+#+begin_src python
+import lsms_library as ll
+
+# Load a country with panel data
+uga = ll.Country('Uganda')
+
+# Get food expenditures across all waves
+food_exp = uga.food_expenditures()
+
+# The multi-index includes time (wave), so you can track households over time
+# Index levels: (household_id, time, region, food_item)
+
+# Example: Track a specific household across waves
+household_id = '00c9353d8ebe42faabf5919b81d7fae7'
+household_over_time = food_exp.xs(household_id, level='i')
+
+# Or analyze changes between specific waves
+wave_2015 = food_exp.xs('2015-16', level='t')
+wave_2019 = food_exp.xs('2019-20', level='t')
+
+# Check panel structure and attrition patterns
+panel_structure = ll.local_tools.panel_attrition(
+    uga.household_characteristics(), 
+    uga.waves
+)
+# Returns a matrix showing number of households appearing in each wave pair:
+#         2005-06 2009-10 2010-11 2011-12 2013-14 2015-16 2018-19 2019-20
+# 2005-06    3122    2606    2386    2363    1566    1470    1358    1290
+# 2009-10     NaN    2974    2617    2581    1685    1578    1454    1379
+# ...
+# Diagonal shows total households per wave; off-diagonal shows panel overlap
+#+end_src
+
+** Exploring Available Data
+
+#+begin_src python
+import lsms_library as ll
+
+uga = ll.Country('Uganda')
+
+# See all available survey waves
+print(uga.waves)
+# ['2005-06', '2009-10', '2010-11', '2011-12', '2013-14', '2015-16', '2018-19', '2019-20']
+
+# See all standardized data types available
+print(uga.data_scheme)
+# ['people_last7days', 'cluster_features', 'shocks', 'earnings',
+#  'food_acquired', 'nutrition', 'household_characteristics',
+#  'food_quantities', 'food_expenditures', 'food_prices',
+#  'panel_ids', 'income', 'enterprise_income', 'other_features']
+
+# Access any standardized data type using the same pattern
+household_chars = uga.household_characteristics()
+shocks = uga.shocks()
+earnings = uga.earnings()
+#+end_src
+
+* Available Datasets
+
+The library currently supports LSMS surveys from:
+- *Ethiopia*: Multiple waves from the LSMS-ISA program
+- *Malawi*: Multiple waves including panel data
+- *Nigeria*: GHS-Panel surveys
+- *Tanzania*: NPS surveys
+- *Uganda*: UNPS surveys
+- And more...
+
+For a complete list of available surveys, see the country directories in the repository.
+
+* Adding New Surveys
+
+Adding a new LSMS survey requires no Python programming—just create YAML configuration files that map the survey's variables to the standardized interface. See [[file:CONTRIBUTING.org][CONTRIBUTING.org]] for detailed instructions.
+
+Brief overview:
+1. Create directory structure: =Country/Year/Documentation= and =Country/Year/Data=
+2. Add source data using DVC
+3. Create YAML files mapping variables to standard names
+4. Submit a pull request
+
+* Documentation
+
+- *Food Classification*: Food items are standardized for spelling and format within each country. Note that food categories differ significantly across countries (e.g., what constitutes "Beans" in Uganda may not match Tanzania's classification), so cross-country food comparisons should be done carefully.
+- *Variable Mappings*: YAML files in each survey directory show how local variables map to standard names
+- *Panel IDs*: For countries with panel surveys, household identifiers are harmonized automatically across waves
+- *API Reference*: [Coming soon]
+
+* Contributing
+
+We welcome contributions! Whether you're:
+- Adding new survey datasets
+- Improving variable mappings
+- Fixing bugs
+- Improving documentation
+
+See [[file:CONTRIBUTING.org][CONTRIBUTING.org]] for detailed guidelines on adding new datasets using DVC.
+
+* Citation
+
+If you use LSMS_Library in your research, please cite:
+
+#+begin_src bibtex
+@software{ligon25:lsms_library,
+  author =    {Ethan Ligon},
+  title =     {{\tt LSMS_Library}: Abstraction layer for working with Living Standards Measurement Surveys},
+  year =      2025,
+  doi = {10.5281/zenodo.17258079},
+  url = {https://pypi.org/project/lsms_library/}
+}
+#+end_src
+
+* License
+
+See the [[file:LICENSE][LICENSE]] file in the repository for details.
+
+* Contact
+
+For questions, issues, or collaboration:
+- *Data Access*: Email ligon@berkeley.edu for read or write credentials
+- *GitHub Issues*: Report bugs or request features at the repository
+- *Contributing*: Contact ligon@berkeley.edu to discuss contributions (GPG/PGP credentials required for write access)
+
+* Acknowledgments
+
+This project builds on data collection efforts by:
+- The World Bank's Living Standards Measurement Study (LSMS) team
+- National statistical offices in participating countries
+- The LSMS-ISA initiative
+
+---
+
+*Note*: This library is under active development. APIs may change as we refine the abstraction layer based on user feedback.
+

{lsms_library-0.2.9.dev0.dist-info → lsms_library-0.2.10.dev0.dist-info}/RECORD

@@ -1,10 +1,9 @@
 lsms_library/Makefile,sha256=5iTMKOlMuK29OtDrqIrjGztt-ivnIw0l8UWI8UR0alU,607
 lsms_library/README.org,sha256=Nm5shD0nZnG_CyFXrJRK78RQJ6bNbHKL3UyVf4tK0rI,810
-lsms_library/__init__.py,sha256=BXz5Xm1FW_0Ebo9NCa05QBhg4-LyntFUx1vI78ILn-E,207
+lsms_library/__init__.py,sha256=E9n7mLvK93sxpVcsjkuB8pv9sNyJq002wXfu-g50Png,382
 lsms_library/categorical_mapping/ai_agent.py,sha256=uN4DZmpeLyl3E03AS-50Acb4bjNhL5BByHIZwbxtwfw,6268
 lsms_library/categorical_mapping/categorical_mapping_helper.py,sha256=P6vHZf2vdXPmIr-FcidikaJZFtp025cRAMA2lBG_nMo,5310
 lsms_library/categorical_mapping/spelling.yml,sha256=c5n0WudZZ3DHzG9dhi6-jzfUt9f29op6jvHyYavPPCI,20
-lsms_library/contributing.org,sha256=KkW9ioEh6snUP5sEbSl42nhjfc-pr2rcd0F4NAd7tkU,7564
 lsms_library/countries/.dvc/.gitignore,sha256=zaP8GkzpZZyxmBi7Bl7ujFJxeVSE9J8xTKA1e02uxu8,26
 lsms_library/countries/.dvc/config,sha256=oWXrcncknTjZRLXS0XcHmaJB0FX6DZNgkRdgY6dOVqc,388
 lsms_library/countries/.dvc/plots/confusion.json,sha256=jUW3NJJZlg4e-CFa4s8hEEvqnsWpLVGt_3cgBwt9iqE,740
@@ -561,6 +560,13 @@ lsms_library/countries/Bosnia-Herzegovina/2002/Documentation/LiBiHW2_Showcards.p
 lsms_library/countries/Bosnia-Herzegovina/2002/Documentation/LiBiH_W2_Report.pdf.dvc,sha256=RFyMsOrYSK7pVWoXOfA6hvcT_2RzCeHVVNUjAWLoRng,101
 lsms_library/countries/Bosnia-Herzegovina/2002/Documentation/SOURCE.org,sha256=k7ny1ZHhazO8b4XYlIPUWVTO5eKMuhXC7JrF6bKzD-M,39
 lsms_library/countries/Bosnia-Herzegovina/2002/Documentation/Wave2quest.pdf.dvc,sha256=TW3zWexbNehwOKHvbzteJ2k_aW2_UW2f8Wgpc1WDmZA,96
+lsms_library/countries/Bosnia-Herzegovina/2003/Data/cbh_ind_weighs.dta.dvc,sha256=I41Og9foBpJj3taWfJmUZlr0h4c7Kq_phrKuSJh_ceg,100
+lsms_library/countries/Bosnia-Herzegovina/2003/Data/cbhcfhh.dta.dvc,sha256=bTPdxrLidHm32dwkmqpYW5s-7LjusoQFni_X76oYYQE,93
+lsms_library/countries/Bosnia-Herzegovina/2003/Data/cbhcfind.dta.dvc,sha256=1cP6f_hp-72KBcZEEE6v3MF1UjeBi6dI1r8k6P4qdIQ,95
+lsms_library/countries/Bosnia-Herzegovina/2003/Data/cbhhhpos.dta.dvc,sha256=BufJIuDzL2G0FirsFp0zU9b93Wfu2N-2nDje57A9Vlc,93
+lsms_library/countries/Bosnia-Herzegovina/2003/Data/cbhihh.dta.dvc,sha256=u1a7Xr0TA6sUa12Uy4YM9VTUllwJ8UwVOn6s_WrssRY,93
+lsms_library/countries/Bosnia-Herzegovina/2003/Data/cbhiind.dta.dvc,sha256=WCsNOWTcEWHc1BmrqsScblk8iBLTiMpIsMMGerJpGeA,95
+lsms_library/countries/Bosnia-Herzegovina/2003/Data/cbhjhist.dta.dvc,sha256=uSMiZEYGxpR-_7NJTPY8kg84HQbzd57XEKkoT4o_go0,94
 lsms_library/countries/Bosnia-Herzegovina/2003/Documentation/.gitignore,sha256=f4NZU5jdzVTClcpE7gscUMOE1b2n0fCNP_AS3Xp7XCA,65
 lsms_library/countries/Bosnia-Herzegovina/2003/Documentation/LICENSE.org,sha256=hHKoLzbrg-KXmKEhNpegQ-VVv86wOXPqxYxsICrq4Xo,2235
 lsms_library/countries/Bosnia-Herzegovina/2003/Documentation/LiBiH3_Showcards.pdf.dvc,sha256=zShLHsySwjwexWiEcF5mdgyKG8ZfUWeezhhkp95Ofjs,101
@@ -1320,6 +1326,8 @@ lsms_library/countries/China/1995-97/Documentation/LICENSE .org,sha256=hHKoLzbrg
 lsms_library/countries/China/1995-97/Documentation/SOURCE.org,sha256=Usezh7djP7E20iHCDt-6YeATFEZ6ZHsQDXRxPu4UqZ4,39
 lsms_library/countries/China/1995-97/Documentation/chnbinfo.pdf.dvc,sha256=qyo7JgLtaxvIY1lelUiJ-m93zGIBYCb0Yz95BCw-8oQ,94
 lsms_library/countries/China/1995-97/Documentation/chnville.pdf.dvc,sha256=nUHW7J3OWide8mdJVCJjV9Ot1oDc4U-zdLgPqd1BRVo,94
+lsms_library/countries/China/1995-97/_/data_info.yml,sha256=gCcpSvwVcpK_KVID_10c3E3MGADMVh5CHrgmhYi-Ue4,569
+lsms_library/countries/China/_/data_scheme.yml,sha256=_P_uDdb1_7O9bvy6c2aVcPuykPTZ-0JDqWQqvmcg1cA,120
 lsms_library/countries/China/var/.gitkeep,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
 lsms_library/countries/CotedIvoire/1985-86/Data/.gitignore,sha256=AW2nKYQGxDmYyQB6FfdHGU9XFLi_Y9zEb51a1tPm83U,1684
 lsms_library/countries/CotedIvoire/1985-86/Data/COMM85.DAT.dvc,sha256=shSXnHCu3VsMSSeODalfRrr8XK6UuCLXhz9W3Syz100,65
@@ -4368,6 +4376,9 @@ lsms_library/countries/India/1997-98/Documentation/SOURCE.org,sha256=Yb30WuTpaFH
 lsms_library/countries/India/1997-98/Documentation/ddi-documentation-english_microdata-276.pdf.dvc,sha256=whrCGd1ACTDomoKWvLmqtCEKX367KIauVYlfHkNejxk,126
 lsms_library/countries/India/1997-98/Documentation/slc-cq97.pdf.dvc,sha256=j3Gtp905d3rcKQCQmiOiBu_d0XEchjDwqFEpwF7I6tQ,94
 lsms_library/countries/India/1997-98/Documentation/slc-hh97.pdf.dvc,sha256=FqLSztWUIYfzeGtajpORunFwjKqnKJhJaREbdgGW1OU,94
+lsms_library/countries/India/1997-98/_/data_info.yml,sha256=_0Auz6xw1UlcvPbF-TRbDOWSklZuZ-I9j6gC1irLJ10,405
+lsms_library/countries/India/1997-98/_/testing.py,sha256=yeLH5xkiegKOjS7lBuWtXtXlfPPxdNHpO5CaEw9PES8,207
+lsms_library/countries/India/_/data_scheme.yml,sha256=eUhs_1cPRm_RJevlfU5Pwrp5jU7yfED0qDbcWNCY76I,213
 lsms_library/countries/India/var/.gitkeep,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
 lsms_library/countries/Iraq/2006-07/Data/2007ihses00_cover_page.dta.dvc,sha256=sOvbfyNWmNBZF-M0sgjfpFvGTlrcbEOHDgOaumCO3Ck,97
 lsms_library/countries/Iraq/2006-07/Data/2007ihses01_household_roster.dta.dvc,sha256=salp4zLuymHyGy8yvzZj4QIqPbWkw1tILo8VIzxLOOA,103
@@ -4403,6 +4414,7 @@ lsms_library/countries/Iraq/2006-07/Documentation/Vol.1_Objectives_methodology.p
 lsms_library/countries/Iraq/2006-07/Documentation/Vol.2_Data_Tables.pdf.dvc,sha256=mm8RkleXT4MDMpblEMPbKXStHZ9pfw51MNkEsUIm_EA,104
 lsms_library/countries/Iraq/2006-07/Documentation/Vol.3_Annexes.pdf.dvc,sha256=5HLW6H22Lkh142JDemIosu7PxX_Hb1KgI7YeCIKOHPQ,100
 lsms_library/countries/Iraq/2006-07/Documentation/ddi-documentation-english_microdata-69.pdf.dvc,sha256=Y9G6oDABReY6uEaVhtX7d8RqiEEBYtbMG-5GiW7yNjA,124
+lsms_library/countries/Iraq/2006-07/_/data_info.yml,sha256=KAjXCpTBizdmNkCvD5ffFs_zHK7OkDug0MhK55_sMJ0,234
 lsms_library/countries/Iraq/2012/Data/2012ihses00_cover_page.dta.dvc,sha256=DnD06_VnaHQL6KU45_VngmRQkQ1G99-Y56qJRhDs0Is,97
 lsms_library/countries/Iraq/2012/Data/2012ihses01_household_roster.dta.dvc,sha256=A_h0Q5gjiOxMis0eaMZIgYZDO0ZrgfSCWb8JJFl-vIg,104
 lsms_library/countries/Iraq/2012/Data/2012ihses02_migration.dta.dvc,sha256=z_wnk1oebilTYvpoiwjPY2DPzHfMPWy0BzhtaPW43wo,96
@@ -4441,6 +4453,8 @@ lsms_library/countries/Iraq/2012/Documentation/Part_3_Income_and_Other_13_24.pdf
 lsms_library/countries/Iraq/2012/Documentation/Part_4_Household_Diary.pdf.dvc,sha256=_Wqpv-HmQk2AtydBCLAoy2SJ4DDxkPIjC19kxlWSA-4,108
 lsms_library/countries/Iraq/2012/Documentation/SOURCE.org,sha256=ybqzmCDvqxywQC5iybKtXoVQ_IFl-tuGyqDUSfF7ruY,39
 lsms_library/countries/Iraq/2012/Documentation/ddi-documentation-english_microdata-2334.pdf.dvc,sha256=IU3wWVviZcOP6BTvKQgJcYrswyHSEVLVCG5H4kUF8HY,126
+lsms_library/countries/Iraq/2012/_/data_info.yml,sha256=7mozHQaehgXBUu3hCIeTdG4_OsmTYOTHa0YVmUoHvHU,227
+lsms_library/countries/Iraq/_/data_scheme.yml,sha256=eeUL3MVz20BCmAoMM11kWLFpFyj7Z-DdUKaZKIBeav4,113
 lsms_library/countries/Iraq/var/.gitkeep,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
 lsms_library/countries/Kazakhstan/1996/Data/KAZ96CON.dta.dvc,sha256=GLYknvFFwyyO6FEbH2QGscyesFU_NSvb6CvoWbxFh_E,82
 lsms_library/countries/Kazakhstan/1996/Data/KOMMU.dta.dvc,sha256=55fiOKHBFQaBwXiCjTI63nm1dBkC0JeHot6X0wzr5OQ,79
@@ -4569,6 +4583,8 @@ lsms_library/countries/Kosovo/2000/Documentation/SOURCE.org,sha256=tk9iehUMICMZ-
 lsms_library/countries/Kosovo/2000/Documentation/comeng.pdf.dvc,sha256=anQ7_RpUFUCIXJf0mUAEOcTJrkW64O1ecekreX07L6A,91
 lsms_library/countries/Kosovo/2000/Documentation/hhalb.pdf.dvc,sha256=vJkDT1WqeoY2IzjDKO4m4E7RK_cHWXCOL04pJmqsHYo,91
 lsms_library/countries/Kosovo/2000/Documentation/hheng.pdf.dvc,sha256=nkj__dSYNm_s22cUtwXRLsLHsRaFtoFTq4sxPfc08f0,91
+lsms_library/countries/Kosovo/2000/_/data_info.yml,sha256=ZU7TkPmgroRqFoVA_KO045x_RdXDOH8XPXDmK_5wFcY,245
+lsms_library/countries/Kosovo/_/data_scheme.yml,sha256=JRWIz-Wik-brDIu48Fpd-Q6z4MARYZBp_Nn8Oowbnmc,137
 lsms_library/countries/Kosovo/var/.gitkeep,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
 lsms_library/countries/Kyrgyz Republic/1993/Data/CONADULT.DTA.dvc,sha256=YUI91TSkzNjbM-UaONG6pYmu2AZukL3iy0YdJKqRpVw,81
 lsms_library/countries/Kyrgyz Republic/1993/Data/CORE.DTA.dvc,sha256=G2Zu33e-Az_NEjVn-RTbmIcExV79JHY-ME1oG6Ah8-0,77
@@ -4777,6 +4793,8 @@ lsms_library/countries/Liberia/2018-19/Documentation/SOURCE.org,sha256=bHYsb-3cm
 lsms_library/countries/Liberia/2018-19/Documentation/ddi-documentation-english_microdata-3787.pdf.dvc,sha256=NmlcYyw21wzlbGp1F3QWedrdgyel2b1CIIaLg40_8ao,125
 lsms_library/countries/Liberia/2018-19/Documentation/liberia_comm_forestry_qx_final.pdf.dvc,sha256=bfqLK89eBUQ8Y1nmI_B7nTUX82Q0GJyj2D0sO_8pavQ,116
 lsms_library/countries/Liberia/2018-19/Documentation/liberia_hh_forestry_qx_final.pdf.dvc,sha256=UMoV052YMIdLqx7lervz4wQ5wQ2RLm_Y4W9aVAnleR4,115
+lsms_library/countries/Liberia/2018-19/_/data_info.yml,sha256=96AkKeBPqro-9TRK6-BUagqEW-565C_wJ5wwM2L_JNw,230
+lsms_library/countries/Liberia/_/data_scheme.yml,sha256=XaNNV0FFpmoTRKyjmS4wBoxmCgRSxN1fD5L-PwL_fD0,115
 lsms_library/countries/Liberia/var/.gitkeep,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
 lsms_library/countries/Malawi/2004-05/Data/Filters.dta.dvc,sha256=BBYvecXxr__uAavqezUhOuak15ZYsH_7aXgKSf_Q3eY,81
 lsms_library/countries/Malawi/2004-05/Data/ihs2_ag.dta.dvc,sha256=RiJ2vxmI1xM4owEa2PJ0KUNecNjujMZT-M2Ve4SNeVU,82
@@ -7312,7 +7330,7 @@ lsms_library/countries/Nigeria/_/food_items.org,sha256=oPCR6IadDycjB5t13d1oUUVpR
 lsms_library/countries/Nigeria/_/food_items0.org,sha256=mlHnzXfdnKu_auqryaQjlHOJJIJZBbkDen1qfYjlzTc,65110
 lsms_library/countries/Nigeria/_/food_quantities.py,sha256=sGN2WpqZOlxgXNbfNUjr5I3UwhNRAoAf1Jvn77kz-Wc,569
 lsms_library/countries/Nigeria/_/household_characteristics.py,sha256=aV5nmjri7R2cdpE5QaPcX7p1FE5TLXREES0UJKWAsTE,467
-lsms_library/countries/Nigeria/_/household_roster.py,sha256=CezzWwnXj-2KluD0PtYeAnBj_Un23tU_Dy9afcv1Q4o,353
+lsms_library/countries/Nigeria/_/household_roster.py,sha256=JPRqA8qAP5rA_0aNy2Q0fOSb40dzwRRJI-KuatLkY4k,322
 lsms_library/countries/Nigeria/_/nigeria.py,sha256=VrFJfQHQtx22siFINUaCv1KIW2A5lrBeLIRR4W-WFTk,227
 lsms_library/countries/Nigeria/_/nonfood_expenditures.py,sha256=dL2vh928a3g-G29uH2Eki6Aaq6Bs6_kJtYaen6nMmXw,584
 lsms_library/countries/Nigeria/_/nonfood_items.json,sha256=77fSHMuKy1pSbpNgwK0ZZJaEj9coiGvg_3ktfImQL8o,18785
@@ -8505,11 +8523,13 @@ lsms_library/countries/Serbia/2007/Documentation/srb07hhqe.pdf.dvc,sha256=11y-xD
 lsms_library/countries/Serbia/2007/Documentation/srb07water_e.pdf.dvc,sha256=tK59MOc8ltT9jpqw0rlzx_tlazpWy_1PAneAQZ1SQUE,98
 lsms_library/countries/Serbia/2007/Documentation/studijaE.pdf.dvc,sha256=71QeSXTmj2IzpVMv9b1qFzNRQqy4u-ZFK-DRkTZ9edo,95
 lsms_library/countries/Serbia/2007/Documentation/studijaS.pdf.dvc,sha256=Uvd3s1588MBpy17GBeDY0hoBpP_dSyrGJC4gvoyK7pg,95
+lsms_library/countries/Serbia/2007/_/data_info.yml,sha256=W952pJvIWvD8WebBlxKiw0UzJLG_515znIgknf7UzNs,248
 lsms_library/countries/Serbia/2007/_/food_acquired.py,sha256=bof4-P8p8iqyYTtFtLNz_6tAIFc6ayBypfdpofo7nCM,1023
 lsms_library/countries/Serbia/2007/_/household_characteristics.py,sha256=6o3oR7u2k_g8JC5F1sieYJ1o1QeO9pQHyts3Xy2eIh0,967
 lsms_library/countries/Serbia/2007/_/other_features.py,sha256=owQ5XhtFhJDjGJ3XFZ1w5JUKkzl0FaeolHaeDGF8DNM,679
 lsms_library/countries/Serbia/_/CONTENTS.org,sha256=3vMLD3o0GUKo04LzLB-uU8dSZIDuIArbRg7pfDPzapc,759
 lsms_library/countries/Serbia/_/Makefile,sha256=GO0nnWostmsY7cYll_uQTQT-Zt9QuPs7ImR0QFQsfNQ,1697
+lsms_library/countries/Serbia/_/data_scheme.yml,sha256=bWrgdn_omKuP811lws9FI7oGxgDvh0k3XS0xUZNbC_c,142
 lsms_library/countries/Serbia/_/food_acquired.py,sha256=VuWD0KPNzAKTxi3y9OZamjM8DY46hX1QCHzdh2wYkfY,836
 lsms_library/countries/Serbia/_/food_prices_quantities_and_expenditures.py,sha256=V0CWqF_3JoNMIKaqnZkDt3MxmPz8X-gMY9bk3ueYON4,629
 lsms_library/countries/Serbia/_/household_characteristics.py,sha256=kUwQspNgz5dTGXul6b40tpH8IMNgMcaiem7aCogQc0g,758
@@ -8545,6 +8565,7 @@ lsms_library/countries/Serbia and Montenegro/2002/Documentation/LSMS_Project_200
 lsms_library/countries/Serbia and Montenegro/2002/Documentation/Poverty_Results_SerbianLSMS(PHHS).pdf.dvc,sha256=Jhdq6XRUWSf5esq5i5TymS1apUS193WzOcHeYwsTLlk,119
 lsms_library/countries/Serbia and Montenegro/2002/Documentation/SOURCE.org,sha256=UhN-_0TNvsWCtnonVuIidDxv8rZwwwN39pNiczgCuSo,39
 lsms_library/countries/Serbia and Montenegro/2002/Documentation/Serbhhq02e.pdf.dvc,sha256=VHZ7y8vblsmWbXdbmeCJJ233xDgjeD9K3ZSMvcZEdek,97
+lsms_library/countries/Serbia and Montenegro/2002/_/data_info.yml,sha256=vpCllQFQxcLmAk8oULvto7yy74UqWmZjiVdEbd23dEk,214
 lsms_library/countries/Serbia and Montenegro/2003/Data/2003 1 demography.dta.dvc,sha256=nvA6qZ3OP8bsq4SnB5fjMr_YL4dplOZ9qUD3HiFljiU,91
 lsms_library/countries/Serbia and Montenegro/2003/Data/2003 2 housing and durables.dta.dvc,sha256=eytLCn5GgtP3wwwAg4QGZdZKnD8_XjqRviBkftnLLn4,102
 lsms_library/countries/Serbia and Montenegro/2003/Data/2003 3 agriculture.dta.dvc,sha256=Rg1X6EEG_8qE39GWH_JSZbNXXK7ZswzxfLEWqTNPotM,92
@@ -8573,6 +8594,8 @@ lsms_library/countries/Serbia and Montenegro/2003/Documentation/LICENSE.org,sha2
 lsms_library/countries/Serbia and Montenegro/2003/Documentation/LSMS_Project_2002_2003_text.pdf.dvc,sha256=7nOddgqJP2R69GvOThCgGATuEwhjPCmiIURxHytGl50,114
 lsms_library/countries/Serbia and Montenegro/2003/Documentation/SOURCE.org,sha256=x4ynO5B1Z0rtVh4D3Of1mjNVepD5dj_vy-xNOSW7EVo,39
 lsms_library/countries/Serbia and Montenegro/2003/Documentation/serb03hhqe.pdf.dvc,sha256=1EsupHfd4up08Sy6D8628yPlxeETXwuzRznPbJk-3TM,97
+lsms_library/countries/Serbia and Montenegro/2003/_/data_info.yml,sha256=FQStt09sTDpww9GDj0-Sa_MoXXpTECBcr8zj_9ryDsQ,229
+lsms_library/countries/Serbia and Montenegro/_/data_scheme.yml,sha256=EuUmpcgWuL76H0OilutEq9EbUZTYg9jePURol4pZQH8,131
 lsms_library/countries/Serbia and Montenegro/var/.gitkeep,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
 lsms_library/countries/South Africa/1993/Data/CFPRI01.dta.dvc,sha256=hYUCxcbGV6l7OxqnRuRR-Jh-1TuXqz0Ie1ztqnhU4yk,81
 lsms_library/countries/South Africa/1993/Data/CFPRI03.dta.dvc,sha256=341vRh51v4LTcHK2GVm4htUnWjCTqZTtfalUjtvtsUc,81
@@ -8649,6 +8672,8 @@ lsms_library/countries/South Africa/1993/Documentation/.gitignore,sha256=Dqp2Pux
 lsms_library/countries/South Africa/1993/Documentation/LICENSE.org,sha256=hHKoLzbrg-KXmKEhNpegQ-VVv86wOXPqxYxsICrq4Xo,2235
 lsms_library/countries/South Africa/1993/Documentation/SOURCE.org,sha256=ezsBYJSzagwijdsDYUN85-XaTbGjjc4xHvOxCT1XCwI,39
 lsms_library/countries/South Africa/1993/Documentation/za94hh85_V2.pdf.dvc,sha256=yjsHNVEADEB7tGa4VGrAG1rLg1zQ_KNz2Z3M5vLCmSM,97
+lsms_library/countries/South Africa/1993/_/data_info.yml,sha256=BMivVV0K5zBXzPTErWRcuGh3ok_jV-yXejTtvOGsVRk,1015
+lsms_library/countries/South Africa/_/data_scheme.yml,sha256=wD5WF1jLwDAfOf3GtVjEiJ67bVb_hVlT-InNHDlvW-I,122
 lsms_library/countries/South Africa/var/.gitkeep,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
 lsms_library/countries/Tajikistan/1999/Data/SHLDDTA.DTA.dvc,sha256=Ai0xA2jof_2FCR8293xT79_TTUCCN9pSl4RlyuCRB0c,81
 lsms_library/countries/Tajikistan/1999/Data/SINDIV.DTA.dvc,sha256=f6jGAPYMeR1DDFHVAbTDILOONE7ehCML1_gIb1hbi2A,80
@@ -9331,6 +9356,8 @@ lsms_library/countries/Timor-Leste/2007-08/Documentation/TLSLS2_Questionnaire_(E
 lsms_library/countries/Timor-Leste/2007-08/Documentation/TLSLS_X_Questionnaire_(English)_2.pdf.dvc,sha256=4W2LC9CRNmOfkiXXmdCr1cV2eziADvvznfTeig5I_QM,119
 lsms_library/countries/Timor-Leste/2007-08/Documentation/TLSS_annexes.pdf.dvc,sha256=-d_NNwT9ZjRvmKcElrrPi4dVxoeWogLhP4LSe3vQUpo,99
 lsms_library/countries/Timor-Leste/2007-08/Documentation/ddi-documentation-english_microdata-78.pdf.dvc,sha256=VoCIDgeIPJsKgfRw3wfY_9VgUaQffLuRThXwQoU9RRQ,124
+lsms_library/countries/Timor-Leste/2007-08/_/data_info.yml,sha256=lQDowO_c-jxblatVfuyfgGkvygt6VbAGzEW67nW8YP0,216
+lsms_library/countries/Timor-Leste/_/data_scheme.yml,sha256=wNKRtYT92AcjvE6uHHIJoX8nsrG-Csy-tZZMl7juauc,120
 lsms_library/countries/Timor-Leste/var/.gitkeep,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
 lsms_library/countries/Togo/2018/Data/.gitignore,sha256=DkVQtzNU0iKAlFZYmIdm-iTvu1hjF5RDPO__6ngVm7U,282
 lsms_library/countries/Togo/2018/Data/Togo_survey2018_fooditems_forEthan.dta.dvc,sha256=XwvtbU-7a12XN6C3XGb7-y1MFgUe2kZ0KH9FEtu6LAA,110
@@ -9400,11 +9427,13 @@ lsms_library/countries/Togo/2018/Documentation/tgo_ehcvm1_qnr_community_excel_va
 lsms_library/countries/Togo/2018/Documentation/tgo_ehcvm1_qnr_community_excel_vague2.xls.dvc,sha256=RM7WWGt6OScpydO-zocb0diNm5wiaxaxP6pzBDqMgH0,123
 lsms_library/countries/Togo/2018/Documentation/tgo_ehcvm1_qnr_household_excel_vague1.xls.dvc,sha256=sFEfHv5PKy_iC4ez3VKXRFKktNUKOGN6bgJMQcWuLNs,123
 lsms_library/countries/Togo/2018/Documentation/tgo_ehcvm1_qnr_household_excel_vague2.xls.dvc,sha256=25-mX1XN7sybAeSNwtVICjwRRDA_SIi6r3MvgSTQBew,124
+lsms_library/countries/Togo/2018/_/data_info.yml,sha256=DuH3gIBk8vpkE1aowJ3l0iZ8v897dOs6QV_zbomjbT0,221
 lsms_library/countries/Togo/2018/_/food_expenditures.py,sha256=SeBh5psVUOxLNkTZh_xj7XJwxOcKsvm9Ufp6JPDHM54,2862
 lsms_library/countries/Togo/2018/_/household_characteristics.py,sha256=dbB0-3rOBtc_Z2iwKf0UoGZhvfBWKr85z9fk0whZuEc,1419
 lsms_library/countries/Togo/2018/_/nonfood_expenditures.py,sha256=5oKZ0lORZ2byCZ-BaUgehCicx1tdaabAOdK6dOmglis,1435
 lsms_library/countries/Togo/2018/_/notes.org,sha256=TLbHUKht2eRuxQWbDTkmOmLWVS3yM-UusmL_ee1Hhqo,92274
 lsms_library/countries/Togo/_/Makefile,sha256=PvuyN0N6WNzrg5MH00amaR52lhRZpEWn5dBOWId4qTc,1710
+lsms_library/countries/Togo/_/data_scheme.yml,sha256=gco8cm3MQTgC9opfNDurc9lFo6kK1qukfIYe0LuPb_g,111
 lsms_library/countries/Togo/_/food_items.org,sha256=LeyZS0s2I6MT5F64ETiXbzhH3NRqnu5hrsJBdWNYyFk,29774
 lsms_library/countries/Togo/_/togo.py,sha256=4qX0A7bCR3PWcr9f8lmz2nFVP5kKTE4_hGDEni1Fupg,3145
 lsms_library/countries/Togo/var/.gitkeep,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
@@ -9487,7 +9516,7 @@ lsms_library/countries/Uganda/2005-06/Documentation/UNHS.2005-06.CommQuest_final
 lsms_library/countries/Uganda/2005-06/Documentation/UNHS.2005-06.Household.Questionnaire.FINAL.pdf.dvc,sha256=NuESUFEsMG10Gm0poidecd3lTFVwh4-2j22ayosZtkY,129
 lsms_library/countries/Uganda/2005-06/Documentation/UNHS.2005-06.Interviewer.Manual.FINAL.pdf.dvc,sha256=6urVSwN3_57SkfWcieq6NzlTbbVm9gxt0WHg5ywuXXs,123
 lsms_library/countries/Uganda/2005-06/_/assets.py,sha256=Lh9BVYNv4DRRgjC6h1S2HK_JMmjLzn8LQYaUpv8yH9w,417
-lsms_library/countries/Uganda/2005-06/_/data_info.yml,sha256=y_k8aZuoQFBn-FVIg6fySwzIAHkpJGi8MeuBMZyFGQk,849
+lsms_library/countries/Uganda/2005-06/_/data_info.yml,sha256=a9pIMmaETkLsQuaUAkOf4WlLknOl9t18VwYnyNcTERc,1023
 lsms_library/countries/Uganda/2005-06/_/earnings.py,sha256=HVM6pmh6_KuKVN_Cl9MQQ2GhbZxpWsztSoXw9jlE5oE,559
 lsms_library/countries/Uganda/2005-06/_/education_expenses.py,sha256=HaBLCZfr8RRlfj9rDEvPg51KOK6uxii8D7M4Lk_LbuU,1466
 lsms_library/countries/Uganda/2005-06/_/enterprise_income.py,sha256=dwJvipFBT9O7rjTAqZNfjSTCNp8aKeqEWLGeonzSmfc,932
@@ -9596,7 +9625,7 @@ lsms_library/countries/Uganda/2009-10/Documentation/LICENSE,sha256=VKGwD2FnV3PN3
 lsms_library/countries/Uganda/2009-10/Documentation/SOURCE,sha256=FCe-v1wmeRh7C8-oWxFE4MGRDHdeI7UYFThuAJ2Aj-I,63
 lsms_library/countries/Uganda/2009-10/Documentation/ddi-documentation-english_microdata-1001.pdf.dvc,sha256=iTfDlLeLaXm7KWnebFHMwqhr56Iycr2jzRWSl-mwGUs,127
 lsms_library/countries/Uganda/2009-10/_/assets.py,sha256=4PdlIY6a65nBJcma-fdur2xNczCWFh1NS9uWZmR8bs0,415
-lsms_library/countries/Uganda/2009-10/_/data_info.yml,sha256=ZPqT-02z9-5XJHzcBQ0L4U9jsNL2xPtlHIiJ0782K2Q,558
+lsms_library/countries/Uganda/2009-10/_/data_info.yml,sha256=JSKAI1QeWQgVXtQUyotM894CtUNVSl_lZzj3_WkKux0,731
 lsms_library/countries/Uganda/2009-10/_/earnings.py,sha256=TLwilh2zE0WrrE8_GDKZYNN6DwIHFcQH3VhHwwSRniY,583
 lsms_library/countries/Uganda/2009-10/_/education_expenses.py,sha256=HleH_Tp4gl-ksmGEX7ZCFbhy101RzsXxu1YmaA_N7AQ,1716
 lsms_library/countries/Uganda/2009-10/_/enterprise_income.py,sha256=5pDXZ4HrppxoDx-18Kte8UPyicCmK1w9beTB50aluUo,937
@@ -10504,7 +10533,7 @@ lsms_library/countries/Uganda/_/Makefile,sha256=9fuxU6l7SCjkL7tPNBo58u0Y42H1RKkf
 lsms_library/countries/Uganda/_/assets.py,sha256=jfwV44k96WZ7bANodoZ8BAMO-baQy1FKuCDRKPoqFwA,665
 lsms_library/countries/Uganda/_/categorical_mapping.org,sha256=XD4QBTKwdIEjScBEElpQ0BijfscmbnXfLS8dLQtDpR0,11822
 lsms_library/countries/Uganda/_/conversion_to_kgs.json,sha256=K7uEX1YERdMTgVCpZ_9Fol2xSbRd90Obf9WuPocJJ98,2650
-lsms_library/countries/Uganda/_/data_scheme.yml,sha256=98XKJaHdrPQj2xwfgkZ_P-uDPATWVByayFWuoj1jQnQ,450
+lsms_library/countries/Uganda/_/data_scheme.yml,sha256=KvNxjuwR3R2Iaw71GfSGI4ZzSomoXe8l4aUH7kLHa6k,540
 lsms_library/countries/Uganda/_/earnings.py,sha256=ela9bgSbY1S-vvOnQM48WV0XOjCl6d5FNlpqmzAlINo,814
 lsms_library/countries/Uganda/_/enterprise_income.py,sha256=MLx1mxjPym_r1KTNudDxRVY0t6Kezn4F4CwqJV1Li7M,851
 lsms_library/countries/Uganda/_/fct_addition.py,sha256=d_TEoxFQ4yjd6D1ghMOT507sCc8T7RvOqKjVKl-RGHM,2679
@@ -10545,7 +10574,7 @@ lsms_library/dvc_permissions.py,sha256=Igs04aJAmHbTiKmitNGh4uMI3mFFctUEebF99IMX3
 lsms_library/harmony.py,sha256=hEGLJUnWBXdyGeAAr7qgCFZ0Q-KsiqjBxHrtYbZ8Ngs,2742
 lsms_library/local_tools.py,sha256=UJvressIwYCBdmq8TJ3fHUowUKzlmiHjlGTTRY-S2Kk,40734
 lsms_library/transformations.py,sha256=uBSGfUAjWMrqSOmxdYYzi9csf8WvjaGCC7lzflJObtU,3661
-lsms_library-0.2.9.dev0.dist-info/LICENSE.txt,sha256=qImFXcRJwxIHS80FE7uOx6FhmLY8apd4Y12aR54QU7w,282
-lsms_library-0.2.9.dev0.dist-info/METADATA,sha256=1tt2IG9-RzVPRBr7V0eQSP6V-2NOtjWZlh_EBeBZ434,5219
-lsms_library-0.2.9.dev0.dist-info/WHEEL,sha256=XbeZDeTWKc1w7CSIyre5aMDU_-PohRwTQceYnisIYYY,88
-lsms_library-0.2.9.dev0.dist-info/RECORD,,
+lsms_library-0.2.10.dev0.dist-info/LICENSE.txt,sha256=qImFXcRJwxIHS80FE7uOx6FhmLY8apd4Y12aR54QU7w,282
+lsms_library-0.2.10.dev0.dist-info/METADATA,sha256=2rEwy4VlwahreUSAlihrIqTE2WX3tk9Ks6cwYSgvGnU,10690
+lsms_library-0.2.10.dev0.dist-info/WHEEL,sha256=XbeZDeTWKc1w7CSIyre5aMDU_-PohRwTQceYnisIYYY,88
+lsms_library-0.2.10.dev0.dist-info/RECORD,,