pysodafair 0.1.62__py3-none-any.whl

pysodafair-0.1.62.dist-info/METADATA

@@ -0,0 +1,190 @@
+Metadata-Version: 2.4
+Name: pysodafair
+Version: 0.1.62
+Summary: Pysoda package for Fairdataihub tools
+License: MIT
+License-File: LICENSE
+Author: Christopher Marroquin
+Author-email: cmarroquin@calmi2.org
+Requires-Python: >=3.6
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.6
+Classifier: Programming Language :: Python :: 3.7
+Classifier: Programming Language :: Python :: 3.8
+Classifier: Programming Language :: Python :: 3.9
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Programming Language :: Python :: 3.13
+Classifier: Programming Language :: Python :: 3.14
+Requires-Dist: openpyxl
+Project-URL: Homepage, https://github.com/fairdataihub/pysodafair
+Project-URL: Repository, https://github.com/fairdataihub/pysodafair
+Description-Content-Type: text/markdown
+
+# pysoda
+
+## Overview
+
+Pysoda is a tool for your python workflows that can help you create datasets in compliance with your favorite FAIR(Findable, Accessible, Interoperable, Reusable) data standards. At the moment, pysoda is primarily focused on neuromodulation, neurophysiology, and related data according to the SPARC guidelines that are aimed at making data FAIR. However, we are envisioning to extend the tool to support other standards such as BIDS, FHIR, etc, in the future.
+
+Pysoda stems from SODA, a desktop software that simplifies the organization and sharing of data that needs to comply to a FAIR data standard. While using the SODA app can be convenient for most investigators, others with coding proficiency may find it more convenient to implement automated workflows. Given that the backend of SODA contains many functions necessary for preparing and submitting a dataset that is compliant with the SPARC Data Structure (SDS) such as:
+
+Creating standard metadata files
+Generating manifest files
+Automatically complying with the file/folder naming conventions
+Validating against the offical SDS validator
+Uploading dataset to Pennsieve with SDS compliance (ignoring empty folders and non-allowed files, avoiding duplicate files and folders, etc.)
+And many more
+
+Pysoda makes these functions, which have been thoroughtly tested and validated, easily integratable in automated workflows such that the investigators do not have to re-write them. This will be very similar to the [pyfairdatatools](https://github.com/AI-READI/pyfairdatatools) Python package we are developing for our [AI-READI](https://aireadi.org/) project as part of the NIH Bridge2AI program.
+
+## Workflow
+
+### Import the pysoda package into your project and initialize the soda object with the supported standard of your choosing
+
+```python
+from pysoda import soda_create
+# initialize the soda_create object
+# Internal note: soda_create returns the typical sodaJSONObj with additional methods for adding data and metadata [not in version 1]
+# It is passed into the module functions just like our sodaJSONObj is passed to the backend of our api
+
+soda = soda_create(standard='sds')
+
+# add a dataset name to the soda object
+soda.set_dataset_name('my_dataset')
+
+```
+
+### Structure your data
+
+```python
+
+
+# get your base dataset files and folders structure
+dataset_structure = soda.get_dataset_structure()
+
+# fill out your dataset structure.
+# NOTE: YOu will want to reference the
+# dataset_structure key in the soda_schema.json file to understand the structure
+# and what is required.
+dataset_structure['folders'] = {
+    'data': {
+        'files': {
+            'file1': {
+                'path': '/home/user/file1.txt', 'relativePath': '/data/file1.txt', 'action': 'new'
+            }, 
+            'file2': {
+                'path': '/home/user/file2.txt', 'relativePath': '/data/file2.txt', 'action': 'new'
+            }
+        }, 
+        'folders': {
+            'primary': {
+                'files': {
+                    'file3': {
+                        'path': '/home/user/file3.txt', 'relativePath': '/data/primary/file3.txt', 'action': 'new'
+                    }
+                }
+            }
+        },
+        'relativePath': '/data'
+    },
+    'files': {},
+    'relativePath': '/'
+}
+
+
+# map your imported data files to the entity structure defined in the soda schema [here](soda_schema.py)
+entity_structure = soda.get_entity_structure()
+
+# fill out your entity structure using the schema as a reference
+# NOTE: data model not finalized
+entity = {'subjectId': 'sub-1', 'metadata': {'age': '1 year', 'sex': 'female'}, 'data-file': '/data/file1.txt'}
+entity_structure['subjects'].append(entity)
+
+
+
+```
+
+### Create your dataset metadata
+
+```python
+
+# import the metadata module from the soda_create package
+from pysoda import metadata
+
+# define your submission metadata
+submission = soda.get_submission_metadata()
+
+submission['consortium-data-standard'] = 'standard'
+submission['funding-consortium'] = 'SPARC'
+submission['award-number'] = '12345'
+submission['milestone-acheieved'] = ['one', 'two', 'three']
+submission['filepath'] = 'path/to/destination'
+
+# create the excel file for the submission metadata
+metadata.submission.create(soda, file_output_location='path/to/output')
+
+
+# repeat
+metadata.subjects.create(soda, file_output_location='path/to/output')
+metadata.samples.create(soda, file_output_location='path/to/output')
+metadata.performances.create(soda, file_output_location='path/to/output')
+metadata.sites.create(soda, file_output_location='path/to/output')
+metadata.code.create(soda, file_output_location='path/to/output')
+metadata.manifest.create(soda, file_output_location='path/to/output')
+
+```
+
+### Generate your dataset
+
+#### Generate locally
+
+```python
+
+from pysoda import generate
+
+# set the generation options
+soda.set_generate_dataset_options(destination='local', path='path/to/destination', dataset_name='my_dataset')
+
+# generate the dataset
+generate(soda)
+
+```
+
+#### Generate on Pennsieve
+
+```python
+from pysoda import generate
+
+# provide the Pennsieve API Key and secret
+soda.upload.auth(api_key='api, api_secret='api_secret)
+
+# upload new dataset
+# NOTE: You will need to download and start the Pennsieve Agent [here](https://app.pennsieve.io) to upload data to Pennsieve
+dataset_id = generate(soda) # returns dataset_id
+
+# OR upload to an existing pennsieve dataset
+# set the generate options in the soda object
+soda.set_generate_dataset_options(destination='existing-ps', if_existing="merge", if_existing_files="replace", dataset_id=dataset_id)
+update_existing(soda)
+```
+
+## Utilities
+
+### Compare a dataset on Pennsieve and a local dataset for differences
+
+```python
+from pysoda import compare
+
+# provide the Pennsieve API Key and secret
+soda.upload.auth(api_key='api, api_secret='api_secret)
+
+# import the dataset from Pennsieve
+soda.import_dataset(dataset_id='dataset_id')
+
+# compare the Pennsieve dataset with the local dataset
+results = compare(soda, local_dataset_location='path/to/local/dataset')
+```
+

pysodafair-0.1.62.dist-info/RECORD

@@ -0,0 +1,77 @@
+pysoda/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+pysoda/constants.py,sha256=_jDO-8-DGHEmj4xlAQynpwIOM28oIb-hUtxb4KcM3eg,89
+pysoda/core/__init__.py,sha256=bXnu4fYemJ915xId8nwh-Gy2IUEvVuoS9Hk3CXyJp8U,235
+pysoda/core/dataset_generation/__init__.py,sha256=tisLmJeXLeAINXf7BdNZGi2i9vQwImWGa_S5FNwQFbs,299
+pysoda/core/dataset_generation/manifestSession/__init__.py,sha256=kqkTAFEhluyQJ9mmMhYQTh1tgowBeJdH-Q9s5ifGkSE,51
+pysoda/core/dataset_generation/manifestSession/manifest_session.py,sha256=TML_KOJ-1REohqSaHCZNFJrbDR1UDQ9sFcithJRx9t8,4669
+pysoda/core/dataset_generation/upload.py,sha256=ATx8D-Ck1xDzrT_rI-YSDmi9hFFqiz2E0FgCrPlyJQA,174022
+pysoda/core/dataset_importing/__init__.py,sha256=NbWs4HAqqydFLACFoVwl6g457dkYvjiZKx9NzB9wFxE,114
+pysoda/core/dataset_importing/import_dataset.py,sha256=cx8qCQmR_BKdC2G-jzqE4dWg2JhkOS3jM8kpjLIsObk,29487
+pysoda/core/metadata/__init__.py,sha256=Tkx6vdEQEPwAHmVSc9GfdbDZUkvuAqEgHJOxRDeX5vE,821
+pysoda/core/metadata/code_description.py,sha256=sWbRPWPf32txpN048oQ9lT3y7GAoDkrS-GHivwwv55Y,4104
+pysoda/core/metadata/constants.py,sha256=PR78huqBKdBpzDUGxVKy9YW3pUrJ4ftuF4MfqpNb1bU,1052
+pysoda/core/metadata/dataset_description.py,sha256=uwVC0tBVglQPs57LQL22nEXKLjCm1j6rtmGj8ByOeoA,7332
+pysoda/core/metadata/excel_utils.py,sha256=FQ8-DBq2lxFdpDUZeABfFKe284JzRTe6AYPxEw7yzsg,1216
+pysoda/core/metadata/helpers.py,sha256=jDf4KPTbx4unHT7pDlFEa0jls1OZY-dpdKf3kUGMtvg,10609
+pysoda/core/metadata/manifest.py,sha256=MjID-r52Yn3i9WlrT5IWeYvmkVdfzQuqGOmoMsZQVJg,4197
+pysoda/core/metadata/manifest_package/__init__.py,sha256=7qiNT62WsI1LKb-lvnK31lW04sOvW_KTZQA1e8sUAgY,211
+pysoda/core/metadata/manifest_package/manifest.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+pysoda/core/metadata/manifest_package/manifest_import.py,sha256=5rKOBf-NMt2dVsPJYotk5V855wnmtiMqrpknSOYOEl0,1347
+pysoda/core/metadata/manifest_package/manifest_writer.py,sha256=AjtKdGYd9e2TS9hpPTPXH0mqer5PH_hLbxvYQPhhFHg,27358
+pysoda/core/metadata/performances.py,sha256=s5nPF9il8m73PADK6YMSfWT0JADn-NDpXzB7K7X3X1o,1851
+pysoda/core/metadata/resources.py,sha256=v0CUl5Lg-_2DkR0h9NJMBQkCkydQL15qzRZvkFDnMdc,1790
+pysoda/core/metadata/samples.py,sha256=sSaHZ0LEYd6oQFKQxoS0xb1m4k1NPNqKxp38CJjzi3U,8389
+pysoda/core/metadata/sites.py,sha256=gpmC7_WIi2wtaCa8BpS0eUYJPeBaOxwXyLIjVEXBhJA,1751
+pysoda/core/metadata/subjects.py,sha256=kaerhYVUsz2BJSGIvETbl1YSliYAGMPg2-ne8AnsXdU,7968
+pysoda/core/metadata/submission.py,sha256=Ym949kEIzdjjyyNWCvtP8OftFKKUBDQy98HOOTUEej4,3002
+pysoda/core/metadata/text_metadata.py,sha256=GYiRxNiQp5Lw-6na80jcrvQBMF4-KHp3CGK2Mmv6TFI,1846
+pysoda/core/metadata_templates/CHANGES,sha256=XIdY2AIWPX8aEtMJeXprL1kHXRH173l5ubTxzMDoCH4,78
+pysoda/core/metadata_templates/LICENSE,sha256=XIdY2AIWPX8aEtMJeXprL1kHXRH173l5ubTxzMDoCH4,78
+pysoda/core/metadata_templates/README.md,sha256=rIxGEC2qoPl4YcSj-G64MX5fmM1JdNed1KCDUFVYRnc,129
+pysoda/core/metadata_templates/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+pysoda/core/metadata_templates/code_description.xlsx,sha256=hONjq4nmDxtHbMmCTAcrosoIA6rxnlt1fub-EjDFDS0,12007
+pysoda/core/metadata_templates/code_parameters.xlsx,sha256=vhHX99V7Abye8dN3GkjzFuJ8g9MUOSQDfAMRrR8DehQ,6027
+pysoda/core/metadata_templates/dataset_description.xlsx,sha256=qTwz8_J0JeZdm_wGzq6-tMnZbKWJlmYdBSR4JN88Saw,16138
+pysoda/core/metadata_templates/manifest.xlsx,sha256=uHUVfmy_jcNeW5qctDLyymOdhyVOwRJCQavungPBR0o,5273
+pysoda/core/metadata_templates/performances.xlsx,sha256=jjiPBb669FHjC7W8hTo3gChTspX5DluBdrvO6UZhFOk,5184
+pysoda/core/metadata_templates/resources.xlsx,sha256=mT-KbF1KzZjV3AifENZHkY2nX6AHB6sLO34pX_6xcAI,5155
+pysoda/core/metadata_templates/samples.xlsx,sha256=5ramdIEUjk0d5rB6RvE_3aiE4vaKz_cKX7KBI_TE7sc,8448
+pysoda/core/metadata_templates/sites.xlsx,sha256=C_XehlNXZSUUxjayZr0XW6OvuGRxoFzA8xM6OklXszM,8081
+pysoda/core/metadata_templates/subjects.xlsx,sha256=_lFYP2WkTz-n_IfocaBgZWYwFtNdaDIFtYoXAQ4AcQE,8621
+pysoda/core/metadata_templates/subjects_pools_samples_structure.xlsx,sha256=AXUBNtYBIAN9C3l7-clGFTCnyLkSFhuoFca227jbxgc,12154
+pysoda/core/metadata_templates/subjects_pools_samples_structure_example.xlsx,sha256=69DcsxOR6H8oTZZq43vOuoyud1D_BOXdzLxJlotdQVk,12154
+pysoda/core/metadata_templates/submission.xlsx,sha256=DIVcio7QyR-6-o1esDn1Gl7vu19xSCyGHhwGkW3RaBI,6002
+pysoda/core/permissions/__init__.py,sha256=YUoJACCe8SO7_TXrn27jzz5gWx1xvCMPy37cNPmV2Mw,85
+pysoda/core/permissions/permissions.py,sha256=l8OTNhzjidF7PrL74PYjcpxVYd1YQpgcs202yh4CJyg,1076
+pysoda/core/pysoda/__init__.py,sha256=gNQ5O-A6wqTc88OGGfLy0UoeFxgPi0T5NMtF7YdUY_U,58
+pysoda/core/pysoda/soda.py,sha256=HTK4_qxw_FL5GZaY8_HNRuXqth9h-t9btMUvfJD7XeU,1145
+pysoda/core/pysoda/soda_object.py,sha256=ISkV2uRREp-ScHt5_ZH_4K20O3veVxYGnP-9Avv7xb4,1075
+pysoda/core/upload_manifests/__init__.py,sha256=SOiyflYmZDtkLwWpeu7flyn3J2SAj9WL4y82O6cEpzg,74
+pysoda/core/upload_manifests/upload_manifests.py,sha256=Hd2XSXYieG-EMcPTLSYXvdtraipp1XBSo5cGpZR-vbA,1223
+pysoda/schema/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+pysoda/schema/code_description.json,sha256=FJOyJBC2TKjTTdtew3B4wdq_WIrti-r2F-M6t5OVNB0,17854
+pysoda/schema/dataset_description.json,sha256=rRuQiYthOwrlmzP_d3F1cG_ceIpefzxGuINorEcrA5g,8626
+pysoda/schema/manifest.json,sha256=bsVzhnZHd2566KhrxQPBcwH376fgE8pSY8eXviTXrWA,2636
+pysoda/schema/performances.json,sha256=TJw7ERC6eMR-9cImOg7xoEVRyOR4xViJqZO8U2X2OXo,1254
+pysoda/schema/resources.json,sha256=FADf1p0IG_gliQlSr04cRtLKQMm8XhEktlnbnw_XG1U,1140
+pysoda/schema/samples.json,sha256=NvuYhskV9QFrkSX4ant9G4KFCe9JLnVG98vDv2Puuvk,3340
+pysoda/schema/sites.json,sha256=lMkglgi4R7_qqUHh6uwbZ38TjkUzRKGY9pdF1CpZh4E,1133
+pysoda/schema/soda_schema.json,sha256=QSe8G39wOMO5wS_MUU0mW6yeM4etufACE6iuAzZMBoA,19290
+pysoda/schema/subjects.json,sha256=j5au8ak0Q_Nxs6EDoJ7FJDr0SeS0Y-X40X-XQwSnRts,4799
+pysoda/schema/submission_schema.json,sha256=b0FfBP_fDFxU8vT1mDAThbUyYMJA7PJ1S6lOpdPpSkY,1103
+pysoda/utils/__init__.py,sha256=cdrc-Ueb7djdA9rPl5FR3nsinCxfOB9lbOhicNCbeCY,1243
+pysoda/utils/authentication.py,sha256=Ed6xXaCSyi23qGz_LkdDB-Cjum5G5az_tMhSWKBGVSY,11943
+pysoda/utils/config.py,sha256=8UC0j89ihuMnPCwl9bTVUupC9Kg_39ly9Hju5W4OmWo,2471
+pysoda/utils/exceptions.py,sha256=H4_bvp-Zq4e-_GHQ5n3wxg4cH12iVgJZEw8tz8jRGfw,4812
+pysoda/utils/logger.py,sha256=fxqJoqxe_wdVTq7IXN5QsWSC-z7mSfsLaJsKU9-UhqA,211
+pysoda/utils/metadata_utils.py,sha256=nCQc24biSsrpnXbjXiZEtISWkfBS-CV00sv5MMydoww,1804
+pysoda/utils/pennsieveAgentUtils.py,sha256=Un0qnVQm1DNg3u5l7PZI-X61sNaJtSmDlcXP_lRbv8Q,422
+pysoda/utils/pennsieveUtils.py,sha256=B_L2NicOR3eQin0sd7TsRLWNDSxhSxyGgUJCGoWBVkM,4622
+pysoda/utils/profile.py,sha256=di4D_IE1rGSfHl0-SRVjrJK2bCdedW4ugp0W-j1HarQ,937
+pysoda/utils/schema_validation.py,sha256=3w3FRPyn4P3xMhITzItk-jYte8TTlNrgCWmY-s05x9Y,4438
+pysoda/utils/time_utils.py,sha256=g5848bivtzWj6TDoWo6CcohF-THxShETP4qTyHTjBWw,131
+pysoda/utils/upload_utils.py,sha256=-BCvfXsJSFqnwEZVCFQX1PLfkdeW0gyGLjLGW6Uxdf8,4607
+pysodafair-0.1.62.dist-info/METADATA,sha256=J4JLeWI1aGB18L8QAl__4vgRS8Z5hNqvK-i2zFTHMVQ,7011
+pysodafair-0.1.62.dist-info/WHEEL,sha256=zp0Cn7JsFoX2ATtOhtaFYIiE2rmFAD4OcMhtUki8W3U,88
+pysodafair-0.1.62.dist-info/licenses/LICENSE,sha256=Jlt0uGnx87qPRGXPQHsBkg_S7MOsYS2E9Rh1zy47bfw,1082
+pysodafair-0.1.62.dist-info/RECORD,,

pysodafair-0.1.62.dist-info/WHEEL

@@ -0,0 +1,4 @@
+Wheel-Version: 1.0
+Generator: poetry-core 2.2.1
+Root-Is-Purelib: true
+Tag: py3-none-any

pysodafair-0.1.62.dist-info/licenses/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2025 FAIR Data Innovations Hub
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.