metacountregressor 0.1.63__py3-none-any.whl → 0.1.64__py3-none-any.whl

metacountregressor-0.1.64.dist-info/METADATA

@@ -0,0 +1,274 @@
+Metadata-Version: 2.1
+Name: metacountregressor
+Version: 0.1.64
+Summary: A python package for count regression of rare events assisted by metaheuristics
+Author: zahern
+Author-email: zeke.ahern@hdr.qut.edu.au
+Requires-Python: >=3.10,<3.11
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.10
+Requires-Dist: latextable (>=1.0.0,<2.0.0)
+Requires-Dist: matplotlib (>=3.7.1,<4.0.0)
+Requires-Dist: numpy (>=1.24.3,<2.0.0)
+Requires-Dist: pandas (>=2.0.2,<3.0.0)
+Requires-Dist: psutil (>=5.9.5,<6.0.0)
+Requires-Dist: scikit-learn (>=1.2.2,<2.0.0)
+Requires-Dist: scipy (>=1.10.1,<2.0.0)
+Requires-Dist: statsmodels (>=0.14.0,<0.15.0)
+Requires-Dist: tabulate (>=0.9.0,<0.10.0)
+Description-Content-Type: text/markdown
+
+<div style="display: flex; align-items: center;">
+    <img src="https://github.com/zahern/data/raw/main/m.png" alt="My Image" style="width: 200px; margin-right: 20px;">
+    <p><span style="font-size: 60px;"><strong>MetaCountRegressor</strong></span></p>
+</div>
+
+##### Quick Setup
+The Below code demonstrates how to set up automatic optimization assisted by the harmony search algorithm. References to the Differential Evolution and Simulated Annealing has been mentioned (change accordingly)
+
+## Quick install: Requires Python 3.10
+
+Install `metacountregressor` using pip as follows:
+
+```bash
+pip install metacountregressor
+
+
+```python
+import pandas as pd
+import numpy as np
+from metacountregressor.solution import ObjectiveFunction
+from metacountregressor.metaheuristics import (harmony_search,
+                                            differential_evolution,
+                                            simulated_annealing)
+```
+
+#### Basic setup. 
+The initial setup involves reading in the data and selecting an optimization algorithm. As the runtime progresses, new solutions will be continually evaluated. Finally, at the end of the runtime, the best solution will be identified and printed out. In the case of multiple objectives all of the best solutions will be printed out that belong to the Pareto frontier.
+
+
+```python
+# Read data from CSV file
+df = pd.read_csv(
+"https://raw.githubusercontent.com/zahern/data/main/Ex-16-3.csv")
+X = df
+y = df['FREQ']  # Frequency of crashes
+X['Offset'] = np.log(df['AADT']) # Explicitley define how to offset the data, no offset otherwise
+# Drop Y, selected offset term and  ID as there are no panels
+X = df.drop(columns=['FREQ', 'ID', 'AADT'])  
+
+#some example argument, these are defualt so the following line is just for claritity. See the later agruments section for detials.
+arguments = {'algorithm': 'hs', 'test_percentage': 0.15, 'test_complexity': 6, 'instance_number':1,
+             'val_percentage':0.15, 'obj_1': 'bic', '_obj_2': 'RMSE_TEST', "MAX_TIME": 6}
+# Fit the model with metacountregressor
+obj_fun = ObjectiveFunction(X, y, **arguments)
+#replace with other metaheuristics if desired
+results = harmony_search(obj_fun)
+
+
+```
+
+## Arguments to feed into the Objective Function:
+### 
+Note: Please Consider the main arguments to change.
+
+- `algorithm`: This parameter has multiple choices for the algorithm, such as 'hs', 'sa', and 'de'. Only one choice should be defined as a string value.
+- `test_percentage`: This parameter represents the percentage of data used for in-sample prediction of the model. The value 0.15 corresponds to 15% of the data.
+- `val_percentage`: This parameter represents the percentage of data used to validate the model. The value 0.15 corresponds to 15% of the data.
+- `test_complexity`: This parameter defines the complexity level for testing. The value 6 tests all complexities. Alternatively, you can provide a list of numbers to consider different complexities. The complexities are further explained later in this document.
+- `instance_number`: This parameter is used to give a name to the outputs.
+- `obj_1`: This parameter has multiple choices for obj_1, such as 'bic', 'aic', and 'hqic'. Only one choice should be defined as a string value.
+- `_obj_2`: This parameter has multiple choices for objective 2, such as 'RMSE_TEST', 'MSE_TEST', and 'MAE_TEST'.
+- `_max_time`: This parameter specifies the maximum number of seconds for the total estimation before stopping.
+- `distribution`: This parameter is a list of distributions to consider. Please select all of the available options and put them into a list of valid options if you want to to consider the distribution type for use when modellign with random parameters. The valid options include: 'Normal', 'LnNormal', 'Triangular', and 'Uniform'.
+- `transformations`: This parameters is a list of transformations to consider. Plesee select all of the available options and put them into a list of valid options if you want to consider the transformation type. The valid options include 'Normal', 'LnNormal', 'Triangular', 'Uniform'.
+- `method_ll`: This is a specificication on the type of solvers are avilable to solve the lower level maximum likilihood objective. The valid options include: 'Normal', 'LnNormal', 'Triangular', and 'Uniform'.
+
+
+
+### An Example of changing the arguments.
+Modify the arguments according to your preferences using the commented code as a guide.
+
+
+```python
+#Solution Arguments
+arguments = {
+        'algorithm': 'hs', #alternatively input 'de', or 'sa'
+        'is_multi': 1,
+        'test_percentage': 0.2, # used in multi-objective optimisation only. Saves 20% of data for testing.
+        'val_percenetage:': 0.2, # Saves 20% of data for testing.
+        'test_complexity': 6, # Complexity level for testing (6 tests all) or a list to consider potential differences in complexity
+        'instance_number': 'name', # used for creeating a named folder where your models are saved into from the directory
+        'distribution': ['Normal', 'LnNormal', 'Triangular', 'Uniform'],
+        'Model': [0,1],  # or equivalently ['POS', 'NB']
+        'transformations': ['no', 'sqrt', 'archsinh'],
+        'method_ll': 'BFGS_2',
+        '_max_time': 10
+    }
+obj_fun = ObjectiveFunction(X, y, **arguments)
+results = harmony_search(obj_fun)
+```
+
+## Initial Solution Configurement
+Listed below is an example of how to specify an initial solution within the framework. This initial solution will be used to calculate the fitness and considered in the objective-based search. However, as the search progresses, different hypotheses may be proposed, and alternative modeling components may completely replace the initial solution.
+
+
+```python
+ #Model Decisions, Specify for Intial Optimization
+manual_fit_spec = {
+    'fixed_terms': ['SINGLE', 'LENGTH'],
+    'rdm_terms': ['AADT:normal'],
+    'rdm_cor_terms': ['GRADEBR:uniform', 'CURVES:triangular'],
+    'grouped_terms': [],
+    'hetro_in_means': ['ACCESS:normal', 'MINRAD:normal'],
+    'transformations': ['no', 'no', 'log', 'no', 'no', 'no', 'no'],
+    'dispersion': 1
+}
+#Search Arguments
+arguments = {
+    'algorithm': 'hs',
+    'test_percentage': 0.2,
+    'test_complexity': 6,
+    'instance_number': 'name',
+    'Manual_Fit': manual_fit_spec
+}
+obj_fun = ObjectiveFunction(X, y, **arguments)
+```
+
+ simarly to return the results feed the objective function into a metaheuristic solution algorithm. An example of this is provided below:
+
+
+```python
+results = harmony_search(obj_fun)
+print(results)
+```
+
+## Notes:
+### Capabilities of the software include:
+* Handling of Panel Data
+* Support for Data Transformations
+* Implementation of Models with Correlated and Non-Correlated Random Parameters
+* A variety of mixing distributions for parameter estimations, including normal, lognormal, truncated normal, Lindley, Gamma, triangular, and uniform distributions
+Capability to handle heterogeneity in the means of the random parameters
+* Use of Halton draws for simulated maximum likelihood estimation
+* Support for grouped random parameters with unbalanced groups
+* Post-estimation tools for assessing goodness of fit, making predictions, and conducting out-of-sample validation
+* Multiple parameter optimization routines, such as the BFGS method
+* Comprehensive hypothesis testing using single objectives, such as in-sample BIC and log-likelihood
+* Extensive hypothesis testing using multiple objectives, such as in-sample BIC and out-of-sample MAE (Mean Absolute Error), or in-sample AIC and out-of-sample MSPE (mean-square prediction errorr) 
+* Features that allow analysts to pre-specify variables, interactions, and mixing distributions, among others
+* Meta-heuristic Guided Optimization, including techniques like Simulated Annealing, Harmony Search, and Differential Evolution
+* Customization of Hyper-parameters to solve problems tailored to your dataset
+* Out-of-the-box optimization capability using default metaheuristics
+
+### Intreting the output of the model:
+A regression table is produced. The following text elements are explained:
+- Std. Dev.: This column appears for effects that are related to random paramters and displays the assument distributional assumption next to it
+- Chol: This term refers to Cholesky decomposition element, to show the correlation between two random paramaters. The combination of the cholesky element on iyself is equivalent to a normal random parameter.
+- hetro group #: This term represents the heterogeneity group number, which refers all of the contributing factors that share hetrogentiy in the means to each other under the same numbered value.
+- $\tau$: This column, displays the type of transformation that was applied to the specific contributing factor in the data.
+
+
+## Arguments: 
+#### In reference to the arguments that can be fed into the solution alrogithm, a dictionary system is utilised with relecant names these include
+
+
+The following list describes the arguments available in this function. By default, all of the capabilities described are enabled unless specified otherwise as an argument. For list arguments, include all desired elements in the list to ensure the corresponding options are considered. Example code will be provided later in this guide.
+
+1. **`complexity_level`**: This argument accepts an integer 1-6 or a list based of integegers between 0 to 5 eg might be a possible configuration [0, 2, 3]. Each integer represents a hierarchy level for estimable models associated with each explanatory variable. Here is a summary of the hierarchy:
+    - 0: Null model
+    - 1: Simple fixed effects model
+    - 2: Random parameters model
+    - 3: Random correlated parameters model
+    - 4: Grouped random parameters model
+    - 5: Heterogeneity in the means random parameter model
+
+    **Note:** For the grouped random parameters model, groupings need to be defined prior to estimation. This can be achieved by including the following key-value pair in the arguments of the `ObjectiveFunction`: `'group': "Enter Column Grouping in data"`. Replace `"Enter Column Grouping in data"` with the actual column grouping in your dataset.
+
+    Similarly, for panel data, the panel column needs to be defined using the key-value pair: `'panel': "enter column string covering panels"`. Replace `"enter column string covering panels"` with the appropriate column string that represents the panel information in your dataset.
+
+2. **`distributions`**: This argument accepts a list of strings where each string corresponds to a distribution. Valid options include:
+    - "Normal"
+    - "Lindley"
+    - "Uniform"
+    - "LogNormal"
+    - "Triangular"
+    - "Gamma"
+    - "TruncatedNormal"
+    - Any of the above, concatenated with ":" (e.g., "Normal:grouped"; requires a grouping term defined in the model)
+
+3. **`Model`**: This argument specifies the model form. It can be a list of integers representing different models to test:
+    - 0: Poisson
+    - 1: Negative-Binomial
+    - 2: Generalized-Poisson
+
+4. **`transformations`**: This argument accepts a list of strings representing available transformations within the framework. Valid options include:
+    - "no"
+    - "square-root"
+    - "logarithmic"
+    - "archsinh"
+    - "as_factor"
+
+5. **`is_multi`**: This argument accepts an integer indicating whether single or multiple objectives are to be tested (0 for single, 1 for multiple).
+
+6. **`test_percentage`**: This argument is used for multi-objective optimization. Define it as a decimal; for example, 0.2 represents 20% of the data for testing.
+
+7.  **`val_percentage`**: This argument saves data for validation. Define it as a decimal; for example, 0.2 represents 20% of the data for validation.
+
+8. **`_max_time`**: This argument is used to add a termination time in the algorithm. It takes values as seconds. Note the time is only dependenant on the time after intial population of solutions are generated.
+
+# Example
+
+
+Let's start by fitting very simple models, use those model sto help and define the objectives, then perform more of an extensive search on the variables that are identified more commonly
+
+
+
+```python
+df = pd.read_csv(
+"https://raw.githubusercontent.com/zahern/data/main/Ex-16-3.csv")
+X = df
+y = df['FREQ']  # Frequency of crashes
+X['Offset'] = np.log(df['AADT']) # Explicitley define how to offset the data, no offset otherwise
+# Drop Y, selected offset term and  ID as there are no panels
+X = df.drop(columns=['FREQ', 'ID', 'AADT'])  
+
+arguments = {
+        'algorithm': 'hs', #alternatively input 'de', or 'sa'
+        'is_multi': 1,
+        'test_percentage': 0.2, # used in multi-objective optimisation only. Saves 20% of data for testing.
+        'val_percentage:': 0.2, # Saves 20% of data for testing.
+        'test_complexity': 3, # For Very simple Models
+        'obj_1': 'BIC', '_obj_2': 'RMSE_TEST',
+        'instance_number': 'name', # used for creeating a named folder where your models are saved into from the directory
+        'distribution': ['Normal'],
+        'Model': [0],  # or equivalently ['POS', 'NB']
+        'transformations': ['no', 'sqrt', 'archsinh'],
+        '_max_time': 10000
+    }
+obj_fun = ObjectiveFunction(X, y, **arguments)
+
+results = harmony_search(obj_fun)
+print(results)
+```
+
+## Contact
+If you have any questions, ideas to improve MetaCountRegressor, or want to report a bug, just open a new issue in [GitHub repository](https://github.com/zahern/CountDataEstimation).
+
+## Citing MetaCountRegressor
+Please cite MetaCountRegressor as follows:
+
+Ahern, Z., Corry P., Paz A. (2023). MetaCountRegressor [Computer software]. [https://pypi.org/project/metacounregressor/](https://pypi.org/project/metacounregressor/)
+
+Or using BibTex as follows:
+
+```bibtex
+@misc{Ahern2023,
+   author = {Zeke Ahern and Paul Corry and Alexander Paz},
+   journal = {PyPi},
+   title = {metacountregressor · PyPI},
+   url = {https://pypi.org/project/metacountregressor/0.1.47/},
+   year = {2023},
+}
+
+

metacountregressor-0.1.64.dist-info/RECORD

@@ -0,0 +1,40 @@
+metacountregressor/__init__.py,sha256=UM4zaqoAcZVWyx3SeL9bRS8xpQ_iLZU9fIIARWmfjis,2937
+metacountregressor/_device_cust.py,sha256=759fnKmTYccJm4Lpi9_1reurh6OB9d6q9soPR0PltKc,2047
+metacountregressor/data/1848.csv,sha256=p53-8nntBb6X3bMJdYAJER6rbTicl_6RsWpOV-S8n_Y,47516
+metacountregressor/data/4000.csv,sha256=XDGmMrZazvcaeAMMAdVibB6EWfEJdyZox8iXtDb7d9w,131240
+metacountregressor/data/Copy of 190613_HV Crash Data 2007-2017 Dates.xlsx,sha256=xzdiR6bFHZ3j22BPJXOmruX_DA08jd-ujeaNwNimsxg,3469742
+metacountregressor/data/Ex-16-3.csv,sha256=7z6tW9A4rqhQGOeiRE4LzlsJh8EjRvGnIQXo00hK82Y,42302
+metacountregressor/data/Ex-16-3variables.csv,sha256=rzl_pv-gy5rdpImZkhzc52cx__S98di1V2CK_krO-DA,14901
+metacountregressor/data/Indiana_data.csv,sha256=9jXPjPuk7pQqtSNcra3RhKB86i2zPo_xavmShsniK7A,14113
+metacountregressor/data/MichiganData.csv,sha256=FwyHAbou49It8rLilY6dF4Uaoi4q-JjrxIqCRl07KfQ,1283955
+metacountregressor/data/Stage5A.csv,sha256=rVqcKFOJTNCF5Aykd8adxLp0Rw2W_3PgZhjZocP9Su8,216874
+metacountregressor/data/Stage5A_1848_All_Initial_Columns.csv,sha256=rVqcKFOJTNCF5Aykd8adxLp0Rw2W_3PgZhjZocP9Su8,216874
+metacountregressor/data/ThaiAccident.csv,sha256=ZQJaD66qPE0QdqgaKTAYuQ42y1OvD0xu3FP4fqPfUFw,397972
+metacountregressor/data/artificial_1h_mixed_corr_2023_MOOF.csv,sha256=8krw3famdKpUsQ4J-cewVVaskMroPh0oSj4PB09yWdM,144023
+metacountregressor/data/artificial_ZA.csv,sha256=dpQsL9dqJtzz7V0wLxF5XURhuMk6C_NCZHZLTEUJERA,3693175
+metacountregressor/data/artificial_mixed_corr_2023_MOOF.csv,sha256=gxJbBsA5318fhhH_4FDQdMUMEhxaYR2W5-EsJ7gwBms,322085
+metacountregressor/data/artificial_mixed_corr_2023_MOOF_copy.csv,sha256=IlYpjwmG6DJH0GfHM3QnqjRILBKLC5df7Y7EyNWMTZM,322612
+metacountregressor/data/latex_summary_output.tex,sha256=d35GSHoNlmKC-7EedvzVELzj3EU3tVRwAYByHt8BZ1o,35287
+metacountregressor/data/rqc40516_MotorcycleQUT_engineer_crash.csv,sha256=6WzhwY7lUGy0S8BovhQe0l01XlgsXCZRzBeAGGgeWJg,3898046
+metacountregressor/data/rural_int.csv,sha256=l_jgI_uTTVN3vmNjwfOE8KNYOvAXsNPRrOdAwamEbQM,6922036
+metacountregressor/data/sum_stats.R,sha256=Qc2k4jVdZJbuk4kMt0t7KmbmoYgAR-C1SURZm_KVN0U,3327
+metacountregressor/data/summary_output.txt,sha256=SPC7ycxu2yaGjSYqY9GLuDv5UBxXH7kT_FeivBZ8gxI,33846
+metacountregressor/halton.py,sha256=jhovA45UBoZYU9g-hl6Lb2sBIx_ZBTNdPrpgkzR9fng,9463
+metacountregressor/helperprocess.py,sha256=nlabPUz_hf8SbFONn2wBKwcVJusTKcynPaxkEYvTWlU,9052
+metacountregressor/main.py,sha256=21Nz4OSFoiFbPSu2H0jOb5k4JaT9mDjw3EbY6QbC5R4,17135
+metacountregressor/main_old.py,sha256=eTS4ygq27MnU-dZ_j983Ucb-D5XfbVF8OJQK2hVVLZc,24123
+metacountregressor/metaheuristics.py,sha256=4coj8gTyesnYFA8r4UkQer156OQ30BRQhFTMFEwSjtU,105490
+metacountregressor/pareto_file.py,sha256=whySaoPAUWYjyI8zo0hwAOa3rFk6SIUlHSpqZiLur0k,23096
+metacountregressor/pareto_logger__plot.py,sha256=mEU2QN4wmsM7t39GJ_XhJ_jjsdl09JOmG0U2jICrAkI,30037
+metacountregressor/plt_style.txt,sha256=Zv4mDFxN-KP_OnwfbC2IoAgEclOVeodIC4maLnERXfw,1280
+metacountregressor/requirements.txt,sha256=jfxFP4msdp3H5kGuu7Mh2ea-18Gg1RvAPgPJygEe4JA,264
+metacountregressor/requirements_new.txt,sha256=ZN_Kq1GgoT2WLFhzAC2J8__ZjY0Lj7ztIUsobXy4yBY,2543
+metacountregressor/set_data.csv,sha256=UUrFFSs-q78mMcMKjYRCT3pciG0yuhdxlNZ-LL2GKN0,649589
+metacountregressor/setup.py,sha256=8w6IqX0tJsbYrOI1BJLIJCIvOnunKli5I9fsF5PhHv4,919
+metacountregressor/single_objective_finder.py,sha256=jVG7GJBqzSP4_riYr-kMMKy_LE3SlGmKMunNhHYxgRg,8011
+metacountregressor/solution.py,sha256=fQaoo71zIxfOKLC6oTE9BnAm5OJRqRZnQ7a9nPIc9cM,284973
+metacountregressor/test_generated_paper2.py,sha256=pwOoRzl1jJIIOUAAvbkT6HmmTQ81mwpsshn9SLdKOg8,3927
+metacountregressor-0.1.64.dist-info/LICENSE.txt,sha256=OXLcl0T2SZ8Pmy2_dmlvKuetivmyPd5m1q-Gyd-zaYY,35149
+metacountregressor-0.1.64.dist-info/METADATA,sha256=m_id4JHffI21V9t7LdUjwj2LLJVwhakWBQQgVzN5ED8,14679
+metacountregressor-0.1.64.dist-info/WHEEL,sha256=sP946D7jFCHeNz5Iq4fL4Lu-PrWrFsgfLXbbkciIZwg,88
+metacountregressor-0.1.64.dist-info/RECORD,,

{metacountregressor-0.1.63.dist-info → metacountregressor-0.1.64.dist-info}/WHEEL

@@ -1,5 +1,4 @@
 Wheel-Version: 1.0
-Generator: bdist_wheel (0.43.0)
+Generator: poetry-core 1.9.0
 Root-Is-Purelib: true
 Tag: py3-none-any
-

metacountregressor/test_motor.py

@@ -1,296 +0,0 @@
-import pandas as pd
-import numpy as np
-import shap
-from sklearn.feature_selection import SelectKBest
-from sklearn.feature_selection import f_regression
-from sklearn.datasets import make_regression
-from sklearn.model_selection import train_test_split
-from sklearn.preprocessing import StandardScaler
-import xgboost as xgb
-import matplotlib.pyplot as plt
-from sklearn.inspection import permutation_importance
-
-X, y = make_regression(n_samples=1000, n_features=100, n_informative=10, noise=0.1, random_state=1)
-X_train, X_test, y_train, y_test = train_test_split(X, y, test_size=0.33, random_state=1)
-
-
-def shape_ply(df, y):
-    df_features = df
-    model = xgb.XGBRegressor(n_estimators=500, max_depth=20, learning_rate=0.1, subsample=0.8, random_state=33)
-    model.fit(df_features, y)
-
-    clustering = shap.utils.hclust(df_features, y)
-
-    # PERMUATION fEATUre importance
-    scoring = ['r2', 'neg_mean_squared_error']
-    perm_importance = permutation_importance(model, df_features, y, scoring=scoring, n_repeats=5, random_state=33)
-    perm_importance_r2 = pd.DataFrame(data={'importance': perm_importance['r2']['importances_mean']},
-                                      index=df_features.columns)
-    perm_importance_r2.sort_values(by='importance', ascending=False).plot(kind='bar')
-    # plt.tight_layout()
-    # plt.savefig('plot.png')
-    # plt.show()
-
-    print(1)
-
-    # SHAPELY PART
-    explainer = shap.Explainer(model)
-    shap_values = explainer(df_features)
-    # fig = shap.summary_plot(shap_values, df_features, show = False)
-
-    # plt.figure(figsize=(10, 8))
-    fig = shap.plots.beeswarm(shap_values, order=shap_values.abs.max(0), show=False)
-    plt.gca().set_xticklabels([])
-    plt.savefig('shap_values.png', bbox_inches='tight')
-    plt.show()
-    shap.plots.bar(shap_values.abs.mean(0), show=False)
-    plt.gca().set_xticklabels([])
-    plt.savefig('bar_values.png', bbox_inches='tight')
-
-    shap.plots.bar(shap_values, clustering=clustering, clustering_cutoff=0.8, show=False)
-    plt.gca().set_xticklabels([])
-    plt.savefig('bar_valuesff.png', bbox_inches='tight')
-    print(2)
-
-
-def summary_stats(crash_data):
-    # Calculate the count of crashes
-    crash_observations = crash_data.shape[0]
-    crash_factors = crash_data.shape[1]
-
-    # Calculate the mean age of drivers involved in the crashes
-    total_vehicle = crash_data['CASUALTY_TOTAL'].sum()
-
-    # Calculate the median number of vehicles involved in the crashes
-    median_vehicles = crash_data['CASUALTY_TOTAL'].median()
-
-    # Calculate the mode of crash types
-    mode_crash_type = crash_data['CASUALTY_TOTAL'].mode()[0]
-
-    # Calculate the 25th and 75th percentiles of a numeric variable
-    percentile_25 = crash_data['CASUALTY_TOTAL'].quantile(0.25)
-    percentile_75 = crash_data['CASUALTY_TOTAL'].quantile(0.75)
-    std_dev = crash_data['CASUALTY_TOTAL'].std()
-
-    # Print the summary statistics
-    print("Summary Statistics:")
-    print('Total Crashes', total_vehicle)
-    print("Crash Observation:", crash_observations)
-    print("Crash Factors:", crash_factors)
-
-    print("Median Vehicles Involved:", median_vehicles)
-    print("Mode Crash Type:", mode_crash_type)
-
-    print("Standard Deviation of Age:", std_dev)
-    print("25th Percentile of Crash Totals:", percentile_25)
-    print("75th Percentile of Crash Total:", percentile_75)
-
-    latex_table = pd.DataFrame({
-        'Statistic': ['Total Crashes', 'Crash Observation', 'Crash Factors', 'Median Vehicles Involved',
-                      'Mode Crash Type', 'Standard Deviation of Age', '25th Percentile of Crash Totals',
-                      '75th Percentile of Crash Total'],
-        'Value': [total_vehicle, crash_observations, crash_factors, median_vehicles, mode_crash_type,
-                  std_dev, percentile_25, percentile_75]
-    }).to_latex(index=False)
-
-    # Print the LaTeX table
-    print(latex_table)
-    summary_statsd = crash_data[
-        ['CRASH_YEAR', 'CRASH_FIN_YEAR', 'CRASH_MONTH', 'CRASH_DAY_OF_WEEK', 'CRASH_HOUR']].describe()
-
-    # Print the summary statistics
-    print("Summary Statistics:")
-    print(summary_statsd)
-
-    if 'CRASH_SEVERITY' in crash_data:
-        severity_counts = crash_data['CRASH_SEVERITY'].value_counts()
-        print(severity_counts)
-
-
-# Load data
-
-
-
-
-
-# Convert data types
-
-def clean_data_types(df):
-    for col in df.columns:
-        if df[col].dtype == 'object':
-            # Attempt to convert the column to numeric type
-            df[col] = pd.to_numeric(df[col], errors='coerce')
-    return df
-
-
-
-
-# id folumn is a string drop
-# feauture slection
-def select_features(X_train, y_train, n_f=16):
-    feature_names = X_train.columns
-    # configure to select all features
-    fs = SelectKBest(score_func=f_regression, k=16)
-
-    # learn relationship from training data
-    fs.fit(X_train, y_train)
-
-    mask = fs.get_support()  # Boolean array of selected features
-    selected_features = [feature for bool, feature in zip(mask, feature_names) if bool]
-    # transform train input data
-    X_train_fs = fs.transform(X_train)
-    X_train_fs = pd.DataFrame(X_train_fs, columns=selected_features)
-    X_train = X_train[selected_features]
-    return X_train, fs
-
-
-def findCorrelation(corr, cutoff=0.9, exact=None):
-    """
-    This function is the Python implementation of the R function
-    `findCorrelation()`.
-
-    Relies on numpy and pandas, so must have them pre-installed.
-
-    It searches through a correlation matrix and returns a list of column names
-    to remove to reduce pairwise correlations.
-
-    For the documentation of the R function, see
-    https://www.rdocumentation.org/packages/caret/topics/findCorrelation
-    and for the source code of `findCorrelation()`, see
-    https://github.com/topepo/caret/blob/master/pkg/caret/R/findCorrelation.R
-
-    -----------------------------------------------------------------------------
-
-    Parameters:
-    -----------
-    corr: pandas dataframe.
-        A correlation matrix as a pandas dataframe.
-    cutoff: float, default: 0.9.
-        A numeric value for the pairwise absolute correlation cutoff
-    exact: bool, default: None
-        A boolean value that determines whether the average correlations be
-        recomputed at each step
-    -----------------------------------------------------------------------------
-    Returns:
-    --------
-    list of column names
-    -----------------------------------------------------------------------------
-    Example:
-    --------
-    R1 = pd.DataFrame({
-        'x1': [1.0, 0.86, 0.56, 0.32, 0.85],
-        'x2': [0.86, 1.0, 0.01, 0.74, 0.32],
-        'x3': [0.56, 0.01, 1.0, 0.65, 0.91],
-        'x4': [0.32, 0.74, 0.65, 1.0, 0.36],
-        'x5': [0.85, 0.32, 0.91, 0.36, 1.0]
-    }, index=['x1', 'x2', 'x3', 'x4', 'x5'])
-
-    findCorrelation(R1, cutoff=0.6, exact=False)  # ['x4', 'x5', 'x1', 'x3']
-    findCorrelation(R1, cutoff=0.6, exact=True)   # ['x1', 'x5', 'x4']
-    """
-
-    def _findCorrelation_fast(corr, avg, cutoff):
-
-        combsAboveCutoff = corr.where(lambda x: (np.tril(x) == 0) & (x > cutoff)).stack().index
-
-        rowsToCheck = combsAboveCutoff.get_level_values(0)
-        colsToCheck = combsAboveCutoff.get_level_values(1)
-
-        msk = avg[colsToCheck] > avg[rowsToCheck].values
-        deletecol = pd.unique(np.r_[colsToCheck[msk], rowsToCheck[~msk]]).tolist()
-
-        return deletecol
-
-    def _findCorrelation_exact(corr, avg, cutoff):
-
-        x = corr.loc[(*[avg.sort_values(ascending=False).index] * 2,)]
-
-        if (x.dtypes.values[:, None] == ['int64', 'int32', 'int16', 'int8']).any():
-            x = x.astype(float)
-
-        x.values[(*[np.arange(len(x))] * 2,)] = np.nan
-
-        deletecol = []
-        for ix, i in enumerate(x.columns[:-1]):
-            for j in x.columns[ix + 1:]:
-                if x.loc[i, j] > cutoff:
-                    if x[i].mean() > x[j].mean():
-                        deletecol.append(i)
-                        x.loc[i] = x[i] = np.nan
-                    else:
-                        deletecol.append(j)
-                        x.loc[j] = x[j] = np.nan
-        return deletecol
-
-    if not np.allclose(corr, corr.T) or any(corr.columns != corr.index):
-        raise ValueError("correlation matrix is not symmetric.")
-
-    acorr = corr.abs()
-    avg = acorr.mean()
-
-    if exact or exact is None and corr.shape[1] < 100:
-        return _findCorrelation_exact(acorr, avg, cutoff)
-    else:
-        return _findCorrelation_fast(acorr, avg, cutoff)
-
-
-# Normalize data
-
-
-
-print('here is the main stuff')
-NAH = 0
-if NAH:
-    df = pd.read_csv('rqc40516_MotorcycleQUT_engineer_crash.csv', skiprows=5)
-    # Clean 'CRASH_SPEED_LIMIT' and convert to integer
-    df['CRASH_SPEED_LIMIT'] = df['CRASH_SPEED_LIMIT'].str.replace(' km/h', '').astype(int)
-
-    # Clean data types
-    df = clean_data_types(df)
-
-    # Encode categorical variables
-    categories = ['CRASH_SEVERITY', 'CRASH_TYPE', 'CRASH_NATURE', 'CRASH_ATMOSPHERIC_CONDITION']
-    df = pd.get_dummies(df, columns=categories)
-
-    # Select only numeric columns
-    numeric_types = ['int32', 'uint8', 'bool', 'int64', 'float64']
-    df = df.select_dtypes(include=numeric_types)
-
-    # Check for missing values and fill with column mean
-    missing_values_count = df['CASUALTY_TOTAL'].isnull().sum()
-    df[numeric_cols] = df[numeric_cols].fillna(df[numeric_cols].mean())
-
-    # Remove unnecessary columns
-    df.drop(columns=['CRASH_REF_NUMBER'], inplace=True)
-
-    # Define columns to exclude from the analysis
-    EXCLUDE = [
-        'LONGITUDE', 'YEAR', 'DCA', 'ID', 'LATIT', 'NAME', 'SEVERITY',
-        "CASUALTY", "CRASH_FIN_YEAR", "CRASH_HOUR"
-    ]
-
-    # Filter out excluded columns
-    df = df[[col for col in df.columns if col not in EXCLUDE]]
-
-    # Prepare target variable
-    y = df['CASUALTY_TOTAL']
-
-    # Check for finite values and compute correlations
-    finite_check = df.apply(np.isfinite).all()
-    df_clean = df.loc[:, finite_check]
-    corr = df_clean.corr()
-
-    # Identify and remove highly correlated features
-    hc = findCorrelation(corr, cutoff=0.5)
-    trimmed_df = df_clean.drop(columns=hc)
-
-    # Feature selection
-    df_cleaner, fs = select_features(trimmed_df, y)
-
-"""
-# Split data
-from sklearn.model_selection import train_test_split
-
-X_train, X_test, y_train, y_test = train_test_split(df.drop('target_column', axis=1), df['target_column'],
-                                                    test_size=0.2, random_state=42)
-"""

metacountregressor-0.1.63.dist-info/METADATA

@@ -1,14 +0,0 @@
-Metadata-Version: 2.1
-Name: metacountregressor
-Version: 0.1.63
-Summary: Extensions for a Python package for                               estimation of count models.
-Home-page: https://github.com/zahern/MetaCount
-Author: Zeke Ahern
-Author-email: zeke.ahern@hdr.qut.edu.au
-License: QUT
-Requires-Python: >=3.10
-License-File: LICENSE.txt
-Requires-Dist: numpy >=1.13.1
-Requires-Dist: scipy >=1.0.0
-
-long_description

metacountregressor-0.1.63.dist-info/RECORD

@@ -1,19 +0,0 @@
-metacountregressor/__init__.py,sha256=L-dpP2iXXPDaKjC34BWkL0XsmC8s8IKuChvqHEraMb4,2940
-metacountregressor/_device_cust.py,sha256=759fnKmTYccJm4Lpi9_1reurh6OB9d6q9soPR0PltKc,2047
-metacountregressor/halton.py,sha256=jhovA45UBoZYU9g-hl6Lb2sBIx_ZBTNdPrpgkzR9fng,9463
-metacountregressor/helperprocess.py,sha256=nlabPUz_hf8SbFONn2wBKwcVJusTKcynPaxkEYvTWlU,9052
-metacountregressor/main.py,sha256=vGdoVsiiiBz_kaCZN_zXSRFS59EtYYNlmz0Et1hgLr8,17138
-metacountregressor/main_old.py,sha256=eTS4ygq27MnU-dZ_j983Ucb-D5XfbVF8OJQK2hVVLZc,24123
-metacountregressor/metaheuristics.py,sha256=4coj8gTyesnYFA8r4UkQer156OQ30BRQhFTMFEwSjtU,105490
-metacountregressor/pareto_file.py,sha256=whySaoPAUWYjyI8zo0hwAOa3rFk6SIUlHSpqZiLur0k,23096
-metacountregressor/pareto_logger__plot.py,sha256=mEU2QN4wmsM7t39GJ_XhJ_jjsdl09JOmG0U2jICrAkI,30037
-metacountregressor/setup.py,sha256=8w6IqX0tJsbYrOI1BJLIJCIvOnunKli5I9fsF5PhHv4,919
-metacountregressor/single_objective_finder.py,sha256=jVG7GJBqzSP4_riYr-kMMKy_LE3SlGmKMunNhHYxgRg,8011
-metacountregressor/solution.py,sha256=fQaoo71zIxfOKLC6oTE9BnAm5OJRqRZnQ7a9nPIc9cM,284973
-metacountregressor/test_generated_paper2.py,sha256=pwOoRzl1jJIIOUAAvbkT6HmmTQ81mwpsshn9SLdKOg8,3927
-metacountregressor/test_motor.py,sha256=tQqot89vcdJMWBY7Y3AOYBkku4Jjj0Ua1cRNeUeK9OA,10424
-metacountregressor-0.1.63.dist-info/LICENSE.txt,sha256=OXLcl0T2SZ8Pmy2_dmlvKuetivmyPd5m1q-Gyd-zaYY,35149
-metacountregressor-0.1.63.dist-info/METADATA,sha256=Ss5jdF_L-b78jKsg_x3hvLXBSl7wxoAs50sjc7cNvtI,412
-metacountregressor-0.1.63.dist-info/WHEEL,sha256=GJ7t_kWBFywbagK5eo9IoUwLW6oyOeTKmQ-9iHFVNxQ,92
-metacountregressor-0.1.63.dist-info/top_level.txt,sha256=zGG7UC5WIpr76gsFUpwJ4En2aCcoNTONBaS3OewwjR0,19
-metacountregressor-0.1.63.dist-info/RECORD,,

metacountregressor-0.1.63.dist-info/top_level.txt

@@ -1 +0,0 @@
-metacountregressor