data-advisor 0.1.0__tar.gz → 0.2.0__tar.gz

data_advisor-0.2.0/PKG-INFO

@@ -0,0 +1,147 @@
+Metadata-Version: 2.4
+Name: data_advisor
+Version: 0.2.0
+Summary: A production-grade diagnostic and code generation advisor for timed data analysis exams and rapid exploratory data science.
+Author: Principal Data Science Architect
+License-Expression: MIT
+Keywords: data-analysis,eda,data-science,hypothesis-testing,code-generation,machine-learning,automated-eda,pandas,scipy,scikit-learn
+Classifier: Development Status :: 4 - Beta
+Classifier: Intended Audience :: Developers
+Classifier: Intended Audience :: Education
+Classifier: Intended Audience :: Science/Research
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.9
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Programming Language :: Python :: 3.13
+Classifier: Topic :: Scientific/Engineering :: Information Analysis
+Classifier: Topic :: Software Development :: Code Generators
+Requires-Python: >=3.9
+Description-Content-Type: text/markdown
+Requires-Dist: pandas>=2.0.0
+Requires-Dist: numpy>=1.24.0
+Requires-Dist: scipy>=1.10.0
+Requires-Dist: scikit-learn>=1.2.0
+Requires-Dist: matplotlib>=3.7.0
+Requires-Dist: seaborn>=0.12.0
+Provides-Extra: dev
+Requires-Dist: pytest>=7.0.0; extra == "dev"
+Requires-Dist: pytest-cov>=4.0.0; extra == "dev"
+
+# DataAdvisor (`data-advisor`)
+
+Quick guide on how to upload this package to PyPI and how to use it on any other system.
+
+---
+
+## 🚀 Part 1: How to Upload to PyPI (From This System)
+
+Run these commands in PowerShell inside this directory:
+
+### 1. Build the Package
+```powershell
+python -m build
+```
+*(This bundles all 52 DAUP questions and 17 IoT lab solutions directly inside the package).*
+
+### 2. Upload to PyPI
+```powershell
+python -m twine upload dist/*
+```
+- **Username**: `__token__`
+- **Password**: `<paste your PyPI API token starting with pypi-...>`
+
+> If you don't have a token yet: Register at [pypi.org](https://pypi.org), enable 2FA in Account Settings, and create an API Token.
+
+---
+
+## 💻 Part 2: What to Do on Other Systems
+
+Once uploaded, on **any other computer, VM, or lab machine** with Python installed:
+
+### 1. Install via `pip`
+```bash
+pip install data-advisor
+```
+
+---
+
+### 2. How to Use on the Other System
+
+#### A. View / Retrieve Complete Code Files
+Directly from terminal:
+```bash
+# View complete code with header & line count:
+data-advisor --get q1
+data-advisor --get q24 --line-numbers
+data-advisor --get q52
+
+# View IoT sketches and scripts:
+data-advisor --get sketch.ino
+data-advisor --get weather_analysis.py
+
+# List all available 52 questions & 17 IoT projects:
+data-advisor --list
+```
+
+Or inside Python / Jupyter Notebook:
+```python
+from data_advisor import get_file, read_file
+
+# Print complete code directly:
+get_file("q1")
+get_file(24, line_numbers=True)
+
+# Or get the code as a string to copy / save:
+code = read_file("q24")
+```
+
+---
+
+#### B. Run Any File Directly
+Execute any question or project script directly:
+```bash
+data-advisor --run q24
+data-advisor --run 10
+data-advisor --run iss
+```
+
+Or inside Python:
+```python
+from data_advisor import run_file
+run_file("q24")
+```
+
+---
+
+#### C. Search by Keyword
+```bash
+data-advisor --search "linear regression"
+data-advisor --search "dht22"
+data-advisor --search "kmeans"
+```
+
+Or inside Python:
+```python
+from data_advisor import search
+search("linear regression")
+```
+
+---
+
+#### D. Audit Any Exam Dataset & Generate Python Code
+When given an exam dataset (e.g. `exam_dataset.csv`):
+```bash
+# Print diagnostic report + complete executable Python solution:
+data-advisor exam_dataset.csv --target churn --code
+
+# Save generated Python script directly to a file:
+data-advisor exam_dataset.csv --target churn --output solution.py
+```
+
+Or inside Python:
+```python
+from data_advisor import data_advisor
+data_advisor("exam_dataset.csv", target="churn")
+```

data_advisor-0.2.0/README.md

@@ -0,0 +1,116 @@
+# DataAdvisor (`data-advisor`)
+
+Quick guide on how to upload this package to PyPI and how to use it on any other system.
+
+---
+
+## 🚀 Part 1: How to Upload to PyPI (From This System)
+
+Run these commands in PowerShell inside this directory:
+
+### 1. Build the Package
+```powershell
+python -m build
+```
+*(This bundles all 52 DAUP questions and 17 IoT lab solutions directly inside the package).*
+
+### 2. Upload to PyPI
+```powershell
+python -m twine upload dist/*
+```
+- **Username**: `__token__`
+- **Password**: `<paste your PyPI API token starting with pypi-...>`
+
+> If you don't have a token yet: Register at [pypi.org](https://pypi.org), enable 2FA in Account Settings, and create an API Token.
+
+---
+
+## 💻 Part 2: What to Do on Other Systems
+
+Once uploaded, on **any other computer, VM, or lab machine** with Python installed:
+
+### 1. Install via `pip`
+```bash
+pip install data-advisor
+```
+
+---
+
+### 2. How to Use on the Other System
+
+#### A. View / Retrieve Complete Code Files
+Directly from terminal:
+```bash
+# View complete code with header & line count:
+data-advisor --get q1
+data-advisor --get q24 --line-numbers
+data-advisor --get q52
+
+# View IoT sketches and scripts:
+data-advisor --get sketch.ino
+data-advisor --get weather_analysis.py
+
+# List all available 52 questions & 17 IoT projects:
+data-advisor --list
+```
+
+Or inside Python / Jupyter Notebook:
+```python
+from data_advisor import get_file, read_file
+
+# Print complete code directly:
+get_file("q1")
+get_file(24, line_numbers=True)
+
+# Or get the code as a string to copy / save:
+code = read_file("q24")
+```
+
+---
+
+#### B. Run Any File Directly
+Execute any question or project script directly:
+```bash
+data-advisor --run q24
+data-advisor --run 10
+data-advisor --run iss
+```
+
+Or inside Python:
+```python
+from data_advisor import run_file
+run_file("q24")
+```
+
+---
+
+#### C. Search by Keyword
+```bash
+data-advisor --search "linear regression"
+data-advisor --search "dht22"
+data-advisor --search "kmeans"
+```
+
+Or inside Python:
+```python
+from data_advisor import search
+search("linear regression")
+```
+
+---
+
+#### D. Audit Any Exam Dataset & Generate Python Code
+When given an exam dataset (e.g. `exam_dataset.csv`):
+```bash
+# Print diagnostic report + complete executable Python solution:
+data-advisor exam_dataset.csv --target churn --code
+
+# Save generated Python script directly to a file:
+data-advisor exam_dataset.csv --target churn --output solution.py
+```
+
+Or inside Python:
+```python
+from data_advisor import data_advisor
+data_advisor("exam_dataset.csv", target="churn")
+```

{data_advisor-0.1.0 → data_advisor-0.2.0}/pyproject.toml

@@ -4,7 +4,7 @@ build-backend = "setuptools.build_meta"
 
 [project]
 name = "data_advisor"
-version = "0.1.0"
+version = "0.2.0"
 description = "A production-grade diagnostic and code generation advisor for timed data analysis exams and rapid exploratory data science."
 readme = "README.md"
 requires-python = ">=3.9"
@@ -59,6 +59,10 @@ data-advisor = "data_advisor.cli:main"
 [tool.setuptools.packages.find]
 where = ["src"]
 
+[tool.setuptools.package-data]
+"*" = ["code_bank/**/*", "code_bank/*"]
+data_advisor = ["code_bank/**/*", "code_bank/*"]
+
 [tool.pytest.ini_options]
 testpaths = ["tests"]
 python_files = ["test_*.py"]

data_advisor-0.2.0/src/data_advisor/code_bank/01_dht22_serial/README.md

@@ -0,0 +1,17 @@
+# Experiment 1: ESP32 DHT22 Temperature & Humidity Sensor
+
+## Objective
+Read ambient temperature and relative humidity using a DHT22 sensor with ESP32 and output values via Serial Communication.
+
+## Hardware Wiring (Wokwi / Physical)
+- DHT22 VCC -> ESP32 3V3
+- DHT22 SDA -> ESP32 GPIO 18
+- DHT22 GND -> ESP32 GND
+
+## How to Run in Wokwi
+1. Open [wokwi.com](https://wokwi.com) and create an ESP32 project.
+2. Paste `sketch.ino` into the code tab.
+3. Paste `diagram.json` into the `diagram.json` tab.
+4. Ensure `libraries.txt` includes `DHT sensor library` and `Adafruit Unified Sensor`.
+5. Click **Start Simulation (Play)**.
+6. Open the **Serial Monitor** (115200 baud) to view sensor readings. Adjust sliders on DHT22 to see live updates.

data_advisor-0.2.0/src/data_advisor/code_bank/01_dht22_serial/diagram.json

@@ -0,0 +1,17 @@
+{
+  "version": 1,
+  "author": "IoT Lab",
+  "editor": "wokwi",
+  "parts": [
+    { "type": "board-esp32-devkit-c-v4", "id": "esp", "top": 0, "left": 0, "attrs": {} },
+    { "type": "wokwi-dht22", "id": "dht1", "top": 0.3, "left": -159, "attrs": {} }
+  ],
+  "connections": [
+    [ "esp:TX", "$serialMonitor:RX", "", [] ],
+    [ "esp:RX", "$serialMonitor:TX", "", [] ],
+    [ "dht1:GND", "esp:GND.2", "black", [ "v0" ] ],
+    [ "dht1:VCC", "esp:3V3", "red", [ "v0" ] ],
+    [ "dht1:SDA", "esp:18", "green", [ "v0" ] ]
+  ],
+  "dependencies": {}
+}

data_advisor-0.2.0/src/data_advisor/code_bank/01_dht22_serial/libraries.txt

@@ -0,0 +1,2 @@
+DHT sensor library
+Adafruit Unified Sensor

data_advisor-0.2.0/src/data_advisor/code_bank/01_dht22_serial/sketch.ino

@@ -0,0 +1,31 @@
+#include <DHT.h>
+
+#define DHT_PIN 18
+#define DHT_TYPE DHT22
+
+DHT dht(DHT_PIN, DHT_TYPE);
+
+void setup() {
+  Serial.begin(115200);
+  delay(1000);
+  dht.begin();
+  Serial.println("System Initialized! Reading DHT22 data...");
+}
+
+void loop() {
+  float temperature = dht.readTemperature();
+  float humidity = dht.readHumidity();
+
+  if (isnan(temperature) || isnan(humidity)) {
+    Serial.println("Failed to read from DHT sensor!");
+    return;
+  }
+
+  Serial.print("Temperature: ");
+  Serial.print(temperature);
+  Serial.print(" °C | Humidity: ");
+  Serial.print(humidity);
+  Serial.println(" %");
+
+  delay(2000);
+}

data_advisor-0.2.0/src/data_advisor/code_bank/02_ldr_serial/README.md

@@ -0,0 +1,15 @@
+# Experiment 2: ESP32 LDR Light Intensity Monitoring
+
+## Objective
+Read digital ambient light levels using an LDR sensor module and display the status via Serial Communication.
+
+## Hardware Wiring
+- LDR VCC -> ESP32 3V3
+- LDR GND -> ESP32 GND
+- LDR DO (Digital Output) -> ESP32 GPIO 34
+
+## How to Run in Wokwi
+1. Load `sketch.ino` and `diagram.json` into Wokwi.
+2. Click **Start Simulation**.
+3. View the **Serial Monitor** (115200 baud).
+4. Click on the LDR sensor in Wokwi and adjust the Lux slider to toggle between BRIGHT and DARK.

data_advisor-0.2.0/src/data_advisor/code_bank/02_ldr_serial/diagram.json

@@ -0,0 +1,17 @@
+{
+  "version": 1,
+  "author": "IoT Lab",
+  "editor": "wokwi",
+  "parts": [
+    { "type": "board-esp32-devkit-c-v4", "id": "esp", "top": 0, "left": 0, "attrs": {} },
+    { "type": "wokwi-photoresistor-sensor", "id": "ldr1", "top": 0.3, "left": -159, "attrs": {} }
+  ],
+  "connections": [
+    [ "esp:TX", "$serialMonitor:RX", "", [] ],
+    [ "esp:RX", "$serialMonitor:TX", "", [] ],
+    [ "ldr1:GND", "esp:GND.2", "black", [ "v0" ] ],
+    [ "ldr1:VCC", "esp:3V3", "red", [ "v0" ] ],
+    [ "ldr1:DO", "esp:34", "green", [ "v0" ] ]
+  ],
+  "dependencies": {}
+}

data_advisor-0.2.0/src/data_advisor/code_bank/02_ldr_serial/sketch.ino

@@ -0,0 +1,21 @@
+#define LDR_PIN 34
+
+void setup() {
+  Serial.begin(115200);
+  delay(1000);
+  pinMode(LDR_PIN, INPUT);
+  Serial.println("LDR Monitoring Initialized.");
+}
+
+void loop() {
+  int lightStatus = digitalRead(LDR_PIN);
+
+  Serial.print("Light Status: ");
+  if (lightStatus == LOW) {
+    Serial.println("BRIGHT (Light Detected)");
+  } else {
+    Serial.println("DARK (No Light)");
+  }
+
+  delay(1000);
+}

data_advisor-0.2.0/src/data_advisor/code_bank/03_pir_serial/README.md

@@ -0,0 +1,14 @@
+# Experiment 3: ESP32 PIR Motion Detection
+
+## Objective
+Detect human/infrared motion using a PIR sensor module and report motion events over Serial Communication.
+
+## Hardware Wiring
+- PIR VCC -> ESP32 3V3
+- PIR GND -> ESP32 GND
+- PIR OUT -> ESP32 GPIO 27
+
+## How to Run in Wokwi
+1. Load `sketch.ino` and `diagram.json` into Wokwi.
+2. Start the simulation.
+3. In Wokwi, click on the PIR sensor and click "Simulate motion" to trigger `MOTION DETECTED!`.

data_advisor-0.2.0/src/data_advisor/code_bank/03_pir_serial/diagram.json

@@ -0,0 +1,17 @@
+{
+  "version": 1,
+  "author": "IoT Lab",
+  "editor": "wokwi",
+  "parts": [
+    { "type": "board-esp32-devkit-c-v4", "id": "esp", "top": 0, "left": 0, "attrs": {} },
+    { "type": "wokwi-pir-motion-sensor", "id": "pir1", "top": 0.3, "left": -159, "attrs": {} }
+  ],
+  "connections": [
+    [ "esp:TX", "$serialMonitor:RX", "", [] ],
+    [ "esp:RX", "$serialMonitor:TX", "", [] ],
+    [ "pir1:GND", "esp:GND.2", "black", [ "v0" ] ],
+    [ "pir1:VCC", "esp:3V3", "red", [ "v0" ] ],
+    [ "pir1:OUT", "esp:27", "green", [ "v0" ] ]
+  ],
+  "dependencies": {}
+}

data_advisor-0.2.0/src/data_advisor/code_bank/03_pir_serial/sketch.ino

@@ -0,0 +1,20 @@
+#define PIR_PIN 27
+
+void setup() {
+  Serial.begin(115200);
+  delay(1000);
+  pinMode(PIR_PIN, INPUT);
+  Serial.println("PIR Motion Detection Initialized.");
+}
+
+void loop() {
+  int motionStatus = digitalRead(PIR_PIN);
+
+  if (motionStatus == HIGH) {
+    Serial.println("MOTION DETECTED!");
+  } else {
+    Serial.println("No motion.");
+  }
+
+  delay(500);
+}

data_advisor-0.2.0/src/data_advisor/code_bank/04_mqtt_esp32_python/README.md

@@ -0,0 +1,19 @@
+# Experiment 4: ESP32 MQTT Publisher & Python Subscriber
+
+## Objective
+Read temperature and humidity with an ESP32 and publish the readings to HiveMQ public MQTT broker. A local Python script subscribes and displays incoming data in real time.
+
+## Requirements
+- Python package: `pip install paho-mqtt`
+- Wokwi libraries: `DHT sensor library`, `PubSubClient`, `Adafruit Unified Sensor`
+
+## Execution Steps
+1. **Run Python Subscriber:**
+   ```bash
+   python subscriber.py
+   ```
+2. **Run ESP32 Publisher in Wokwi:**
+   - Paste `sketch.ino`, `diagram.json`, and `libraries.txt`.
+   - Click Play in Wokwi.
+   - ESP32 connects to `Wokwi-GUEST` WiFi and publishes data to `broker.hivemq.com`.
+3. Observe live sensor data appearing in your terminal.

data_advisor-0.2.0/src/data_advisor/code_bank/04_mqtt_esp32_python/diagram.json

@@ -0,0 +1,17 @@
+{
+  "version": 1,
+  "author": "IoT Lab",
+  "editor": "wokwi",
+  "parts": [
+    { "type": "board-esp32-devkit-c-v4", "id": "esp", "top": 0, "left": 0, "attrs": {} },
+    { "type": "wokwi-dht22", "id": "dht1", "top": 0.3, "left": -159, "attrs": {} }
+  ],
+  "connections": [
+    [ "esp:TX", "$serialMonitor:RX", "", [] ],
+    [ "esp:RX", "$serialMonitor:TX", "", [] ],
+    [ "dht1:GND", "esp:GND.2", "black", [ "v0" ] ],
+    [ "dht1:VCC", "esp:3V3", "red", [ "v0" ] ],
+    [ "dht1:SDA", "esp:4", "green", [ "v0" ] ]
+  ],
+  "dependencies": {}
+}

data_advisor-0.2.0/src/data_advisor/code_bank/04_mqtt_esp32_python/libraries.txt

@@ -0,0 +1,3 @@
+DHT sensor library
+PubSubClient
+Adafruit Unified Sensor

data_advisor-0.2.0/src/data_advisor/code_bank/04_mqtt_esp32_python/sketch.ino

@@ -0,0 +1,87 @@
+#include <WiFi.h>
+#include <PubSubClient.h>
+#include <DHT.h>
+
+const char* ssid = "Wokwi-GUEST"; 
+const char* password = "";
+
+const char* mqtt_server = "broker.hivemq.com";
+const int mqtt_port = 1883;
+
+const char* temp_topic = "iot_lab_test/temp";
+const char* hum_topic  = "iot_lab_test/humidity";
+
+#define DHTPIN 4
+#define DHTTYPE DHT22
+DHT dht(DHTPIN, DHTTYPE);
+
+WiFiClient espClient;
+PubSubClient client(espClient);
+
+void setup_wifi() {
+  delay(10);
+  Serial.print("Connecting to WiFi: ");
+  Serial.println(ssid);
+
+  WiFi.mode(WIFI_STA);
+  WiFi.begin(ssid, password);
+
+  while (WiFi.status() != WL_CONNECTED) {
+    delay(500);
+    Serial.print(".");
+  }
+
+  Serial.println("\nWiFi connected: ");
+  Serial.println(WiFi.localIP());
+}
+
+void reconnect() {
+  while (!client.connected()) {
+    Serial.print("Connecting to MQTT broker...");
+    String clientId = "ESP32-" + String(random(0xffff), HEX);
+    if (client.connect(clientId.c_str())) {
+      Serial.println("connected");
+    } else {
+      Serial.print("failed, rc=");
+      Serial.print(client.state());
+      Serial.println(" retrying in 5 seconds");
+      delay(5000);
+    }
+  }
+}
+
+void setup() {
+  Serial.begin(115200);
+  delay(1000);
+  dht.begin();
+  setup_wifi();
+  client.setServer(mqtt_server, mqtt_port);
+}
+
+void loop() {
+  if (!client.connected()) {
+    reconnect();
+  }
+  client.loop();
+
+  delay(2000);
+
+  float temperature = dht.readTemperature();
+  float humidity = dht.readHumidity();
+
+  if (isnan(temperature) || isnan(humidity)) {
+    Serial.println("Failed to read from DHT sensor!");
+    return;
+  }
+
+  String temp_str = String(temperature, 2);
+  String humidity_str = String(humidity, 2);
+
+  client.publish(temp_topic, temp_str.c_str());
+  client.publish(hum_topic, humidity_str.c_str());
+
+  Serial.print("Published: Temp=");
+  Serial.print(temp_str);
+  Serial.print(" C | Hum=");
+  Serial.println(humidity_str);
+}

data_advisor-0.2.0/src/data_advisor/code_bank/04_mqtt_esp32_python/subscriber.py

@@ -0,0 +1,30 @@
+import paho.mqtt.client as mqtt
+
+BROKER = "broker.hivemq.com"
+PORT = 1883
+TEMP_TOPIC = "iot_lab_test/temp"
+HUMIDITY_TOPIC = "iot_lab_test/humidity"
+
+def on_connect(client, userdata, flags, rc, *extra):
+    if rc == 0:
+        print("Connected to HiveMQ broker successfully.")
+        client.subscribe(TEMP_TOPIC)
+        client.subscribe(HUMIDITY_TOPIC)
+        print("Subscribed to:", TEMP_TOPIC, "and", HUMIDITY_TOPIC)
+    else:
+        print("Connection failed with return code:", rc)
+
+def on_message(client, userdata, msg):
+    print(f"[{msg.topic}] : {msg.payload.decode()}")
+
+try:
+    client = mqtt.Client(mqtt.CallbackAPIVersion.VERSION2)
+except AttributeError:
+    client = mqtt.Client()
+
+client.on_connect = on_connect
+client.on_message = on_message
+
+print("Connecting to MQTT Broker...")
+client.connect(BROKER, PORT, 60)
+client.loop_forever()

data_advisor-0.2.0/src/data_advisor/code_bank/05_http_rest_supabase/README.md

@@ -0,0 +1,30 @@
+# Experiment 5: HTTP REST API Cloud Storage & Web Dashboard
+
+## Objective
+Transmit sensor data to a cloud database via HTTP POST requests and render records on an interactive web dashboard.
+
+## Requirements
+```bash
+pip install requests streamlit pandas
+```
+
+## Cloud DB Table Setup (Supabase SQL)
+```sql
+create table sensor_readings (
+  id bigint generated by default as identity primary key,
+  created_at timestamp with time zone default timezone('utc'::text, now()) not null,
+  temperature float not null,
+  humidity float not null
+);
+```
+
+## Execution
+1. Update `SUPABASE_URL` and `SUPABASE_KEY` in both scripts.
+2. In Terminal 1, run sender:
+   ```bash
+   python send_http_data.py
+   ```
+3. In Terminal 2, launch dashboard:
+   ```bash
+   streamlit run app_http.py
+   ```