sciveo 0.0.49__tar.gz → 0.1.0__tar.gz
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- {sciveo-0.0.49 → sciveo-0.1.0}/PKG-INFO +12 -3
- {sciveo-0.0.49 → sciveo-0.1.0}/README.md +11 -2
- {sciveo-0.0.49 → sciveo-0.1.0}/sciveo/monitoring/monitor.py +13 -0
- sciveo-0.1.0/sciveo/version.py +2 -0
- {sciveo-0.0.49 → sciveo-0.1.0}/sciveo.egg-info/PKG-INFO +12 -3
- sciveo-0.0.49/sciveo/version.py +0 -2
- {sciveo-0.0.49 → sciveo-0.1.0}/sciveo/__init__.py +0 -0
- {sciveo-0.0.49 → sciveo-0.1.0}/sciveo/api/__init__.py +0 -0
- {sciveo-0.0.49 → sciveo-0.1.0}/sciveo/api/base.py +0 -0
- {sciveo-0.0.49 → sciveo-0.1.0}/sciveo/api/upload.py +0 -0
- {sciveo-0.0.49 → sciveo-0.1.0}/sciveo/common/__init__.py +0 -0
- {sciveo-0.0.49 → sciveo-0.1.0}/sciveo/common/configuration.py +0 -0
- {sciveo-0.0.49 → sciveo-0.1.0}/sciveo/common/model.py +0 -0
- {sciveo-0.0.49 → sciveo-0.1.0}/sciveo/common/optimizers.py +0 -0
- {sciveo-0.0.49 → sciveo-0.1.0}/sciveo/common/sampling.py +0 -0
- {sciveo-0.0.49 → sciveo-0.1.0}/sciveo/common/tools/__init__.py +0 -0
- {sciveo-0.0.49 → sciveo-0.1.0}/sciveo/common/tools/daemon.py +0 -0
- {sciveo-0.0.49 → sciveo-0.1.0}/sciveo/common/tools/formating.py +0 -0
- {sciveo-0.0.49 → sciveo-0.1.0}/sciveo/common/tools/hardware.py +0 -0
- {sciveo-0.0.49 → sciveo-0.1.0}/sciveo/common/tools/logger.py +0 -0
- {sciveo-0.0.49 → sciveo-0.1.0}/sciveo/common/tools/synchronized.py +0 -0
- {sciveo-0.0.49 → sciveo-0.1.0}/sciveo/common/tools/timers.py +0 -0
- {sciveo-0.0.49 → sciveo-0.1.0}/sciveo/content/__init__.py +0 -0
- {sciveo-0.0.49 → sciveo-0.1.0}/sciveo/content/dataset.py +0 -0
- {sciveo-0.0.49 → sciveo-0.1.0}/sciveo/content/experiment.py +0 -0
- {sciveo-0.0.49 → sciveo-0.1.0}/sciveo/content/project.py +0 -0
- {sciveo-0.0.49 → sciveo-0.1.0}/sciveo/content/runner.py +0 -0
- {sciveo-0.0.49 → sciveo-0.1.0}/sciveo/monitoring/__init__.py +0 -0
- {sciveo-0.0.49 → sciveo-0.1.0}/sciveo/monitoring/network.py +0 -0
- {sciveo-0.0.49 → sciveo-0.1.0}/sciveo/monitoring/start.py +0 -0
- {sciveo-0.0.49 → sciveo-0.1.0}/sciveo.egg-info/SOURCES.txt +0 -0
- {sciveo-0.0.49 → sciveo-0.1.0}/sciveo.egg-info/dependency_links.txt +0 -0
- {sciveo-0.0.49 → sciveo-0.1.0}/sciveo.egg-info/requires.txt +0 -0
- {sciveo-0.0.49 → sciveo-0.1.0}/sciveo.egg-info/top_level.txt +0 -0
- {sciveo-0.0.49 → sciveo-0.1.0}/setup.cfg +0 -0
- {sciveo-0.0.49 → sciveo-0.1.0}/setup.py +0 -0
- {sciveo-0.0.49 → sciveo-0.1.0}/test/test_configuration.py +0 -0
- {sciveo-0.0.49 → sciveo-0.1.0}/test/test_monitoring.py +0 -0
- {sciveo-0.0.49 → sciveo-0.1.0}/test/test_runner.py +0 -0
- {sciveo-0.0.49 → sciveo-0.1.0}/test/test_sampling.py +0 -0
|
@@ -1,18 +1,21 @@
|
|
|
1
1
|
Metadata-Version: 2.1
|
|
2
2
|
Name: sciveo
|
|
3
|
-
Version: 0.0
|
|
3
|
+
Version: 0.1.0
|
|
4
4
|
Description-Content-Type: text/markdown
|
|
5
5
|
Provides-Extra: mon
|
|
6
6
|
Provides-Extra: net
|
|
7
7
|
Provides-Extra: all
|
|
8
8
|
|
|
9
|
-
# SCIVEO - ML/
|
|
9
|
+
# SCIVEO - ML/AI and Scientific tools
|
|
10
10
|
|
|
11
|
+
## Experiments Management Client
|
|
11
12
|
`sciveo` is a Python library that serves as a client for managing machine learning and scientific experiments on the sciveo.com platform. This library provides a convenient interface to interact with the sciveo.com API, enabling users to organize, track, and analyze their experiments efficiently.
|
|
12
13
|
There are few configuration params samplers, which allows easy parameter tuning. The "auto" sampler perhaps is the easiest to use, but also
|
|
13
14
|
"random" and "grid" ones are available.
|
|
14
15
|
|
|
15
|
-
|
|
16
|
+
## Monitoring client
|
|
17
|
+
There is also the sciveo.monitor() which will start monitoring machine CPU/RAM/GPU/NET/DISK/TEMP etc.
|
|
18
|
+
It is very easy to start and use.
|
|
16
19
|
|
|
17
20
|
|
|
18
21
|
## Features
|
|
@@ -21,6 +24,7 @@ There is also the sciveo.monitor() which will start monitoring machine CPU/RAM/G
|
|
|
21
24
|
- **Experiment Comparison:** Compare different experiments and their results.
|
|
22
25
|
- **Data Visualization:** Visualize experiment metrics and results.
|
|
23
26
|
- **Integration with sciveo.com:** Seamlessly connect and synchronize with the sciveo.com platform.
|
|
27
|
+
- **Monitoring machines (from HPC to jetson nano):** Visualisation and metrics collection in sciveo platform.
|
|
24
28
|
|
|
25
29
|
## Installation
|
|
26
30
|
|
|
@@ -29,6 +33,11 @@ pip install sciveo
|
|
|
29
33
|
|
|
30
34
|
- optional for sciveo monitoring
|
|
31
35
|
pip install sciveo[mon]
|
|
36
|
+
- optional for sciveo network tools
|
|
37
|
+
pip install sciveo[net]
|
|
38
|
+
|
|
39
|
+
- for full installation
|
|
40
|
+
pip install sciveo[all]
|
|
32
41
|
|
|
33
42
|
## Example usage
|
|
34
43
|
|
|
@@ -1,10 +1,13 @@
|
|
|
1
|
-
# SCIVEO - ML/
|
|
1
|
+
# SCIVEO - ML/AI and Scientific tools
|
|
2
2
|
|
|
3
|
+
## Experiments Management Client
|
|
3
4
|
`sciveo` is a Python library that serves as a client for managing machine learning and scientific experiments on the sciveo.com platform. This library provides a convenient interface to interact with the sciveo.com API, enabling users to organize, track, and analyze their experiments efficiently.
|
|
4
5
|
There are few configuration params samplers, which allows easy parameter tuning. The "auto" sampler perhaps is the easiest to use, but also
|
|
5
6
|
"random" and "grid" ones are available.
|
|
6
7
|
|
|
7
|
-
|
|
8
|
+
## Monitoring client
|
|
9
|
+
There is also the sciveo.monitor() which will start monitoring machine CPU/RAM/GPU/NET/DISK/TEMP etc.
|
|
10
|
+
It is very easy to start and use.
|
|
8
11
|
|
|
9
12
|
|
|
10
13
|
## Features
|
|
@@ -13,6 +16,7 @@ There is also the sciveo.monitor() which will start monitoring machine CPU/RAM/G
|
|
|
13
16
|
- **Experiment Comparison:** Compare different experiments and their results.
|
|
14
17
|
- **Data Visualization:** Visualize experiment metrics and results.
|
|
15
18
|
- **Integration with sciveo.com:** Seamlessly connect and synchronize with the sciveo.com platform.
|
|
19
|
+
- **Monitoring machines (from HPC to jetson nano):** Visualisation and metrics collection in sciveo platform.
|
|
16
20
|
|
|
17
21
|
## Installation
|
|
18
22
|
|
|
@@ -21,6 +25,11 @@ pip install sciveo
|
|
|
21
25
|
|
|
22
26
|
- optional for sciveo monitoring
|
|
23
27
|
pip install sciveo[mon]
|
|
28
|
+
- optional for sciveo network tools
|
|
29
|
+
pip install sciveo[net]
|
|
30
|
+
|
|
31
|
+
- for full installation
|
|
32
|
+
pip install sciveo[all]
|
|
24
33
|
|
|
25
34
|
## Example usage
|
|
26
35
|
|
|
@@ -33,6 +33,7 @@ class BaseMonitor(DaemonBase):
|
|
|
33
33
|
self.data.setdefault("CPU", {})
|
|
34
34
|
self.data.setdefault("DISK", {})
|
|
35
35
|
self.data.setdefault("NET", {})
|
|
36
|
+
self.data.setdefault("TEMP", {})
|
|
36
37
|
self.data["RAM"] = {}
|
|
37
38
|
self.data["LOG"] = {}
|
|
38
39
|
self.list_logs = []
|
|
@@ -58,6 +59,7 @@ class BaseMonitor(DaemonBase):
|
|
|
58
59
|
|
|
59
60
|
def loop(self):
|
|
60
61
|
self.get_cpu_usage()
|
|
62
|
+
self.get_temperatures()
|
|
61
63
|
self.get_memory()
|
|
62
64
|
self.get_gpu()
|
|
63
65
|
self.get_disk()
|
|
@@ -82,6 +84,14 @@ class BaseMonitor(DaemonBase):
|
|
|
82
84
|
except Exception:
|
|
83
85
|
pass
|
|
84
86
|
|
|
87
|
+
def get_temperatures(self):
|
|
88
|
+
try:
|
|
89
|
+
temperatures = psutil.sensors_temperatures()
|
|
90
|
+
for k, v in temperatures.items():
|
|
91
|
+
self.data["TEMP"][k] = [t.current for t in v]
|
|
92
|
+
except Exception:
|
|
93
|
+
pass
|
|
94
|
+
|
|
85
95
|
def get_memory(self):
|
|
86
96
|
try:
|
|
87
97
|
memory = psutil.virtual_memory()
|
|
@@ -143,6 +153,9 @@ class BaseMonitor(DaemonBase):
|
|
|
143
153
|
list_metrics = ["read bytes", "write bytes", "read count", "write count", "read time", "write time"]
|
|
144
154
|
disk_io_counters = psutil.disk_io_counters(perdisk=False)
|
|
145
155
|
self.get_io_metrics("DISK", list_metrics, disk_io_counters)
|
|
156
|
+
|
|
157
|
+
disk_usage = psutil.disk_usage('/')._asdict()
|
|
158
|
+
self.data["DISK"]["print"] = f"{disk_usage['percent']}% ({round(disk_usage['used'] / (1024 * 1024 * 1024), 1)} GB / {round(disk_usage['total'] / (1024 * 1024 * 1024), 1)} GB)"
|
|
146
159
|
except Exception as e:
|
|
147
160
|
pass
|
|
148
161
|
|
|
@@ -1,18 +1,21 @@
|
|
|
1
1
|
Metadata-Version: 2.1
|
|
2
2
|
Name: sciveo
|
|
3
|
-
Version: 0.0
|
|
3
|
+
Version: 0.1.0
|
|
4
4
|
Description-Content-Type: text/markdown
|
|
5
5
|
Provides-Extra: mon
|
|
6
6
|
Provides-Extra: net
|
|
7
7
|
Provides-Extra: all
|
|
8
8
|
|
|
9
|
-
# SCIVEO - ML/
|
|
9
|
+
# SCIVEO - ML/AI and Scientific tools
|
|
10
10
|
|
|
11
|
+
## Experiments Management Client
|
|
11
12
|
`sciveo` is a Python library that serves as a client for managing machine learning and scientific experiments on the sciveo.com platform. This library provides a convenient interface to interact with the sciveo.com API, enabling users to organize, track, and analyze their experiments efficiently.
|
|
12
13
|
There are few configuration params samplers, which allows easy parameter tuning. The "auto" sampler perhaps is the easiest to use, but also
|
|
13
14
|
"random" and "grid" ones are available.
|
|
14
15
|
|
|
15
|
-
|
|
16
|
+
## Monitoring client
|
|
17
|
+
There is also the sciveo.monitor() which will start monitoring machine CPU/RAM/GPU/NET/DISK/TEMP etc.
|
|
18
|
+
It is very easy to start and use.
|
|
16
19
|
|
|
17
20
|
|
|
18
21
|
## Features
|
|
@@ -21,6 +24,7 @@ There is also the sciveo.monitor() which will start monitoring machine CPU/RAM/G
|
|
|
21
24
|
- **Experiment Comparison:** Compare different experiments and their results.
|
|
22
25
|
- **Data Visualization:** Visualize experiment metrics and results.
|
|
23
26
|
- **Integration with sciveo.com:** Seamlessly connect and synchronize with the sciveo.com platform.
|
|
27
|
+
- **Monitoring machines (from HPC to jetson nano):** Visualisation and metrics collection in sciveo platform.
|
|
24
28
|
|
|
25
29
|
## Installation
|
|
26
30
|
|
|
@@ -29,6 +33,11 @@ pip install sciveo
|
|
|
29
33
|
|
|
30
34
|
- optional for sciveo monitoring
|
|
31
35
|
pip install sciveo[mon]
|
|
36
|
+
- optional for sciveo network tools
|
|
37
|
+
pip install sciveo[net]
|
|
38
|
+
|
|
39
|
+
- for full installation
|
|
40
|
+
pip install sciveo[all]
|
|
32
41
|
|
|
33
42
|
## Example usage
|
|
34
43
|
|
sciveo-0.0.49/sciveo/version.py
DELETED
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|