dfindexeddb 20241031__tar.gz → 20251109__tar.gz
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- dfindexeddb-20251109/PKG-INFO +222 -0
- {dfindexeddb-20241031 → dfindexeddb-20251109}/dfindexeddb/indexeddb/chromium/blink.py +116 -74
- {dfindexeddb-20241031 → dfindexeddb-20251109}/dfindexeddb/indexeddb/chromium/definitions.py +152 -124
- {dfindexeddb-20241031 → dfindexeddb-20251109}/dfindexeddb/indexeddb/chromium/record.py +536 -348
- {dfindexeddb-20241031 → dfindexeddb-20251109}/dfindexeddb/indexeddb/chromium/v8.py +112 -141
- {dfindexeddb-20241031 → dfindexeddb-20251109}/dfindexeddb/indexeddb/cli.py +125 -114
- {dfindexeddb-20241031 → dfindexeddb-20251109}/dfindexeddb/indexeddb/firefox/definitions.py +7 -4
- {dfindexeddb-20241031 → dfindexeddb-20251109}/dfindexeddb/indexeddb/firefox/gecko.py +103 -79
- {dfindexeddb-20241031 → dfindexeddb-20251109}/dfindexeddb/indexeddb/firefox/record.py +66 -24
- {dfindexeddb-20241031 → dfindexeddb-20251109}/dfindexeddb/indexeddb/safari/definitions.py +12 -10
- {dfindexeddb-20241031 → dfindexeddb-20251109}/dfindexeddb/indexeddb/safari/record.py +68 -51
- {dfindexeddb-20241031 → dfindexeddb-20251109}/dfindexeddb/indexeddb/safari/webkit.py +112 -189
- {dfindexeddb-20241031 → dfindexeddb-20251109}/dfindexeddb/indexeddb/types.py +5 -2
- {dfindexeddb-20241031 → dfindexeddb-20251109}/dfindexeddb/leveldb/cli.py +146 -131
- {dfindexeddb-20241031 → dfindexeddb-20251109}/dfindexeddb/leveldb/definitions.py +6 -2
- {dfindexeddb-20241031 → dfindexeddb-20251109}/dfindexeddb/leveldb/descriptor.py +75 -45
- {dfindexeddb-20241031 → dfindexeddb-20251109}/dfindexeddb/leveldb/ldb.py +39 -30
- {dfindexeddb-20241031 → dfindexeddb-20251109}/dfindexeddb/leveldb/log.py +44 -27
- {dfindexeddb-20241031 → dfindexeddb-20251109}/dfindexeddb/leveldb/plugins/chrome_notifications.py +30 -18
- {dfindexeddb-20241031 → dfindexeddb-20251109}/dfindexeddb/leveldb/plugins/interface.py +5 -6
- {dfindexeddb-20241031 → dfindexeddb-20251109}/dfindexeddb/leveldb/plugins/manager.py +11 -10
- {dfindexeddb-20241031 → dfindexeddb-20251109}/dfindexeddb/leveldb/record.py +71 -62
- {dfindexeddb-20241031 → dfindexeddb-20251109}/dfindexeddb/leveldb/utils.py +21 -13
- {dfindexeddb-20241031 → dfindexeddb-20251109}/dfindexeddb/utils.py +35 -30
- {dfindexeddb-20241031 → dfindexeddb-20251109}/dfindexeddb/version.py +2 -2
- dfindexeddb-20251109/dfindexeddb.egg-info/PKG-INFO +222 -0
- {dfindexeddb-20241031 → dfindexeddb-20251109}/dfindexeddb.egg-info/SOURCES.txt +0 -1
- {dfindexeddb-20241031 → dfindexeddb-20251109}/pyproject.toml +4 -3
- dfindexeddb-20241031/AUTHORS +0 -12
- dfindexeddb-20241031/PKG-INFO +0 -424
- dfindexeddb-20241031/dfindexeddb.egg-info/PKG-INFO +0 -424
- {dfindexeddb-20241031 → dfindexeddb-20251109}/LICENSE +0 -0
- {dfindexeddb-20241031 → dfindexeddb-20251109}/README.md +0 -0
- {dfindexeddb-20241031 → dfindexeddb-20251109}/dfindexeddb/__init__.py +0 -0
- {dfindexeddb-20241031 → dfindexeddb-20251109}/dfindexeddb/errors.py +0 -0
- {dfindexeddb-20241031 → dfindexeddb-20251109}/dfindexeddb/indexeddb/__init__.py +0 -0
- {dfindexeddb-20241031 → dfindexeddb-20251109}/dfindexeddb/indexeddb/chromium/__init__.py +0 -0
- {dfindexeddb-20241031 → dfindexeddb-20251109}/dfindexeddb/indexeddb/firefox/__init__.py +0 -0
- {dfindexeddb-20241031 → dfindexeddb-20251109}/dfindexeddb/indexeddb/safari/__init__.py +0 -0
- {dfindexeddb-20241031 → dfindexeddb-20251109}/dfindexeddb/indexeddb/utils.py +0 -0
- {dfindexeddb-20241031 → dfindexeddb-20251109}/dfindexeddb/leveldb/__init__.py +0 -0
- {dfindexeddb-20241031 → dfindexeddb-20251109}/dfindexeddb/leveldb/plugins/__init__.py +0 -0
- {dfindexeddb-20241031 → dfindexeddb-20251109}/dfindexeddb/leveldb/plugins/notification_database_data_pb2.py +0 -0
- {dfindexeddb-20241031 → dfindexeddb-20251109}/dfindexeddb.egg-info/dependency_links.txt +0 -0
- {dfindexeddb-20241031 → dfindexeddb-20251109}/dfindexeddb.egg-info/entry_points.txt +0 -0
- {dfindexeddb-20241031 → dfindexeddb-20251109}/dfindexeddb.egg-info/requires.txt +0 -0
- {dfindexeddb-20241031 → dfindexeddb-20251109}/dfindexeddb.egg-info/top_level.txt +0 -0
- {dfindexeddb-20241031 → dfindexeddb-20251109}/setup.cfg +0 -0
- {dfindexeddb-20241031 → dfindexeddb-20251109}/setup.py +0 -0
|
@@ -0,0 +1,222 @@
|
|
|
1
|
+
Metadata-Version: 2.4
|
|
2
|
+
Name: dfindexeddb
|
|
3
|
+
Version: 20251109
|
|
4
|
+
Summary: dfindexeddb is an experimental Python tool for performing digital forensic analysis of IndexedDB and leveldb files.
|
|
5
|
+
Author-email: Syd Pleno <sydp@google.com>
|
|
6
|
+
Maintainer-email: dfIndexeddb Developers <dfindexeddb-dev@googlegroups.com>
|
|
7
|
+
License-Expression: Apache-2.0
|
|
8
|
+
Project-URL: Homepage, https://github.com/google/dfindexeddb
|
|
9
|
+
Project-URL: Documentation, https://github.com/google/dfindexeddb/tree/main/docs
|
|
10
|
+
Project-URL: Repository, https://github.com/google/dfindexeddb
|
|
11
|
+
Project-URL: Bug Tracker, https://github.com/google/dfindexeddb/issues
|
|
12
|
+
Classifier: Development Status :: 3 - Alpha
|
|
13
|
+
Classifier: Programming Language :: Python
|
|
14
|
+
Requires-Python: >=3.9
|
|
15
|
+
Description-Content-Type: text/markdown
|
|
16
|
+
License-File: LICENSE
|
|
17
|
+
Requires-Dist: python-snappy==0.6.1
|
|
18
|
+
Requires-Dist: zstd==1.5.5.1
|
|
19
|
+
Provides-Extra: plugins
|
|
20
|
+
Requires-Dist: protobuf; extra == "plugins"
|
|
21
|
+
Requires-Dist: dfdatetime; extra == "plugins"
|
|
22
|
+
Dynamic: license-file
|
|
23
|
+
|
|
24
|
+
# dfIndexeddb
|
|
25
|
+
|
|
26
|
+
dfindexeddb is an experimental Python tool for performing digital forensic
|
|
27
|
+
analysis of IndexedDB and LevelDB files.
|
|
28
|
+
|
|
29
|
+
It parses LevelDB, IndexedDB and JavaScript structures from these files without
|
|
30
|
+
requiring native libraries. (Note: only a subset of IndexedDB key types and
|
|
31
|
+
JavaScript types for Firefox, Safari and Chromium-based browsers are currently supported).
|
|
32
|
+
|
|
33
|
+
The content of IndexedDB files is dependent on what a web application stores
|
|
34
|
+
locally/offline using the web browser's
|
|
35
|
+
[IndexedDB API](https://www.w3.org/TR/IndexedDB/). Examples of content might
|
|
36
|
+
include:
|
|
37
|
+
* text from a text/source-code editor application,
|
|
38
|
+
* emails and contact information from an e-mail application,
|
|
39
|
+
* images and metadata from a photo gallery application
|
|
40
|
+
|
|
41
|
+
|
|
42
|
+
## Installation
|
|
43
|
+
|
|
44
|
+
1. [Linux] Install the snappy compression development package
|
|
45
|
+
|
|
46
|
+
```
|
|
47
|
+
$ sudo apt install libsnappy-dev
|
|
48
|
+
```
|
|
49
|
+
|
|
50
|
+
2. Create a virtual environment and install the package
|
|
51
|
+
|
|
52
|
+
```
|
|
53
|
+
$ python3 -m venv .venv
|
|
54
|
+
$ source .venv/bin/activate
|
|
55
|
+
$ pip install dfindexeddb
|
|
56
|
+
```
|
|
57
|
+
|
|
58
|
+
To also install the dependencies for leveldb/indexeddb plugins, run
|
|
59
|
+
```
|
|
60
|
+
$ pip install 'dfindexeddb[plugins]'
|
|
61
|
+
```
|
|
62
|
+
|
|
63
|
+
|
|
64
|
+
## Installation from source
|
|
65
|
+
|
|
66
|
+
1. [Linux] Install the snappy compression development package
|
|
67
|
+
|
|
68
|
+
```
|
|
69
|
+
$ sudo apt install libsnappy-dev
|
|
70
|
+
```
|
|
71
|
+
|
|
72
|
+
2. Clone or download/unzip the repository to your local machine.
|
|
73
|
+
|
|
74
|
+
3. Create a virtual environment and install the package
|
|
75
|
+
|
|
76
|
+
```
|
|
77
|
+
$ python3 -m venv .venv
|
|
78
|
+
$ source .venv/bin/activate
|
|
79
|
+
$ pip install .
|
|
80
|
+
```
|
|
81
|
+
|
|
82
|
+
To also install the dependencies for leveldb/indexeddb plugins, run
|
|
83
|
+
```
|
|
84
|
+
$ pip install '.[plugins]'
|
|
85
|
+
```
|
|
86
|
+
|
|
87
|
+
## Usage
|
|
88
|
+
|
|
89
|
+
Two CLI tools for parsing IndexedDB/LevelDB files are available after
|
|
90
|
+
installation:
|
|
91
|
+
|
|
92
|
+
|
|
93
|
+
### IndexedDB
|
|
94
|
+
|
|
95
|
+
```
|
|
96
|
+
$ dfindexeddb -h
|
|
97
|
+
usage: dfindexeddb [-h] {db,ldb,log} ...
|
|
98
|
+
|
|
99
|
+
A cli tool for parsing indexeddb files
|
|
100
|
+
|
|
101
|
+
positional arguments:
|
|
102
|
+
{db,ldb,log}
|
|
103
|
+
db Parse a directory as indexeddb.
|
|
104
|
+
ldb Parse a ldb file as indexeddb.
|
|
105
|
+
log Parse a log file as indexeddb.
|
|
106
|
+
|
|
107
|
+
options:
|
|
108
|
+
-h, --help show this help message and exit
|
|
109
|
+
```
|
|
110
|
+
|
|
111
|
+
#### Examples:
|
|
112
|
+
|
|
113
|
+
To parse IndexedDB records from an sqlite file for Firefox and output the
|
|
114
|
+
results as JSON, use the following command:
|
|
115
|
+
|
|
116
|
+
```
|
|
117
|
+
dfindexeddb db -s SOURCE --format firefox -o json
|
|
118
|
+
```
|
|
119
|
+
|
|
120
|
+
To parse IndexedDB records from an sqlite file for Safari and output the
|
|
121
|
+
results as JSON-L, use the following command:
|
|
122
|
+
|
|
123
|
+
```
|
|
124
|
+
dfindexeddb db -s SOURCE --format safari -o jsonl
|
|
125
|
+
```
|
|
126
|
+
|
|
127
|
+
To parse IndexedDB records from a LevelDB folder for Chrome/Chromium, using the
|
|
128
|
+
manifest file to determine recovered records and output as JSON, use the
|
|
129
|
+
following command:
|
|
130
|
+
|
|
131
|
+
```
|
|
132
|
+
dfindexeddb db -s SOURCE --format chrome --use_manifest
|
|
133
|
+
```
|
|
134
|
+
|
|
135
|
+
To parse IndexedDB records from a LevelDB ldb (.ldb) file and output the
|
|
136
|
+
results as JSON-L, use the following command:
|
|
137
|
+
|
|
138
|
+
```
|
|
139
|
+
dfindexeddb ldb -s SOURCE -o jsonl
|
|
140
|
+
```
|
|
141
|
+
|
|
142
|
+
To parse IndexedDB records from a LevelDB log (.log) file and output the
|
|
143
|
+
results as the Python printable representation, use the following command:
|
|
144
|
+
|
|
145
|
+
```
|
|
146
|
+
dfindexeddb log -s SOURCE -o repr
|
|
147
|
+
```
|
|
148
|
+
|
|
149
|
+
To parse a file as a Chrome/Chromium IndexedDB blink value and output the
|
|
150
|
+
results as JSON:
|
|
151
|
+
|
|
152
|
+
```
|
|
153
|
+
dfindexeddb blink -s SOURCE
|
|
154
|
+
```
|
|
155
|
+
|
|
156
|
+
### LevelDB
|
|
157
|
+
|
|
158
|
+
```
|
|
159
|
+
$ dfleveldb -h
|
|
160
|
+
usage: dfleveldb [-h] {db,log,ldb,descriptor} ...
|
|
161
|
+
|
|
162
|
+
A cli tool for parsing leveldb files
|
|
163
|
+
|
|
164
|
+
positional arguments:
|
|
165
|
+
{db,log,ldb,descriptor}
|
|
166
|
+
db Parse a directory as leveldb.
|
|
167
|
+
log Parse a leveldb log file.
|
|
168
|
+
ldb Parse a leveldb table (.ldb) file.
|
|
169
|
+
descriptor Parse a leveldb descriptor (MANIFEST) file.
|
|
170
|
+
|
|
171
|
+
options:
|
|
172
|
+
-h, --help show this help message and exit
|
|
173
|
+
```
|
|
174
|
+
|
|
175
|
+
#### Examples
|
|
176
|
+
|
|
177
|
+
To parse records from a LevelDB folder, use the following command:
|
|
178
|
+
|
|
179
|
+
```
|
|
180
|
+
dfleveldb db -s SOURCE
|
|
181
|
+
```
|
|
182
|
+
|
|
183
|
+
To parse records from a LevelDB folder, and use the sequence number to
|
|
184
|
+
determine recovered records and output as JSON, use the
|
|
185
|
+
following command:
|
|
186
|
+
|
|
187
|
+
```
|
|
188
|
+
dfleveldb db -s SOURCE --use_sequence_number
|
|
189
|
+
```
|
|
190
|
+
|
|
191
|
+
To parse blocks / physical records/ write batches / internal key records from a
|
|
192
|
+
LevelDB log (.log) file, use the following command, specifying the type (block,
|
|
193
|
+
physical_records, etc) via the `-t` option. By default, internal key records are parsed:
|
|
194
|
+
|
|
195
|
+
```
|
|
196
|
+
$ dfleveldb log -s SOURCE [-t {blocks,physical_records,write_batches,parsed_internal_key}]
|
|
197
|
+
```
|
|
198
|
+
|
|
199
|
+
To parse blocks / records from a LevelDB table (.ldb) file, use the following
|
|
200
|
+
command, specifying the type (blocks, records) via the `-t` option. By
|
|
201
|
+
default, records are parsed:
|
|
202
|
+
|
|
203
|
+
```
|
|
204
|
+
$ dfleveldb ldb -s SOURCE [-t {blocks,records}]
|
|
205
|
+
```
|
|
206
|
+
|
|
207
|
+
To parse version edit records from a Descriptor (MANIFEST) file, use the
|
|
208
|
+
following command:
|
|
209
|
+
|
|
210
|
+
```
|
|
211
|
+
$ dfleveldb descriptor -s SOURCE [-o {json,jsonl,repr}] [-t {blocks,physical_records,versionedit} | -v]
|
|
212
|
+
```
|
|
213
|
+
|
|
214
|
+
#### Plugins
|
|
215
|
+
|
|
216
|
+
To apply a plugin parser for a leveldb file/folder, add the
|
|
217
|
+
`--plugin [Plugin Name]` argument. Currently, there is support for the
|
|
218
|
+
following artifacts:
|
|
219
|
+
|
|
220
|
+
| Plugin Name | Artifact Name |
|
|
221
|
+
| -------- | ------- |
|
|
222
|
+
| `ChromeNotificationRecord` | Chrome/Chromium Notifications |
|