@twin.org/entity-storage-connector-memory 0.0.3-next.8 → 0.9.0-next.1

package/docs/reference/classes/MemoryEntityStorageConnector.md

@@ -1,6 +1,14 @@
 # Class: MemoryEntityStorageConnector\<T\>
 
-Class for performing entity storage operations in-memory.
+Class for performing entity storage operations in-memory backed by a shared object buffer.
+
+All reads and writes are serialised with a per-schema lock so that concurrent async
+access, including across worker threads, never produces torn or lost updates.
+
+All connector instances that share the same entity schema name share the same underlying
+buffer, making data written in one instance immediately visible in another, including
+across worker threads when the main thread forwards worker messages to the lock and
+buffer handlers.
 
 ## Type Parameters
 
@@ -11,6 +19,7 @@ Class for performing entity storage operations in-memory.
 ## Implements
 
 - `IEntityStorageConnector`\<`T`\>
+- `IEntityStorageMigrationConnector`\<`T`\>
 
 ## Constructors
 
@@ -60,6 +69,24 @@ The class name of the component.
 
 ***
 
+### health() {#health}
+
+> **health**(): `Promise`\<`IHealth`[]\>
+
+Returns the health status of the component.
+
+#### Returns
+
+`Promise`\<`IHealth`[]\>
+
+The health status of the component.
+
+#### Implementation of
+
+`IEntityStorageConnector.health`
+
+***
+
 ### getSchema() {#getschema}
 
 > **getSchema**(): `IEntitySchema`
@@ -78,6 +105,32 @@ The schema for the entities.
 
 ***
 
+### bootstrap() {#bootstrap}
+
+> **bootstrap**(`nodeLoggingComponentType?`): `Promise`\<`boolean`\>
+
+Bootstrap the component by creating and initializing any resources it needs.
+
+#### Parameters
+
+##### nodeLoggingComponentType?
+
+`string`
+
+The node logging component type.
+
+#### Returns
+
+`Promise`\<`boolean`\>
+
+True if the bootstrapping process was successful.
+
+#### Implementation of
+
+`IEntityStorageConnector.bootstrap`
+
+***
+
 ### get() {#get}
 
 > **get**(`id`, `secondaryIndex?`, `conditions?`): `Promise`\<`T` \| `undefined`\>
@@ -140,7 +193,7 @@ The optional conditions to match for the entities.
 
 `Promise`\<`void`\>
 
-The id of the entity.
+Resolves when the entity has been stored.
 
 #### Implementation of
 
@@ -148,6 +201,32 @@ The id of the entity.
 
 ***
 
+### setBatch() {#setbatch}
+
+> **setBatch**(`entities`): `Promise`\<`void`\>
+
+Set multiple entities in a batch.
+
+#### Parameters
+
+##### entities
+
+`T`[]
+
+The entities to set.
+
+#### Returns
+
+`Promise`\<`void`\>
+
+Nothing.
+
+#### Implementation of
+
+`IEntityStorageConnector.setBatch`
+
+***
+
 ### remove() {#remove}
 
 > **remove**(`id`, `conditions?`): `Promise`\<`void`\>
@@ -231,14 +310,248 @@ and a cursor which can be used to request more entities.
 
 ***
 
+### empty() {#empty}
+
+> **empty**(): `Promise`\<`void`\>
+
+Remove all entities from the storage.
+
+#### Returns
+
+`Promise`\<`void`\>
+
+Nothing.
+
+#### Implementation of
+
+`IEntityStorageConnector.empty`
+
+***
+
+### removeBatch() {#removebatch}
+
+> **removeBatch**(`ids`): `Promise`\<`void`\>
+
+Remove multiple entities by id.
+
+#### Parameters
+
+##### ids
+
+`string`[]
+
+The ids of the entities to remove.
+
+#### Returns
+
+`Promise`\<`void`\>
+
+Nothing.
+
+#### Implementation of
+
+`IEntityStorageConnector.removeBatch`
+
+***
+
+### teardown() {#teardown}
+
+> **teardown**(`nodeLoggingComponentType?`): `Promise`\<`boolean`\>
+
+Teardown the storage by clearing the underlying shared buffer for this schema.
+
+#### Parameters
+
+##### nodeLoggingComponentType?
+
+`string`
+
+The node logging component type.
+
+#### Returns
+
+`Promise`\<`boolean`\>
+
+True if the teardown process was successful.
+
+#### Implementation of
+
+`IEntityStorageConnector.teardown`
+
+***
+
+### count() {#count}
+
+> **count**(`conditions?`): `Promise`\<`number`\>
+
+Count all the entities which match the conditions.
+
+#### Parameters
+
+##### conditions?
+
+`EntityCondition`\<`T`\>
+
+The optional conditions to match for the entities.
+
+#### Returns
+
+`Promise`\<`number`\>
+
+The total count of entities in the storage.
+
+#### Implementation of
+
+`IEntityStorageConnector.count`
+
+***
+
 ### getStore() {#getstore}
 
-> **getStore**(): `T`[]
+> **getStore**(): `Promise`\<`T`[]\>
 
-Get the memory store.
+Get all entities in the memory store.
 
 #### Returns
 
-`T`[]
+`Promise`\<`T`[]\>
+
+All stored entities with partition keys removed.
+
+***
+
+### getPartitionContextIds() {#getpartitioncontextids}
+
+> **getPartitionContextIds**(): `Promise`\<`IContextIds`[]\>
+
+Get a unique list of all the context ids from the storage.
+
+#### Returns
+
+`Promise`\<`IContextIds`[]\>
+
+The list of unique context ids.
+
+#### Implementation of
+
+`IEntityStorageMigrationConnector.getPartitionContextIds`
+
+***
+
+### createTargetConnector() {#createtargetconnector}
+
+> **createTargetConnector**\<`U`\>(`newEntitySchema`): `Promise`\<`IEntityStorageConnector`\<`U`\>\>
+
+Create the target connector for performing the migration it will use a temporary storage location.
+
+#### Type Parameters
+
+##### U
+
+`U`
+
+#### Parameters
+
+##### newEntitySchema
+
+`string`
+
+The name of the new entity schema to create the connector for.
+
+#### Returns
+
+`Promise`\<`IEntityStorageConnector`\<`U`\>\>
+
+Connector for performing the migration.
+
+#### Implementation of
+
+`IEntityStorageMigrationConnector.createTargetConnector`
+
+***
+
+### finalizeMigration() {#finalizemigration}
+
+> **finalizeMigration**\<`U`\>(`targetConnector`, `options?`, `loggingComponentType?`): `Promise`\<`IEntityStorageConnector`\<`U`\>\>
+
+Finalize the migration by tearing down the old connector and replacing it with the target connector.
+
+#### Type Parameters
+
+##### U
+
+`U`
+
+#### Parameters
+
+##### targetConnector
+
+`IEntityStorageConnector`\<`U`\>
+
+The target connector to finalize the migration with.
+
+##### options?
+
+`IMigrationOptions`
+
+The options to control how the migration is finalized.
+
+##### loggingComponentType?
+
+`string`
+
+The optional component type to use for logging the migration progress.
+
+#### Returns
+
+`Promise`\<`IEntityStorageConnector`\<`U`\>\>
+
+A promise that resolves when the migration is finalized.
+
+#### Implementation of
+
+`IEntityStorageMigrationConnector.finalizeMigration`
+
+***
+
+### cleanupMigration() {#cleanupmigration}
+
+> **cleanupMigration**\<`U`\>(`targetConnector`, `options?`, `loggingComponentType?`): `Promise`\<`void`\>
+
+Cleanup the migration if a migration fails or needs to be aborted.
+
+#### Type Parameters
+
+##### U
+
+`U`
+
+#### Parameters
+
+##### targetConnector
+
+`IEntityStorageConnector`\<`U`\> \| `undefined`
+
+The target connector to cleanup the migration with.
+
+##### options?
+
+`IMigrationOptions`
+
+The options to control how the migration is cleaned up.
+
+##### loggingComponentType?
+
+`string`
+
+The optional component type to use for logging the migration progress.
+
+#### Returns
+
+`Promise`\<`void`\>
+
+A promise that resolves when the migration is cleaned up.
+
+#### Implementation of
 
-The store.
+`IEntityStorageMigrationConnector.cleanupMigration`

package/docs/reference/index.md

@@ -6,4 +6,5 @@
 
 ## Interfaces
 
+- [IMemoryEntityStorageConnectorConfig](interfaces/IMemoryEntityStorageConnectorConfig.md)
 - [IMemoryEntityStorageConnectorConstructorOptions](interfaces/IMemoryEntityStorageConnectorConstructorOptions.md)

package/docs/reference/interfaces/IMemoryEntityStorageConnectorConfig.md

@@ -0,0 +1,48 @@
+# Interface: IMemoryEntityStorageConnectorConfig
+
+Configuration for the Memory Entity Storage Connector.
+
+## Properties
+
+### storageKey {#storagekey}
+
+> **storageKey**: `string`
+
+Key to use for the shared buffer instead of the entity schema type.
+Use this to give two connectors with the same entitySchema separate storage.
+
+***
+
+### initialCapacityBytes? {#initialcapacitybytes}
+
+> `optional` **initialCapacityBytes?**: `number`
+
+Initial capacity in bytes for the shared entity buffer.
+
+#### Default
+
+```ts
+16 MiB.
+```
+
+***
+
+### maxCapacityBytes? {#maxcapacitybytes}
+
+> `optional` **maxCapacityBytes?**: `number`
+
+Maximum JSON payload size in bytes for the shared entity buffer.
+
+#### Default
+
+```ts
+256 MiB.
+```
+
+***
+
+### mutexTimeoutMs? {#mutextimeoutms}
+
+> `optional` **mutexTimeoutMs?**: `number`
+
+Maximum milliseconds to wait for the per-directory write lock before throwing.

package/docs/reference/interfaces/IMemoryEntityStorageConnectorConstructorOptions.md

@@ -17,3 +17,11 @@ The schema for the entity.
 > `optional` **partitionContextIds?**: `string`[]
 
 The keys to use from the context ids to create partitions.
+
+***
+
+### config {#config}
+
+> **config**: [`IMemoryEntityStorageConnectorConfig`](IMemoryEntityStorageConnectorConfig.md)
+
+Configuration for storage key and capacity settings.

package/locales/en.json

@@ -1 +1,13 @@
-{}
+{
+	"info": {
+		"memoryEntityStorageConnector": {
+			"storeTearingDown": "Tearing down entity storage",
+			"storeTornDown": "Entity storage torn down"
+		}
+	},
+	"health": {
+		"memoryEntityStorageConnector": {
+			"healthDescription": "Memory entity storage for \"{entityType}\" is always available"
+		}
+	}
+}

package/package.json

@@ -1,10 +1,10 @@
 {
 	"name": "@twin.org/entity-storage-connector-memory",
-	"version": "0.0.3-next.8",
+	"version": "0.9.0-next.1",
 	"description": "In-memory connector for local development, testing and short-lived workloads.",
 	"repository": {
 		"type": "git",
-		"url": "git+https://github.com/twinfoundation/entity-storage.git",
+		"url": "git+https://github.com/iotaledger/twin-entity-storage.git",
 		"directory": "packages/entity-storage-connector-memory"
 	},
 	"author": "martyn.janes@iota.org",
@@ -14,11 +14,12 @@
 		"node": ">=20.0.0"
 	},
 	"dependencies": {
-		"@twin.org/context": "next",
-		"@twin.org/core": "next",
-		"@twin.org/entity": "next",
-		"@twin.org/entity-storage-models": "0.0.3-next.8",
-		"@twin.org/nameof": "next"
+		"@twin.org/context": "0.9.0-next.1",
+		"@twin.org/core": "0.9.0-next.1",
+		"@twin.org/entity": "0.9.0-next.1",
+		"@twin.org/entity-storage-models": "0.9.0-next.1",
+		"@twin.org/logging-models": "0.9.0-next.1",
+		"@twin.org/nameof": "0.9.0-next.1"
 	},
 	"main": "./dist/es/index.js",
 	"types": "./dist/types/index.d.ts",
@@ -55,7 +56,7 @@
 		"testing"
 	],
 	"bugs": {
-		"url": "git+https://github.com/twinfoundation/entity-storage/issues"
+		"url": "git+https://github.com/iotaledger/twin-entity-storage/issues"
 	},
 	"homepage": "https://twindev.org"
 }