solis 0.113.0 → 0.115.0

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: 250f917e5faee6c5f5babc190c2f225defe07b9a32f53908e929b81714b61908
-  data.tar.gz: ed611b0714eada966c6b9e82e1b44aabfbd45563ceead625ad249d5896f7583e
+  metadata.gz: 7c9039f8bba386333b11237b9914c7fdeee57ad8094ea57058815f2fc008d4a7
+  data.tar.gz: ea7269d0380b39c1a88a7d064c503c972194a548441c6c32459ab4ca7187cab8
 SHA512:
-  metadata.gz: 29050d4e0148efb7cc7992d1fbd75902290a6f35c16f528eb35aafe2a3d65cb02657c148c02daefe3123145b22fad24238f8e377fed0e9b5317567e8aabd65d7
-  data.tar.gz: d18917f52c79246927e8235f0ae1eacaf769b361c661294319ad03e09848ad4459dfc0159115a0fc403ace2c7c8efcc79aa48b84ae2a3b26471dd9efa7262c70
+  metadata.gz: 17d2aa3f39b2bee0cb267996467ba8a0fe08d433e3e63c9dbab3df8624cac6ebf45703bc90c606f3c7d90d4c0ab12b72c3794056c11481f008141c456fe27675
+  data.tar.gz: 0e9faa327c21a51aa3413ed0d90c20f781186c360ae4e33c3d2b6432c1e9779e19c100008197b4fbed8969eefecdf2d9d5776cf18ab72872f0dff95ac334160b

data/README.md

@@ -4,7 +4,7 @@ Solis means 'the sun' in Latin or just Silos spelled backwards.
 A simple idea to use SHACL to describe models and API on top of a data store.
 
 # Status
-Although I'm using it in production I must shamefully acknowledge that it actually needs refactoring. Solis is currently still grown organically driven by my needs and understanding of problem domain(RDF, triples, ...).
+Although I'm using it in production I must shamefully acknowledge that it actually needs refactoring. Solis is currently still grown organically driven by my needs and understanding of the problem domain(RDF, triples, ...).
 When my current project is live I'll start to refactor the code and release it as 1.0.
 
 # From Google Sheets to RDF, Shacl, ... to API
@@ -422,6 +422,88 @@ Solis::ConfigFile.path = './'
 solis = Solis::Graph.new(Solis::Shape::Reader::File.read(Solis::ConfigFile[:solis][:shacl]), Solis::ConfigFile[:solis][:env])
 ```
 
+## Performance Optimizations
+
+Entity create/update operations have been optimized to reduce SPARQL round-trips from ~25+ down to ~5-7 for a typical update with embedded entities.
+
+### What changed
+
+| Optimization | Impact |
+|---|---|
+| **Cached `up?` health check** (30s TTL) | Eliminates ~10 redundant ASK queries per operation |
+| **Removed UUID collision check** | Saves 2 round-trips per new entity (UUID v4 collision is ~1 in 2^122) |
+| **Eliminated redundant re-fetches in `update()`** | Saves 1-3 SELECT queries by returning in-memory data |
+| **`known_entities` cache in graph building** | Avoids re-fetching entities from store during `build_ttl_objekt` recursion |
+| **Batched existence checks** (`batch_exists?`) | Replaces N individual ASK queries with 1 SELECT for embedded entities |
+| **Batched orphan reference checks** (`batch_referenced?`) | Replaces N individual ASK queries with 1 SELECT for orphan detection |
+| **SPARQL client reuse** | `save()` passes its client to `update()` when delegating |
+
+## PATCH vs PUT Updates
+
+The `update()` method supports both PUT (full replace) and PATCH (partial merge) semantics via the `patch:` keyword argument.
+
+```ruby
+# PUT (default) — replaces embedded arrays entirely, orphans removed entities
+entity.update({ 'id' => '1', 'students' => [{ 'id' => 's1' }] })
+
+# PATCH — merges into existing arrays, no orphan deletion
+entity.update({ 'id' => '1', 'students' => [{ 'id' => 's3' }] }, true, true, nil, patch: true)
+```
+
+### PUT mode (default, `patch: false`)
+- Embedded entity arrays are **fully replaced** by the provided data
+- Entities removed from the array are detected as orphans and may be deleted
+- Omitted attributes keep their original values
+
+### PATCH mode (`patch: true`)
+- Embedded entity arrays are **merged**: new IDs are added, existing IDs are updated, unmentioned IDs are kept
+- **No orphan detection or deletion** — removing an entity requires an explicit PUT or destroy
+- Omitted embedded attributes are left completely untouched
+
+## Orphan Protection (Embedded Entity Lifecycle)
+
+When updating an entity with PUT semantics and removing a reference to an embedded entity, Solis decides whether to delete the orphaned entity using this decision chain:
+
+| # | Check | Result |
+|---|-------|--------|
+| 1 | Entity in `embedded_readonly`? | **Never delete** (code tables, lookup values) |
+| 2 | Top-level entity + NOT in `embedded_delete`? | **Unlink only** (safe default) |
+| 3 | Top-level entity + in `embedded_delete`? | **Delete** (opt-in cascade) |
+| 4 | Still referenced by other entities? | **Never delete** (safety net) |
+
+A **top-level entity** is one that has its own `sh:NodeShape` + `sh:targetClass` in the SHACL schema — it is independently addressable with its own CRUD endpoint.
+
+### Configuration
+
+```yaml
+:solis:
+  # Code tables / lookup values: never modified, never deleted
+  :embedded_readonly:
+    - :Codetable
+
+  # Child/join entities that should cascade-delete when orphaned
+  :embedded_delete:
+    - :About
+    - :Contributor
+    - :Comment
+    - :Link
+    - :ImageObject
+    - :Identifier
+    - :Provider
+```
+
+### Example
+
+Given an Item with 5 About entities (join between Item and Tag+Role):
+
+```ruby
+# PUT: reduce from 5 Abouts to 1 — the other 4 are deleted (About is in embedded_delete)
+item.update({ 'id' => '1', 'about' => [{ 'id' => 'a1' }] })
+
+# But if Item references a Tag directly, removing it just unlinks — Tag is top-level, not in embedded_delete
+```
+
+Entities like `Tag`, `Agens`, `Person`, `Organization`, `Owner`, `Book` are protected automatically because they are top-level entities not listed in `embedded_delete`.
 
 TODO:
  - extract sparql layer into its own gem

data/lib/solis/model.rb

@@ -1,6 +1,7 @@
 require 'securerandom'
 require 'iso8601'
 require 'hashdiff'
+require 'set'
 require_relative 'query'
 
 module Solis
@@ -22,7 +23,16 @@ module Solis
           end
 
           if self.class.metadata[:attributes][attribute.to_s][:node_kind].is_a?(RDF::URI) && value.is_a?(Hash)
-            inner_model = self.class.graph.shape_as_model(self.class.metadata[:attributes][attribute.to_s][:datatype].to_s)
+            inner_class = self.class.metadata[:attributes][attribute.to_s][:datatype].to_s
+            inner_model = self.class.graph.shape_as_model(inner_class)
+
+            if value.key?('id') && value['id'].match?(self.class.graph_name)
+              inner_class = value['id'].gsub(self.class.graph_name, '').split('/').first.classify.to_s
+              if inner_model.descendants.map(&:to_s).include?(inner_class)
+                inner_model = self.class.graph.shape_as_model(inner_class)
+              end
+            end
+
             value = inner_model.new(value)
           elsif self.class.metadata[:attributes][attribute.to_s][:node_kind].is_a?(RDF::URI) && value.is_a?(Array)
             new_value = []
@@ -141,33 +151,40 @@ values ?s {<#{self.graph_id}>}
 
       if self.exists?(sparql)
         data = properties_to_hash(self)
-        result = update(data)
+        result = update(data, validate_dependencies, top_level, sparql)
       else
         data = properties_to_hash(self)
         attributes = data.include?('attributes') ? data['attributes'] : data
         readonly_list = (Solis::Options.instance.get[:embedded_readonly] || []).map(&:to_s)
 
+        # Collect all embedded entities first for batched existence check
+        all_embedded = []
         attributes.each_pair do |key, value|
           unless self.class.metadata[:attributes][key][:node].nil?
             value = [value] unless value.is_a?(Array)
             value.each do |sub_value|
               embedded = self.class.graph.shape_as_model(self.class.metadata[:attributes][key][:datatype].to_s).new(sub_value)
+              all_embedded << embedded
+            end
+          end
+        end
 
-              if readonly_entity?(embedded, readonly_list)
-                # Readonly entities (code tables) should never be modified
-                # Only verify they exist, do not create or update them
-                unless embedded.exists?(sparql)
-                  Solis::LOGGER.warn("#{embedded.class.name} (id: #{embedded.id}) is readonly but does not exist in database. Skipping.")
-                end
-              else
-                # Non-readonly entities can be created or updated
-                if embedded.exists?(sparql)
-                  embedded_data = properties_to_hash(embedded)
-                  embedded.update(embedded_data, validate_dependencies, false)
-                else
-                  embedded.save(validate_dependencies, false)
-                end
-              end
+        # Batch check existence of all embedded entities in one query
+        existing_ids = self.class.batch_exists?(sparql, all_embedded)
+
+        all_embedded.each do |embedded|
+          entity_exists = existing_ids.include?(embedded.graph_id)
+
+          if readonly_entity?(embedded, readonly_list)
+            unless entity_exists
+              Solis::LOGGER.warn("#{embedded.class.name} (id: #{embedded.id}) is readonly but does not exist in database. Skipping.")
+            end
+          else
+            if entity_exists
+              embedded_data = properties_to_hash(embedded)
+              embedded.update(embedded_data, validate_dependencies, false)
+            else
+              embedded.save(validate_dependencies, false)
             end
           end
         end
@@ -186,14 +203,28 @@ values ?s {<#{self.graph_id}>}
       raise e
     end
 
-    def update(data, validate_dependencies = true, top_level = true)
+    # Update an entity.
+    #
+    # @param data [Hash] the attributes to update. Must include 'id'.
+    # @param validate_dependencies [Boolean] whether to validate dependencies (default: true)
+    # @param top_level [Boolean] whether this is a top-level call (default: true)
+    # @param sparql_client [SPARQL::Client, nil] optional reusable SPARQL client
+    # @param patch [Boolean] when true, uses PATCH semantics:
+    #   - Only provided attributes are changed; omitted attributes are untouched
+    #   - Embedded entity arrays are merged (new IDs added, existing IDs updated,
+    #     missing IDs are kept as-is — not orphaned)
+    #   - No orphan detection or deletion
+    #   When false (default), uses PUT semantics:
+    #   - Embedded entity arrays are fully replaced
+    #   - Entities removed from the array are orphaned and deleted if unreferenced
+    def update(data, validate_dependencies = true, top_level = true, sparql_client = nil, patch: false)
       raise Solis::Error::GeneralError, "I need a SPARQL endpoint" if self.class.sparql_endpoint.nil?
 
       attributes = data.include?('attributes') ? data['attributes'] : data
       raise "id is mandatory when updating" unless attributes.keys.include?('id')
 
       id = attributes.delete('id')
-      sparql = SPARQL::Client.new(self.class.sparql_endpoint)
+      sparql = sparql_client || SPARQL::Client.new(self.class.sparql_endpoint)
 
       original_klass = self.query.filter({ language: self.class.language, filters: { id: [id] } }).find_all.map { |m| m }&.first
       raise Solis::Error::NotFoundError if original_klass.nil?
@@ -202,63 +233,89 @@ values ?s {<#{self.graph_id}>}
       # Cache readonly entities list once
       readonly_list = (Solis::Options.instance.get[:embedded_readonly] || []).map(&:to_s)
 
-      # Track entities to potentially delete
+      # Track entities to potentially delete (only used in PUT mode)
       entities_to_check_for_deletion = {}
 
+      # First pass: collect all embedded entities for batched existence check
+      embedded_by_key = {}
       attributes.each_pair do |key, value|
         unless original_klass.class.metadata[:attributes][key][:node].nil?
           value = [value] unless value.is_a?(Array)
+          embedded_by_key[key] = value.map do |sub_value|
+            self.class.graph.shape_as_model(original_klass.class.metadata[:attributes][key][:datatype].to_s).new(sub_value)
+          end
+        end
+      end
 
-          # Get original embedded entities for this attribute
-          original_embedded = original_klass.instance_variable_get("@#{key}")
-          original_embedded = [original_embedded] unless original_embedded.nil? || original_embedded.is_a?(Array)
-          original_embedded ||= []
+      all_embedded = embedded_by_key.values.flatten
+      existing_ids = self.class.batch_exists?(sparql, all_embedded)
 
-          # Track original IDs
-          original_ids = original_embedded.map { |e| solis_model?(e) ? e.id : nil }.compact
+      # Second pass: process embedded entities using batched results
+      embedded_by_key.each do |key, embedded_list|
+        value = attributes[key]
+        value = [value] unless value.is_a?(Array)
 
-          # Build new array of embedded entities
-          new_embedded_values = []
-          new_ids = []
+        # Get original embedded entities for this attribute
+        original_embedded = original_klass.instance_variable_get("@#{key}")
+        original_embedded = [original_embedded] unless original_embedded.nil? || original_embedded.is_a?(Array)
+        original_embedded ||= []
 
-          value.each do |sub_value|
-            embedded = self.class.graph.shape_as_model(original_klass.class.metadata[:attributes][key][:datatype].to_s).new(sub_value)
-            new_ids << embedded.id if embedded.id
+        # Track original IDs
+        original_ids = original_embedded.map { |e| solis_model?(e) ? e.id : nil }.compact
 
-            if readonly_entity?(embedded, readonly_list)
-              # Readonly entities (code tables) should never be modified
-              # Only verify they exist, do not create or update them
-              if embedded.exists?(sparql)
-                new_embedded_values << embedded
-              else
-                Solis::LOGGER.warn("#{embedded.class.name} (id: #{embedded.id}) is readonly but does not exist in database. Skipping.")
-              end
+        # Build new array of embedded entities
+        new_embedded_values = []
+        new_ids = []
+
+        embedded_list.each do |embedded|
+          new_ids << embedded.id if embedded.id
+          entity_exists = existing_ids.include?(embedded.graph_id)
+
+          if readonly_entity?(embedded, readonly_list)
+            if entity_exists
+              new_embedded_values << embedded
             else
-              # Non-readonly entities can be created or updated
-              if embedded.exists?(sparql)
-                embedded_data = properties_to_hash(embedded)
-                embedded.update(embedded_data, validate_dependencies, false)
-                new_embedded_values << embedded
-              else
-                embedded_value = embedded.save(validate_dependencies, false)
-                new_embedded_values << embedded_value
-              end
+              Solis::LOGGER.warn("#{embedded.class.name} (id: #{embedded.id}) is readonly but does not exist in database. Skipping.")
+            end
+          else
+            if entity_exists
+              embedded_data = properties_to_hash(embedded)
+              embedded.update(embedded_data, validate_dependencies, false)
+              new_embedded_values << embedded
+            else
+              embedded_value = embedded.save(validate_dependencies, false)
+              new_embedded_values << embedded_value
             end
           end
+        end
+
+        if patch
+          # PATCH mode: merge new embedded entities into the original array.
+          # Keep original entities that were not mentioned in the update data.
+          unmentioned = original_embedded.select do |e|
+            solis_model?(e) && !new_ids.include?(e.id)
+          end
+          merged_values = unmentioned + new_embedded_values
+        else
+          # PUT mode: replace the entire array; detect orphans for deletion
+          merged_values = new_embedded_values
 
-          # Identify orphaned entities (in original but not in new)
-          # Note: Readonly entities will be filtered out in delete_orphaned_entities
           orphaned_ids = original_ids - new_ids
           unless orphaned_ids.empty?
             orphaned_entities = original_embedded.select { |e| solis_model?(e) && orphaned_ids.include?(e.id) }
             entities_to_check_for_deletion[key] = orphaned_entities
           end
-
-          # Replace entire array with new values
-          maxcount = original_klass.class.metadata[:attributes][key][:maxcount]
-          value = maxcount && maxcount == 1 ? new_embedded_values.first : new_embedded_values
         end
 
+        maxcount = original_klass.class.metadata[:attributes][key][:maxcount]
+        embedded_value = maxcount && maxcount == 1 ? merged_values.first : merged_values
+        updated_klass.instance_variable_set("@#{key}", embedded_value)
+      end
+
+      # Process non-embedded attributes
+      attributes.each_pair do |key, value|
+        next unless original_klass.class.metadata[:attributes][key][:node].nil?
+
         updated_klass.instance_variable_set("@#{key}", value)
       end
 
@@ -269,9 +326,11 @@ values ?s {<#{self.graph_id}>}
 
       if Hashdiff.best_diff(properties_original_klass, properties_updated_klass).empty?
         Solis::LOGGER.info("#{original_klass.class.name} unchanged, skipping")
-        data = self.query.filter({ filters: { id: [id] } }).find_all.map { |m| m }&.first
+        data = original_klass
       else
-        delete_graph = as_graph(original_klass, false)
+        # Pre-populate known entities to avoid re-fetching during graph building
+        known_entities = { id => original_klass }
+        delete_graph = as_graph(original_klass, false, known_entities)
         where_graph = RDF::Graph.new(graph_name: RDF::URI("#{self.class.graph_name}#{tableized_class_name(self)}/#{id}"), data: RDF::Repository.new)
 
         if id.is_a?(Array)
@@ -282,21 +341,22 @@ values ?s {<#{self.graph_id}>}
           where_graph << [RDF::URI("#{self.class.graph_name}#{tableized_class_name(self)}/#{id}"), :p, :o]
         end
 
-        insert_graph = as_graph(updated_klass, true)
+        insert_graph = as_graph(updated_klass, true, known_entities)
 
         delete_insert_query = SPARQL::Client::Update::DeleteInsert.new(delete_graph, insert_graph, where_graph, graph: insert_graph.name).to_s
         delete_insert_query.gsub!('_:p', '?p')
 
-        data = sparql.query(delete_insert_query)
+        sparql.query(delete_insert_query)
 
+        # Verify the update succeeded by re-fetching; fallback to insert if needed
         data = self.query.filter({ filters: { id: [id] } }).find_all.map { |m| m }&.first
         if data.nil?
           sparql.insert_data(insert_graph, graph: insert_graph.name)
-          data = self.query.filter({ filters: { id: [id] } }).find_all.map { |m| m }&.first
+          data = updated_klass
         end
 
-        # Delete orphaned entities after successful update
-        delete_orphaned_entities(entities_to_check_for_deletion, sparql)
+        # Delete orphaned entities after successful update (PUT mode only)
+        delete_orphaned_entities(entities_to_check_for_deletion, sparql) unless patch
       end
 
       after_update_proc&.call(updated_klass, data)
@@ -324,18 +384,24 @@ values ?s {<#{self.graph_id}>}
       sparql.query("ASK WHERE { <#{self.graph_id}> ?p ?o }")
     end
 
+    # Check existence of multiple entities in a single SPARQL query
+    # Returns a Set of graph_ids that exist
+    def self.batch_exists?(sparql, entities)
+      return Set.new if entities.empty?
+      return Set.new([entities.first.graph_id]) if entities.size == 1 && entities.first.exists?(sparql)
+      return Set.new if entities.size == 1
+
+      values = entities.map { |e| "<#{e.graph_id}>" }.join(' ')
+      query = "SELECT DISTINCT ?s WHERE { VALUES ?s { #{values} } . ?s ?p ?o }"
+      results = sparql.query(query)
+      Set.new(results.map { |r| r[:s].to_s })
+    end
+
     def self.make_id_for(model)
-      raise "I need a SPARQL endpoint" if self.sparql_endpoint.nil?
-      sparql = Solis::Store::Sparql::Client.new(self.sparql_endpoint)
       id = model.instance_variable_get("@id")
       if id.nil? || (id.is_a?(String) && id&.empty?)
-        id_retries = 0
-
-        while id.nil? || sparql.query("ASK WHERE { ?s <#{self.graph_name}id>  \"#{id}\" }")
-          id = SecureRandom.uuid
-          id_retries += 1
-        end
-        LOGGER.info("ID(#{id}) generated for #{self.name} in #{id_retries} retries") if ConfigFile[:debug]
+        id = SecureRandom.uuid
+        LOGGER.info("ID(#{id}) generated for #{self.name}") if ConfigFile[:debug]
         model.instance_variable_set("@id", id)
       elsif id.to_s =~ /^https?:\/\//
         id = id.to_s.split('/').last
@@ -488,6 +554,13 @@ values ?s {<#{self.graph_id}>}
       (entity.class.ancestors.map(&:to_s) & readonly_list).any?
     end
 
+    # Helper method to check if an entity is a top-level entity (has its own shape definition).
+    # Top-level entities are independently addressable and should not be cascade-deleted
+    # when unlinked from a parent, unless explicitly opted in via embedded_delete config.
+    def top_level_entity?(entity)
+      self.class.graph.shape?(entity.class.name)
+    end
+
     # Helper method to get tableized class name
     def tableized_class_name(obj)
       obj.class.name.tableize
@@ -505,50 +578,85 @@ values ?s {<#{self.graph_id}>}
       RDF::URI("#{self.class.graph_name}#{class_name.tableize}/#{id}")
     end
 
-    # Delete orphaned entities that are no longer referenced
+    # Delete orphaned entities that are no longer referenced.
+    #
+    # Decision logic (in order of precedence):
+    # 1. embedded_readonly → never delete (code tables)
+    # 2. Top-level entity (has own shape) + NOT in embedded_delete → unlink only, don't delete
+    # 3. Top-level entity + listed in embedded_delete → delete (opt-in override)
+    # 4. Still referenced by other entities (batch_referenced?) → never delete (safety net)
     def delete_orphaned_entities(entities_to_check, sparql)
       return if entities_to_check.nil? || entities_to_check.empty?
 
       readonly_list = (Solis::Options.instance.get[:embedded_readonly] || []).map(&:to_s)
+      delete_list = (Solis::Options.instance.get[:embedded_delete] || []).map(&:to_s)
 
-      entities_to_check.each do |key, orphaned_entities|
+      # Collect all deletable orphans
+      deletable_orphans = []
+      entities_to_check.each do |_key, orphaned_entities|
         next if orphaned_entities.nil?
-
         orphaned_entities.each do |orphaned_entity|
           next unless solis_model?(orphaned_entity)
 
-          # Skip if it's a readonly entity (like code tables)
+          # 1. Never delete readonly entities (code tables)
           if readonly_entity?(orphaned_entity, readonly_list)
             Solis::LOGGER.info("#{orphaned_entity.class.name} (id: #{orphaned_entity.id}) is in embedded_readonly list. Skipping deletion.")
             next
           end
 
-          # Check if the entity is still referenced elsewhere
-          if orphaned_entity.is_referenced?(sparql)
-            Solis::LOGGER.info("#{orphaned_entity.class.name} (id: #{orphaned_entity.id}) is still referenced elsewhere. Skipping deletion.")
-            next
+          # 2. Top-level entities are never auto-deleted unless opted in via embedded_delete
+          if top_level_entity?(orphaned_entity)
+            explicitly_deletable = (orphaned_entity.class.ancestors.map(&:to_s) & delete_list).any?
+            unless explicitly_deletable
+              Solis::LOGGER.info("#{orphaned_entity.class.name} (id: #{orphaned_entity.id}) is a top-level entity. Skipping deletion (unlink only).")
+              next
+            end
           end
 
-          # Safe to delete the orphan
-          begin
-            Solis::LOGGER.info("Deleting orphaned entity: #{orphaned_entity.class.name} (id: #{orphaned_entity.id})")
-            orphaned_entity.destroy
-          rescue StandardError => e
-            Solis::LOGGER.error("Failed to delete orphaned entity #{orphaned_entity.class.name} (id: #{orphaned_entity.id}): #{e.message}")
-          end
+          deletable_orphans << orphaned_entity
+        end
+      end
+
+      return if deletable_orphans.empty?
+
+      # 4. Safety net: batch check which orphans are still referenced elsewhere
+      referenced_ids = batch_referenced?(sparql, deletable_orphans)
+
+      deletable_orphans.each do |orphaned_entity|
+        if referenced_ids.include?(orphaned_entity.graph_id)
+          Solis::LOGGER.info("#{orphaned_entity.class.name} (id: #{orphaned_entity.id}) is still referenced elsewhere. Skipping deletion.")
+          next
+        end
+
+        begin
+          Solis::LOGGER.info("Deleting orphaned entity: #{orphaned_entity.class.name} (id: #{orphaned_entity.id})")
+          orphaned_entity.destroy
+        rescue StandardError => e
+          Solis::LOGGER.error("Failed to delete orphaned entity #{orphaned_entity.class.name} (id: #{orphaned_entity.id}): #{e.message}")
         end
       end
     end
 
-    def as_graph(klass = self, resolve_all = true)
+    # Batch check which entities are still referenced by other entities
+    # Returns a Set of graph_ids that are referenced
+    def batch_referenced?(sparql, entities)
+      return Set.new if entities.empty?
+
+      values = entities.map { |e| "<#{e.graph_id}>" }.join(' ')
+      query = "SELECT DISTINCT ?o WHERE { VALUES ?o { #{values} } . ?s ?p ?o . FILTER(!CONTAINS(STR(?s), 'audit') && !CONTAINS(STR(?p), 'audit')) }"
+      results = sparql.query(query)
+      Set.new(results.map { |r| r[:o].to_s })
+    end
+
+    def as_graph(klass = self, resolve_all = true, known_entities = {})
       graph = RDF::Graph.new
       graph.name = RDF::URI(self.class.graph_name)
-      id = build_ttl_objekt(graph, klass, [], resolve_all)
+      id = build_ttl_objekt(graph, klass, [], resolve_all, known_entities)
 
       graph
     end
 
-    def build_ttl_objekt(graph, klass, hierarchy = [], resolve_all = true)
+    def build_ttl_objekt(graph, klass, hierarchy = [], resolve_all = true, known_entities = {})
       hierarchy.push("#{klass.class.name}(#{klass.instance_variables.include?(:@id) ? klass.instance_variable_get("@id") : ''})")
 
       graph_name = self.class.graph_name
@@ -559,8 +667,11 @@ values ?s {<#{self.graph_id}>}
 
       graph << [id, RDF::RDFV.type, klass_metadata[:target_class]]
 
-      # load existing object and overwrite
-      original_klass = klass.query.filter({ filters: { id: [uuid] } }).find_all { |f| f.id == uuid }.first || nil
+      # Use cached entity if available, otherwise query the store
+      original_klass = known_entities[uuid]
+      if original_klass.nil?
+        original_klass = klass.query.filter({ filters: { id: [uuid] } }).find_all { |f| f.id == uuid }.first || nil
+      end
 
       if original_klass.nil?
         original_klass = klass
@@ -574,8 +685,11 @@ values ?s {<#{self.graph_id}>}
         end
       end
 
+      # Cache entity for potential reuse in recursive calls
+      known_entities[uuid] = original_klass
+
       begin
-        make_graph(graph, hierarchy, id, original_klass, klass_metadata, resolve_all)
+        make_graph(graph, hierarchy, id, original_klass, klass_metadata, resolve_all, known_entities)
       rescue => e
         Solis::LOGGER.error(e.message)
         raise e
@@ -585,14 +699,19 @@ values ?s {<#{self.graph_id}>}
       id
     end
 
-    def make_graph(graph, hierarchy, id, klass, klass_metadata, resolve_all)
+    def make_graph(graph, hierarchy, id, klass, klass_metadata, resolve_all, known_entities = {})
       klass_metadata[:attributes].each do |attribute, metadata|
         data = klass.instance_variable_get("@#{attribute}")
 
         if data.nil? && metadata.key?(:mincount) && (metadata[:mincount].nil? || metadata[:mincount] > 0) && graph.query(RDF::Query.new({ attribute.to_sym => { RDF.type => metadata[:node] } })).size == 0
           if data.nil?
             uuid = id.value.split('/').last
-            original_klass = klass.query.filter({ filters: { id: [uuid] } }).find_all { |f| f.id == uuid }.first || nil
+            # Use cached entity if available
+            original_klass = known_entities[uuid]
+            if original_klass.nil?
+              original_klass = klass.query.filter({ filters: { id: [uuid] } }).find_all { |f| f.id == uuid }.first || nil
+              known_entities[uuid] = original_klass if original_klass
+            end
             unless original_klass.nil?
               klass = original_klass
               data = klass.instance_variable_get("@#{attribute}")
@@ -633,10 +752,10 @@ values ?s {<#{self.graph_id}>}
             if self.class.graph.shape_as_model(d.class.name).metadata[:attributes].select { |_, v| v[:node_kind].is_a?(RDF::URI) }.size > 0 &&
               hierarchy.select { |s| s =~ /^#{d.class.name}/ }.size == 0
               internal_resolve = false
-              d = build_ttl_objekt(graph, d, hierarchy, internal_resolve)
+              d = build_ttl_objekt(graph, d, hierarchy, internal_resolve, known_entities)
             elsif self.class.graph.shape_as_model(d.class.name) && hierarchy.select { |s| s =~ /^#{d.class.name}/ }.size == 0
               internal_resolve = false
-              d = build_ttl_objekt(graph, d, hierarchy, internal_resolve)
+              d = build_ttl_objekt(graph, d, hierarchy, internal_resolve, known_entities)
             else
               d = "#{klass.class.graph_name}#{d.class.name.tableize}/#{d.id}"
             end
@@ -755,21 +874,21 @@ values ?s {<#{self.graph_id}>}
             model_instance = model.new(d) if model_instance.nil?
 
             if resolve_all
-              d = build_ttl_objekt(graph, model_instance, hierarchy, false)
+              d = build_ttl_objekt(graph, model_instance, hierarchy, false, known_entities)
             else
-              real_model = model_instance.query.filter({ filters: { id: model_instance.id } }).find_all { |f| f.id == model_instance.id }&.first
+              real_model = known_entities[model_instance.id] || model_instance.query.filter({ filters: { id: model_instance.id } }).find_all { |f| f.id == model_instance.id }&.first
               d = RDF::URI("#{self.class.graph_name}#{real_model ? real_model.class.name.tableize : model_instance.class.name.tableize}/#{model_instance.id}")
             end
           elsif model && d.is_a?(model)
             if resolve_all
               if parent_model
                 model_instance = parent_model.new({ id: d.id })
-                d = build_ttl_objekt(graph, model_instance, hierarchy, false)
+                d = build_ttl_objekt(graph, model_instance, hierarchy, false, known_entities)
               else
-                d = build_ttl_objekt(graph, d, hierarchy, false)
+                d = build_ttl_objekt(graph, d, hierarchy, false, known_entities)
               end
             else
-              real_model = model.new.query.filter({ filters: { id: d.id } }).find_all { |f| f.id == d.id }&.first
+              real_model = known_entities[d.id] || model.new.query.filter({ filters: { id: d.id } }).find_all { |f| f.id == d.id }&.first
               d = RDF::URI("#{self.class.graph_name}#{real_model ? real_model.class.name.tableize : model.name.tableize}/#{d.id}")
             end
           else

data/lib/solis/query/filter.rb

@@ -89,6 +89,9 @@ module Solis
                 v=normalize_string(v)
                 filter = "filter( !exists {?concept <#{@model.class.graph_name}id> \"#{v}\"})"
               end
+            elsif ['>', '<', '>=', '<='].include?(value[:operator])
+              v = normalize_string(value[:value].first)
+              filter = "?concept <#{@model.class.graph_name}id> ?__search FILTER (?__search #{value[:operator]} \"#{v}\") .\n"
             else
               filter = "?concept <#{@model.class.graph_name}id> ?__search FILTER (?__search IN(#{contains})) .\n"
             end

data/lib/solis/sparql_adaptor.rb

@@ -44,10 +44,10 @@ module Solis
         big_decimal: [:eq, :not_eq, :gt, :lt],
         date: [:eq, :not_eq, :gt, :gte, :lt, :lte],
         boolean: [:eq, :not_eq],
-        uuid: [:eq, :not_eq],
+        uuid: [:eq, :not_eq, :gt, :lt],
         enum: [:eq],
         datetime: [:eq, :not_eq, :gt, :lt],
-        anyuri: [:eq, :not_eq],
+        anyuri: [:eq, :not_eq, :gt, :lt],
       }
     end
 
@@ -106,6 +106,7 @@ module Solis
     alias :filter_uuid_gt :filter_gt
     alias :filter_enum_gt :filter_gt
     alias :filter_datetime_gt :filter_gt
+    alias :filter_anyuri_gt :filter_gt
 
     def filter_not_gt(scope, attribute, value)
       filter_eq(scope, attribute, value, true, '>')
@@ -134,6 +135,7 @@ module Solis
     alias :filter_uuid_lt :filter_lt
     alias :filter_enum_lt :filter_lt
     alias :filter_datetime_lt :filter_lt
+    alias :filter_anyuri_lt :filter_lt
 
     def filter_not_lt(scope, attribute, value)
       filter_eq(scope, attribute, value, true, '<')

data/lib/solis/store/sparql/client.rb

@@ -27,12 +27,18 @@ module Solis
         end
 
         def up?
-          result = nil
+          now = Process.clock_gettime(Process::CLOCK_MONOTONIC)
+          if @up_checked_at && (now - @up_checked_at) < 30
+            return @up_result
+          end
+          @up_result = nil
           @pool.with do |c|
-            result = c.query("ASK WHERE { ?s ?p ?o }")
+            @up_result = c.query("ASK WHERE { ?s ?p ?o }")
           end
-          result
+          @up_checked_at = now
+          @up_result
         rescue HTTP::Error => e
+          @up_checked_at = nil
           return false
         end
 

data/lib/solis/version.rb

@@ -1,3 +1,3 @@
 module Solis
-  VERSION = "0.113.0"
+  VERSION = "0.115.0"
 end

data/solis.gemspec

@@ -28,7 +28,7 @@ Gem::Specification.new do |spec|
   spec.require_paths = ['lib']
 
   spec.add_runtime_dependency 'activesupport', '~> 8.0'
-  spec.add_runtime_dependency 'http', '~> 5.2'
+  spec.add_runtime_dependency 'http', '~> 5.3'
   spec.add_runtime_dependency 'graphiti', '~> 1.8'
   spec.add_runtime_dependency 'moneta', '~> 1.6'
   spec.add_runtime_dependency 'linkeddata', '~> 3.3'

metadata

@@ -1,7 +1,7 @@
 --- !ruby/object:Gem::Specification
 name: solis
 version: !ruby/object:Gem::Version
-  version: 0.113.0
+  version: 0.115.0
 platform: ruby
 authors:
 - Mehmet Celik
@@ -29,14 +29,14 @@ dependencies:
     requirements:
     - - "~>"
       - !ruby/object:Gem::Version
-        version: '5.2'
+        version: '5.3'
   type: :runtime
   prerelease: false
   version_requirements: !ruby/object:Gem::Requirement
     requirements:
     - - "~>"
       - !ruby/object:Gem::Version
-        version: '5.2'
+        version: '5.3'
 - !ruby/object:Gem::Dependency
   name: graphiti
   requirement: !ruby/object:Gem::Requirement