smart_message 0.0.12 → 0.0.16

data/docs/transports/redis-transport.md

@@ -430,24 +430,6 @@ All subscribers receive all messages:
 # No load balancing between subscribers
 ```
 
-## Migration to Enhanced Transport
-
-When you need advanced routing, consider upgrading to Enhanced Transport:
-
-```ruby
-# From Redis Transport
-SmartMessage.configure do |config|
-  config.default_transport = SmartMessage::Transport::RedisTransport.new
-end
-
-# To Enhanced Transport (with backward compatibility)
-SmartMessage.configure do |config|
-  config.default_transport = SmartMessage::Transport::RedisEnhancedTransport.new
-end
-
-# All existing messages continue to work
-# New messages gain pattern-matching capabilities
-```
 
 ## Examples
 
@@ -503,7 +485,6 @@ For more Redis Transport examples and patterns, also see:
 
 ## Related Documentation
 
-- [Redis Enhanced Transport](redis-enhanced-transport.md) - Advanced routing with patterns
-- [Redis Queue Transport](redis-queue-transport.md) - Persistent queues with load balancing  
-- [Transport Comparison](redis-transport-comparison.md) - Compare all Redis transports
-- [Transport Overview](../reference/transports.md) - All available transports
+- [Transport Overview](../reference/transports.md) - All available transports
+- [Examples & Use Cases](../getting-started/examples.md) - Practical usage patterns
+- [Architecture Overview](../core-concepts/architecture.md) - How SmartMessage works

data/examples/README.md

@@ -40,7 +40,7 @@ cd city_scenario
 **Key Features:**
 - Request-response messaging pattern
 - Error handling and payment validation
-- JSON serialization of complex business objects
+- Automatic serialization of complex business objects by transport
 - Service-to-service communication
 
 **Messages Used:**
@@ -393,7 +393,6 @@ Most examples use `StdoutTransport` with loopback enabled for demonstration purp
 ```ruby
 config do
   transport SmartMessage::Transport::StdoutTransport.new(loopback: true)
-  serializer SmartMessage::Serializer::JSON.new
 end
 ```
 
@@ -406,13 +405,12 @@ config do
     db: 1,
     auto_subscribe: true
   )
-  serializer SmartMessage::Serializer::JSON.new
 end
 ```
 
 **For Production Use:**
 - Use production transports like Redis (see example #4), RabbitMQ, or Kafka
-- Configure appropriate serializers for your data needs
+- Transports handle serialization automatically
 - Add proper error handling and logging
 - Implement monitoring and metrics
 
@@ -547,7 +545,6 @@ class MyCustomMessage < SmartMessage::Base
   
   config do
     transport SmartMessage::Transport::StdoutTransport.new(loopback: true)
-    serializer SmartMessage::Serializer::JSON.new
   end
 end
 ```
@@ -676,9 +673,9 @@ When adapting these examples for production:
    - Implement proper error handling
 
 2. **Serialization:**
-   - Choose appropriate serializers for your data
-   - Consider performance and compatibility requirements
-   - Handle schema evolution
+   - Transports handle serialization automatically
+   - Choose transports based on serialization requirements
+   - Handle schema evolution at the message level
 
 3. **Monitoring:**
    - Add logging and metrics
@@ -699,7 +696,7 @@ When adapting these examples for production:
 
 - [SmartMessage Documentation](../docs/README.md)
 - [Transport Layer Guide](../docs/transports.md)
-- [Serialization Guide](../docs/serializers.md)
+- [Serialization Guide](../docs/serializers.md) (Note: Serialization is now handled by transports)
 - [Architecture Overview](../docs/architecture.md)
 
 ## Questions and Contributions

data/examples/city_scenario/README.md

@@ -372,7 +372,7 @@ All messages include comprehensive headers:
     "publisher_pid": 12345,
     "version": 1,
     "from": "house-sensor-01",
-    "serializer": "SmartMessage::Serializer::Json"
+    "transport": "SmartMessage::Transport::RedisTransport"
   },
   "_sm_payload": {
     "location": "123 Oak Street",

data/examples/city_scenario/messages/emergency_911_message.rb

@@ -10,7 +10,6 @@ module Messages
     description 'Emergency 911 call for reporting fires, crimes, accidents, medical emergencies, or other urgent situations requiring police, fire, or medical response'
 
     transport  SmartMessage::Transport::RedisTransport.new
-    serializer SmartMessage::Serializer::Json.new
 
     VALID_EMERGENCY_TYPES = %w[fire medical crime accident hazmat rescue other]
     VALID_SEVERITY = %w[critical high medium low]

data/examples/city_scenario/messages/emergency_resolved_message.rb

@@ -14,7 +14,6 @@ module Messages
     description 'Emergency incident closure notification message broadcast by emergency services when incidents are successfully resolved, providing completion status, response duration, outcome details, and unit deployment information to all city services for operational awareness and incident tracking'
 
     transport  SmartMessage::Transport::RedisTransport.new
-    serializer SmartMessage::Serializer::Json.new
 
     property :incident_id, required: true,
                            description: 'Unique identifier of the emergency incident that was resolved'

data/examples/city_scenario/messages/fire_dispatch_message.rb

@@ -13,7 +13,6 @@ module Messages
     description 'Emergency fire suppression dispatch coordination message sent by the Fire Department in response to fire emergencies, containing fire engine assignments, specialized equipment deployment, and tactical response information for various fire types, rescue operations, and hazardous material incidents'
 
     transport  SmartMessage::Transport::RedisTransport.new
-    serializer SmartMessage::Serializer::Json.new
 
     property :dispatch_id, required: true,
                            description: 'Unique hexadecimal identifier for this fire department dispatch operation'

data/examples/city_scenario/messages/fire_emergency_message.rb

@@ -13,7 +13,6 @@ module Messages
     description "Critical fire emergency alert message sent by residential monitoring systems to the Fire Department when smoke, heat, or fire is detected, triggering immediate emergency response with fire engine dispatch, specialized equipment deployment, and rescue operations based on fire type, severity, and occupant safety status"
 
     transport SmartMessage::Transport::RedisTransport.new
-    serializer SmartMessage::Serializer::Json.new
 
     VALID_FIRE_TYPES = %w[fire kitchen electrical basement garage wildfire]
     VALID_SEVERITY = %w[small medium large out_of_control]

data/examples/city_scenario/messages/health_check_message.rb

@@ -14,7 +14,6 @@ module Messages
     description "Health monitoring message broadcast by the Health Department every 5 seconds to verify operational status of all city services including police, fire, banks, and residential monitoring systems"
 
     transport SmartMessage::Transport::RedisTransport.new
-    serializer SmartMessage::Serializer::Json.new
 
     property :check_id, required: true,
       description: "Unique identifier for this health check request (UUID format)"

data/examples/city_scenario/messages/health_status_message.rb

@@ -16,7 +16,6 @@ module Messages
     VALID_STATUS = %w[healthy warning critical failed]
 
     transport  SmartMessage::Transport::RedisTransport.new
-    serializer SmartMessage::Serializer::Json.new
 
     property :service_name, required: true,
       description: "Name of the city service reporting its status (e.g., 'police-department', 'fire-department')"

data/examples/city_scenario/messages/police_dispatch_message.rb

@@ -16,7 +16,6 @@ module Messages
     DESC
 
     transport  SmartMessage::Transport::RedisTransport.new
-    serializer SmartMessage::Serializer::Json.new
 
     VALID_PRIORITY = %w[low medium high emergency]
 

data/examples/city_scenario/messages/silent_alarm_message.rb

@@ -17,7 +17,6 @@ module Messages
     DESC
 
     transport  SmartMessage::Transport::RedisTransport.new
-    serializer SmartMessage::Serializer::Json.new
 
     VALID_ALARM_TYPES = %w[robbery vault_breach suspicious_activity]
     VALID_SEVERITY = %w[low medium high critical]

data/examples/file/00_run_all_file_demos.rb

@@ -0,0 +1,260 @@
+#!/usr/bin/env ruby
+# encoding: utf-8
+# frozen_string_literal: true
+
+# Run All File Transport Demos
+# 
+# This script runs all the FileTransport demonstration programs
+# and provides a summary of each demo's capabilities.
+
+require 'fileutils'
+
+puts "🚀 SmartMessage FileTransport Demo Suite"
+puts "=" * 50
+puts
+
+demos = [
+  {
+    file: '01_basic_file_transport_demo.rb',
+    title: 'Basic File Transport Demo',
+    description: 'Core FileTransport functionality including writing, formats, and modes'
+  },
+  {
+    file: '02_fifo_transport_demo.rb', 
+    title: 'FIFO Transport Demo',
+    description: 'Named pipes (FIFO) for real-time inter-process communication'
+  },
+  {
+    file: '03_file_watching_demo.rb',
+    title: 'File Watching Demo', 
+    description: 'Monitoring files for changes and processing new content'
+  },
+  {
+    file: '04_multi_transport_file_demo.rb',
+    title: 'Multi-Transport File Demo',
+    description: 'Advanced patterns with multiple transports and routing'
+  }
+]
+
+def run_demo(demo_file, title)
+  puts "🔧 Running: #{title}"
+  puts "-" * 60
+  
+  start_time = Time.now
+  
+  begin
+    # Run the demo in a separate process to isolate any issues
+    output = `ruby #{demo_file} 2>&1`
+    exit_status = $?.exitstatus
+    
+    end_time = Time.now
+    duration = (end_time - start_time).round(2)
+    
+    if exit_status == 0
+      puts output
+      puts "✅ SUCCESS - Completed in #{duration}s"
+    else
+      puts "❌ FAILED - Exit status: #{exit_status}"
+      puts "Output:"
+      puts output
+    end
+    
+    return exit_status == 0
+    
+  rescue => e
+    puts "❌ ERROR - #{e.message}"
+    return false
+  end
+end
+
+def check_system_requirements
+  puts "🔍 Checking System Requirements"
+  puts "-" * 40
+  
+  requirements = {
+    'Ruby version' => RUBY_VERSION,
+    'Platform' => RUBY_PLATFORM,
+    'SmartMessage available' => File.exist?('../../lib/smart_message.rb')
+  }
+  
+  requirements.each do |req, status|
+    puts "  #{req}: #{status}"
+  end
+  
+  # Check for FIFO support
+  fifo_supported = false
+  begin
+    test_dir = Dir.mktmpdir('fifo_check')
+    test_fifo = File.join(test_dir, 'test.fifo')
+    fifo_supported = system("mkfifo #{test_fifo} 2>/dev/null") && File.exist?(test_fifo)
+    FileUtils.rm_rf(test_dir)
+  rescue
+    fifo_supported = false
+  end
+  
+  puts "  FIFO support: #{fifo_supported ? '✅ Available' : '❌ Not available'}"
+  
+  unless fifo_supported
+    puts "  ⚠️  Note: FIFO demos will be skipped on this system"
+  end
+  
+  puts
+  return fifo_supported
+end
+
+def show_demo_menu(demos)
+  puts "📋 Available Demos:"
+  puts "-" * 20
+  
+  demos.each_with_index do |demo, index|
+    puts "  #{index + 1}. #{demo[:title]}"
+    puts "     #{demo[:description]}"
+    puts
+  end
+  
+  puts "  0. Run all demos"
+  puts "  q. Quit"
+  puts
+end
+
+def get_user_choice(max_choice)
+  loop do
+    print "Enter your choice (0-#{max_choice}, q): "
+    input = gets.chomp.downcase
+    
+    return :quit if input == 'q'
+    return 0 if input == '0'
+    
+    choice = input.to_i
+    if choice >= 1 && choice <= max_choice
+      return choice
+    end
+    
+    puts "Invalid choice. Please try again."
+  end
+end
+
+# Change to the examples/file directory
+script_dir = File.dirname(__FILE__)
+Dir.chdir(script_dir)
+
+# Check system requirements
+fifo_supported = check_system_requirements
+
+# Interactive mode
+if ARGV.empty?
+  loop do
+    show_demo_menu(demos)
+    choice = get_user_choice(demos.length)
+    
+    break if choice == :quit
+    
+    puts
+    
+    if choice == 0
+      # Run all demos
+      puts "🚀 Running All Demos"
+      puts "=" * 30
+      puts
+      
+      success_count = 0
+      total_start = Time.now
+      
+      demos.each_with_index do |demo, index|
+        # Skip FIFO demo if not supported
+        if demo[:file].include?('fifo') && !fifo_supported
+          puts "⏭️  Skipping #{demo[:title]} (FIFO not supported)"
+          puts
+          next
+        end
+        
+        if run_demo(demo[:file], demo[:title])
+          success_count += 1
+        end
+        puts
+      end
+      
+      total_time = (Time.now - total_start).round(2)
+      
+      puts "📊 Summary"
+      puts "=" * 20
+      puts "Successful demos: #{success_count}/#{demos.length}"
+      puts "Total time: #{total_time}s"
+      puts
+      
+    else
+      # Run specific demo
+      demo = demos[choice - 1]
+      
+      # Check if FIFO demo on unsupported system
+      if demo[:file].include?('fifo') && !fifo_supported
+        puts "❌ Cannot run #{demo[:title]} - FIFO not supported on this system"
+        puts
+        next
+      end
+      
+      run_demo(demo[:file], demo[:title])
+      puts
+    end
+  end
+  
+  puts "👋 Thanks for exploring SmartMessage FileTransport!"
+  
+else
+  # Command line mode
+  case ARGV[0]
+  when 'all'
+    puts "🚀 Running All Demos (Non-Interactive Mode)"
+    puts "=" * 45
+    puts
+    
+    success_count = 0
+    
+    demos.each do |demo|
+      # Skip FIFO demo if not supported
+      if demo[:file].include?('fifo') && !fifo_supported
+        puts "⏭️  Skipping #{demo[:title]} (FIFO not supported)"
+        puts
+        next
+      end
+      
+      if run_demo(demo[:file], demo[:title])
+        success_count += 1
+      end
+      puts
+    end
+    
+    puts "📊 Final Summary: #{success_count}/#{demos.length} demos successful"
+    
+  when 'list'
+    puts "📋 Available FileTransport Demos:"
+    demos.each_with_index do |demo, index|
+      puts "  #{index + 1}. #{demo[:file]} - #{demo[:title]}"
+    end
+    
+  when /^\d+$/
+    choice = ARGV[0].to_i
+    if choice >= 1 && choice <= demos.length
+      demo = demos[choice - 1]
+      
+      if demo[:file].include?('fifo') && !fifo_supported
+        puts "❌ Cannot run #{demo[:title]} - FIFO not supported on this system"
+        exit 1
+      end
+      
+      success = run_demo(demo[:file], demo[:title])
+      exit(success ? 0 : 1)
+    else
+      puts "❌ Invalid demo number. Use 'list' to see available demos."
+      exit 1
+    end
+    
+  else
+    puts "Usage:"
+    puts "  #{$0}           # Interactive mode"
+    puts "  #{$0} all       # Run all demos"
+    puts "  #{$0} list      # List available demos"
+    puts "  #{$0} N         # Run demo number N"
+    exit 1
+  end
+end

data/examples/file/01_basic_file_transport_demo.rb

@@ -0,0 +1,237 @@
+#!/usr/bin/env ruby
+# encoding: utf-8
+# frozen_string_literal: true
+
+# Basic File Transport Demo
+#
+# This example demonstrates the core functionality of SmartMessage's FileTransport.
+# It shows how to publish messages to files and read them back.
+
+require_relative '../../lib/smart_message'
+require 'tempfile'
+require 'fileutils'
+
+# Define message classes that will be saved in the messages directory
+Dir.mkdir('messages') unless Dir.exist?('messages')
+
+class LogMessage < SmartMessage::Base
+  property :level, required: true, valid: %w[DEBUG INFO WARN ERROR FATAL]
+  property :message, required: true
+  property :timestamp, default: -> { Time.now.iso8601 }
+  property :component, default: 'system'
+
+  from 'file_transport_demo'
+
+  # Transport will be set dynamically in examples
+end
+
+class UserAction < SmartMessage::Base
+  property :user_id, required: true
+  property :action, required: true
+  property :details, default: {}
+  property :timestamp, default: -> { Time.now.iso8601 }
+
+  from 'file_transport_demo'
+
+  # Transport will be set dynamically in examples
+end
+
+puts "=== SmartMessage FileTransport Basic Demo ==="
+puts
+
+# Create a temporary directory for our demo
+demo_dir = Dir.mktmpdir('file_transport_demo')
+puts "Demo directory: #{demo_dir}"
+
+begin
+  # Example 1: Basic file writing
+  puts "\n1. Basic File Writing"
+  puts "=" * 30
+
+  log_file = File.join(demo_dir, 'application.log')
+
+  # Configure a simple file transport
+  file_transport = SmartMessage::Transport::FileTransport.new(
+    file_path: log_file,
+    format: :json
+  )
+
+  # Configure LogMessage to use the file transport
+  LogMessage.class_eval do
+    transport file_transport
+  end
+
+  # Publish some log messages
+  LogMessage.new(level: 'INFO', message: 'Application started', component: 'main').publish
+  LogMessage.new(level: 'DEBUG', message: 'Loading configuration', component: 'config').publish
+  LogMessage.new(level: 'WARN', message: 'Deprecated feature used', component: 'legacy').publish
+  LogMessage.new(level: 'ERROR', message: 'Database connection failed', component: 'db').publish
+
+  puts "✓ Messages written to: #{log_file}"
+  puts "File contents:"
+  puts File.read(log_file)
+
+  # Example 2: Different output formats
+  puts "\n2. Different Output Formats"
+  puts "=" * 30
+
+  formats = [:json, :yaml, :raw]
+
+  formats.each do |format|
+    format_file = File.join(demo_dir, "messages_#{format}.log")
+
+    format_transport = SmartMessage::Transport::FileTransport.new(
+      file_path: format_file,
+      format: format
+    )
+
+    # Create a temporary message class for this format
+    temp_message = Class.new(SmartMessage::Base) do
+      property :content, required: true
+      property :format_type, required: true
+      from 'file_transport_demo'
+    end
+
+    temp_message.class_eval do
+      transport format_transport
+    end
+
+    temp_message.new(
+      content: "This message is in #{format} format",
+      format_type: format.to_s
+    ).publish
+
+    puts "\n#{format.upcase} format (#{format_file}):"
+    puts File.read(format_file)
+  end
+
+  # Example 3: Append vs Overwrite modes
+  puts "\n3. Append vs Overwrite Modes"
+  puts "=" * 30
+
+  append_file = File.join(demo_dir, 'append_demo.log')
+  overwrite_file = File.join(demo_dir, 'overwrite_demo.log')
+
+  # Append mode (default)
+  append_transport = SmartMessage::Transport::FileTransport.new(
+    file_path: append_file,
+    write_mode: :append,
+    format: :raw
+  )
+
+  # Overwrite mode
+  overwrite_transport = SmartMessage::Transport::FileTransport.new(
+    file_path: overwrite_file,
+    write_mode: :overwrite,
+    format: :raw
+  )
+
+  # Create messages for demonstration
+  3.times do |i|
+    # Append mode - messages accumulate
+    temp_append = Class.new(SmartMessage::Base) do
+      property :content, required: true
+      from 'file_transport_demo'
+    end
+    temp_append.class_eval do
+      transport append_transport
+    end
+    temp_append.new(content: "Append message #{i + 1}").publish
+
+    # Overwrite mode - only the last message remains
+    temp_overwrite = Class.new(SmartMessage::Base) do
+      property :content, required: true
+      from 'file_transport_demo'
+    end
+    temp_overwrite.class_eval do
+      transport overwrite_transport
+    end
+    temp_overwrite.new(content: "Overwrite message #{i + 1}").publish
+  end
+
+  puts "\nAppend mode result (#{append_file}):"
+  puts File.read(append_file)
+
+  puts "\nOverwrite mode result (#{overwrite_file}):"
+  puts File.read(overwrite_file)
+
+  # Example 4: Custom serialization
+  puts "\n4. Custom Serialization"
+  puts "=" * 30
+
+  csv_file = File.join(demo_dir, 'user_actions.csv')
+
+  # Create a CSV-style transport with custom serializer
+  csv_transport = SmartMessage::Transport::FileTransport.new(
+    file_path: csv_file,
+    format: :custom,
+    serializer: ->(message) {
+      # Custom CSV serialization
+      "#{message.timestamp},#{message.user_id},#{message.action},\"#{message.details}\"\n"
+    }
+  )
+
+  UserAction.class_eval do
+    transport csv_transport
+  end
+
+  # Write CSV header manually
+  File.write(csv_file, "timestamp,user_id,action,details\n")
+
+  # Publish user action messages
+  UserAction.new(user_id: '12345', action: 'login', details: {ip: '192.168.1.1'}).publish
+  UserAction.new(user_id: '12345', action: 'view_profile', details: {page: 'settings'}).publish
+  UserAction.new(user_id: '67890', action: 'purchase', details: {item_id: 'ABC123', amount: 29.99}).publish
+  UserAction.new(user_id: '12345', action: 'logout', details: {}).publish
+
+  puts "CSV file contents (#{csv_file}):"
+  puts File.read(csv_file)
+
+  # Example 5: File rotation
+  puts "\n5. File Rotation"
+  puts "=" * 30
+
+  # Note: This demonstrates the concept - actual rotation would require external tools
+  base_file = File.join(demo_dir, 'rotated.log')
+
+  rotation_transport = SmartMessage::Transport::FileTransport.new(
+    file_path: base_file,
+    format: :json
+  )
+
+  temp_rotated = Class.new(SmartMessage::Base) do
+    property :sequence, required: true
+    property :data, required: true
+    from 'file_transport_demo'
+  end
+  temp_rotated.class_eval do
+    transport rotation_transport
+  end
+
+  # Simulate rotation by publishing messages and manually rotating
+  5.times do |i|
+    temp_rotated.new(sequence: i + 1, data: "Message #{i + 1}").publish
+
+    # Simulate rotation after every 2 messages
+    if (i + 1) % 2 == 0
+      rotated_file = "#{base_file}.#{(i + 1) / 2}"
+      FileUtils.mv(base_file, rotated_file) if File.exist?(base_file)
+      puts "✓ Rotated to: #{rotated_file}"
+    end
+  end
+
+  # Show rotated files
+  Dir.glob("#{base_file}*").sort.each do |file|
+    puts "\n#{file}:"
+    puts File.read(file) if File.exist?(file) && File.size(file) > 0
+  end
+
+rescue => e
+  puts "Error: #{e.message}"
+  puts e.backtrace.first(3)
+ensure
+  # Cleanup
+  FileUtils.rm_rf(demo_dir) if Dir.exist?(demo_dir)
+  FileUtils.rm_rf('messages') if Dir.exist?('messages')
+  puts "\n✓ Demo completed and cleaned up"
+end