StatsCollect 0.1.1.20101220 → 0.2.0.20110830

data/ChangeLog

@@ -1,5 +1,103 @@
 = StatsCollect Release History
 
+== 0.2.0.20110830 (Beta)
+
+=== General
+
+* Migrated TODO list to Trackers.
+* Updated copyright information.
+* Migrated source repository to git.
+* Used fileMutex from last rUtilAnts version.
+* Added useful log info.
+* Completed the conf example file.
+* New API: Location plugins can now add a complete list of stats at once.
+* New API: Backends have to be able to return a given stat.
+* When stats are added with a given timestamp, their existence will be checked before add.
+* Added RB location plugin to add stats from a Ruby list defined in a file.
+* Collection plugins can now add stats for a given timestamp.
+* Collection plugins can now add stats for a location different than they.
+* Collection plugins can now ask for the list of known categories, locations and objects.
+* Removed the logging of errors details a second time at the end of logs.
+* Added CSV plugin to collect stats from CSV files.
+* Added a string type value
+* Added a way to recap all encountered errors at the end of the log.
+* Added PID info in logs.
+* Lock file is removed when the process it monitors has disappeared.
+* Added MAP stats value type.
+* Added new error logging: no more needed to parse the whole logs to check for errors presence.
+* Changed API for Backends: Implemented a simplified and more flexible way to specify Stats Orders.
+* Add a configurable delay when re-enqueuing recoverable stats orders.
+* Added a closeSession method to finalize Backend sessions.
+* Bug correction: StatsCollect did not execute due to new rUtilAnts lib.
+* Bug correction: Lock file was not deleted when exception occurred.
+
+=== Backends/MySQL
+
+* Uses MySQL connection and prepared statements pools
+* Implemented a way to store Ruby maps as values in a differential storage (encode differences only).
+* Process only stats orders with past times tamps
+* Adapted to the new API.
+* Now uses prepared queries for performance and security.
+* Bug correction: Stats orders were not read correctly from DB.
+
+=== Backends/Terminal
+
+* Adapted to the new API.
+* Bug correction: Enqueued order was invalid.
+
+=== Locations/Facebook
+
+* Updated to the new URL scheme. Configuration files need to add :URLID attribute.
+* Facebook changed pages code.
+* Changed the way number of friends were retrieved, as Facebook code changed
+* Changed UserAgent as Facebook considered it as mobile
+
+=== Locations/FacebookArtist
+
+* Facebook changed pages code.
+* Changed UserAgent as Facebook considered it as mobile
+
+=== Locations/GoogleGroup
+
+* Added compatibility between Mechanize 1.0.0 and 2.0.1.
+* Updated to Mechanize 2.0.1 API.
+* Added a new Location plugin to parse GoogleGroups.
+
+=== Locations/MySpace
+
+* Corrected MySpace code as it has changed.
+* Changed the way comments are parsed.
+* Added a stat to get complete Friends list with IDs and names.
+* Bug correction: Visits and Friends where not counted correctly when exceeding 1000.
+* Bug correction: Friends lists did not match names on IDs sometimes.
+
+=== Locations/ReverbNation
+
+* Changed way to parse songs and videos plays
+* Changed way to parse integers with thousand separators.
+
+=== Locations/Youtube
+
+* Added compatibility between Mechanize 1.0.0 and 2.0.1.
+* Updated to Mechanize 2.0.1 API.
+* Adapted to new code.
+* Bug correction: Counters were not parsed correctly when greater than 1000.
+
+=== Notifiers/Custom
+
+* Added a customizable notifier
+
+=== Notifiers/LogFile
+
+* Added a log file notifier
+
+== 0.1.1.20101220 (Beta)
+
+* Facebook: Adapted code to new profiles.
+* Youtube: Added Following, Followers, Visits and Friends stats.
+* Added a way to push a new stats order using the API.
+* Bug correction: MySQL: Did not work.
+
 == 0.1.0.20101220 (Beta)
 
 * Initial version

data/LICENSE

@@ -6,7 +6,7 @@ This list is found in the file named AUTHORS.
 The AUTHORS and LICENSE files have to be included in any release of software
 embedding source code of this package, or using it as a derivative software.
 
-Copyright (c) 2009-2010 Muriel Salvan (murielsalvan@users.sourceforge.net)
+Copyright (c) 2010 - 2011 Muriel Salvan (murielsalvan@users.sourceforge.net)
 
 Redistribution and use in source and binary forms, with or without
 modification, are permitted provided that the following conditions are met:

data/ReleaseInfo

@@ -1,8 +1,8 @@
-
-# This file has been generated by RubyPackager during a delivery.
-# More info about RubyPackager: http://rubypackager.sourceforge.net
-{
-  :Version => '0.1.1.20101220',
-  :Tags => [ 'Beta' ],
-  :DevStatus => 'Beta'
-}
+
+# This file has been generated by RubyPackager during a delivery.
+# More info about RubyPackager: http://rubypackager.sourceforge.net
+{
+  :Version => '0.2.0.20110830',
+  :Tags => [ 'Beta' ],
+  :DevStatus => 'Beta'
+}

data/StatsCollect.conf.rb.example

@@ -1,4 +1,7 @@
 {
+  # Delay to apply before retrying recoverable stats orders (number of seconds)
+  :RecoverableErrorsRetryDelay => 300,
+
   # Configuration for Backends
   :Backends => {
     'MySQL' => {
@@ -27,7 +30,16 @@
       # To who the notifications are sent
       :To => 'mail@host.com'
     },
-    'None' => {}
+    'None' => {},
+    'LogFile' => {
+      :FileName => '/log/MyLogFile.log',
+      :Append => true
+    },
+    'Custom' => {
+      :SendCode => Proc.new do |iMessage|
+        puts iMessage
+      end
+    }
   },
 
   # Configuration for Locations
@@ -46,7 +58,8 @@
     },
     'Facebook' => {
       :LoginEMail => 'FacebookLogin',
-      :LoginPassword => '*****'
+      :LoginPassword => '*****',
+      :URLID => 'facebookid'
     },
     'FacebookArtist' => {
       :LoginEMail => 'FacebookLogin',
@@ -66,6 +79,10 @@
         'www.myhost.com'
       ]
     },
+    'Youtube' => {
+      :LoginEMail => 'YoutubeLogin',
+      :LoginPassword => '*****'
+    },
     'FacebookLike' => {
       # List of objects for which we retrieve the Facebook likes
       :Objects => [
@@ -87,5 +104,29 @@
         'GoogleSearchString'
       ]
     },
+    'GoogleGroup' => {
+      :LoginEMail => 'GoogleGroupLogin',
+      :LoginPassword => '*****',
+      :Objects => [
+        'GoogleGroupName'
+      ]
+    },
+    'CSV' => {
+      :ColumnSeparator => ',',
+      :RowSeparator => "\n",
+      :QuoteChar => '"',
+      :DateTimeFormat => '%d/%m/%y %H:%M',
+      :IDsMustExist => false,
+      :Files => [
+        'C:\\Temp\\Stats.csv'
+      ]
+    },
+    'RB' => {
+      :DateTimeFormat => '%Y-%m-%d %H:%M:%S',
+      :IDsMustExist => false,
+      :Files => [
+        'C:\\Temp\\Stats.rb'
+      ]
+    }
   }
 }

data/bin/StatsCollect.rb

@@ -1,6 +1,6 @@
 #!/bin/env ruby
 #--
-# Copyright (c) 2009-2010 Muriel Salvan (murielsalvan@users.sourceforge.net)
+# Copyright (c) 2010 - 2011 Muriel Salvan (murielsalvan@users.sourceforge.net)
 # Licensed under the terms specified in LICENSE file. No warranty is provided.
 #++
 

data/lib/StatsCollect/Backends/MySQL.rb

@@ -1,56 +1,100 @@
 #--
-# Copyright (c) 2009-2010 Muriel Salvan (murielsalvan@users.sourceforge.net)
+# Copyright (c) 2010 - 2011 Muriel Salvan (murielsalvan@users.sourceforge.net)
 # Licensed under the terms specified in LICENSE file. No warranty is provided.
 #++
 
+require 'zlib'
+
+class DateTime
+
+  # Convert this date time to a MySQL time
+  def to_MySQLTime
+    return Mysql::Time.new(
+      self.year,
+      self.month,
+      self.day,
+      self.hour,
+      self.min,
+      self.sec)
+  end
+
+end
+
 module StatsCollect
 
   module Backends
 
     class MySQL
 
+      # Constants used to represent differencial data storage
+      DIFFDATA_KEY = 'K'
+      DIFFDATA_MERGE = 'M'
+      DIFFDATA_DELETE = 'D'
+      DIFFDATA_MODIFY = 'O'
+      DIFFDATA_SAME = 'S'
+      # Number of maximal rows to store data differences before creating a new data key
+      DIFFDATA_MAX_NUMBER_OF_ROWS = 20
+
       # Initialize a session of this backend
       #
       # Parameters:
       # * *iConf* (<em>map<Symbol,Object></em>): Configuration of this backend
       def initSession(iConf)
-        require 'mysql'
-        @MySQLConnection = Mysql.new(iConf[:DBHost], iConf[:DBUser], iConf[:DBPassword], iConf[:DBName])
-        # TODO: Use bound variables everywhere !
+        require 'rUtilAnts/MySQLPool'
+        RUtilAnts::MySQLPool::initializeMySQLPool
+        lError, @MySQLConnection = connectToMySQL(iConf[:DBHost], iConf[:DBName], iConf[:DBUser], iConf[:DBPassword])
+        if (lError != nil)
+          raise lError
+        end
+        @StatementSelectFromStatsOrders = getPreparedStatement(@MySQLConnection, 'SELECT id, timestamp, locations_list, objects_list, categories_list, status FROM stats_orders WHERE (status = 0 OR status = 1) AND timestamp < ? ORDER BY timestamp DESC', :LeaveOpen => true)
+        @StatementDeleteFromStatsOrders = getPreparedStatement(@MySQLConnection, 'DELETE FROM stats_orders WHERE id=?', :LeaveOpen => true)
+        @StatementInsertIntoStatsLocations = getPreparedStatement(@MySQLConnection, 'INSERT INTO stats_locations (name) VALUES (?)', :LeaveOpen => true)
+        @StatementInsertIntoStatsCategories = getPreparedStatement(@MySQLConnection, 'INSERT INTO stats_categories (name, value_type) VALUES (?, ?)', :LeaveOpen => true)
+        @StatementInsertIntoStatsObjects = getPreparedStatement(@MySQLConnection, 'INSERT INTO stats_objects (name) VALUES (?)', :LeaveOpen => true)
+        @StatementInsertIntoStatsValues = getPreparedStatement(@MySQLConnection, 'INSERT INTO stats_values (timestamp, stats_location_id, stats_object_id, stats_category_id, value) VALUES (?, ?, ?, ?, ?)', :LeaveOpen => true)
+        @StatementSelectFromStatsValues = getPreparedStatement(@MySQLConnection, 'SELECT value FROM stats_values WHERE timestamp = ? AND stats_location_id = ? AND stats_object_id = ? AND stats_category_id = ?', :LeaveOpen => true)
+        @StatementInsertIntoStatsBinaryValues = getPreparedStatement(@MySQLConnection, 'INSERT INTO stats_binary_values (timestamp, stats_location_id, stats_object_id, stats_category_id, value) VALUES (?, ?, ?, ?, ?)', :LeaveOpen => true)
+        @StatementInsertIntoStatsOrders = getPreparedStatement(@MySQLConnection, 'INSERT INTO stats_orders (timestamp, locations_list, objects_list, categories_list, status) VALUES (?, ?, ?, ?, ?)', :LeaveOpen => true)
+        @StatementSelectFromStatsLastKeys = getPreparedStatement(@MySQLConnection, 'SELECT stats_value_id FROM stats_last_keys WHERE stats_location_id = ? AND stats_object_id = ? AND stats_category_id = ?', :LeaveOpen => true)
+        @StatementSelectFromStatsBinaryValues = getPreparedStatement(@MySQLConnection, 'SELECT id, value FROM stats_binary_values WHERE stats_location_id = ? AND stats_object_id = ? AND stats_category_id = ? AND id >= ? ORDER BY id', :LeaveOpen => true)
+        @StatementInsertIntoStatsLastKeys = getPreparedStatement(@MySQLConnection, 'INSERT INTO stats_last_keys (stats_location_id, stats_object_id, stats_category_id, stats_value_id) VALUES (?, ?, ?, ?)', :LeaveOpen => true)
+        @StatementUpdateStatsLastKeys = getPreparedStatement(@MySQLConnection, 'UPDATE stats_last_keys SET stats_value_id = ? WHERE stats_location_id = ? AND stats_object_id = ? AND stats_category_id = ?', :LeaveOpen => true)
       end
 
-      # Get the next stats order.
-      # Code to begin a new transaction can be set in this method too.
+      # Get the next stats orders.
       #
-      # Return:
-      # * _DateTime_: The time stamp, or nil if no new stats order
-      # * <em>list<String></em>: List of locations
-      # * <em>list<String></em>: List of objects
-      # * <em>list<String></em>: List of categories
-      # * _Integer_: The order status
-      def getNextStatsOrder
-        rTimeStamp = nil
-        rLstLocations = nil
-        rLstObjects = nil
-        rLstCategories = nil
-        rStatus = nil
-
-        if (defined?(@LstStatsOrders) == nil)
-          @LstStatsOrders = []
-          @MySQLConnection.query('SELECT id, timestamp, objects_list, categories_list, locations_list, status FROM stats_orders WHERE status=0 OR status=1 ORDER BY timestamp DESC').each do |iRow|
-            @LstStatsOrders << iRow.clone
-          end
-        end
-        if (!@LstStatsOrders.empty?)
-          lID, rTimeStamp, lStrLocations, lStrObjects, lStrCategories, rStatus = @LstStatsOrders.pop
-          rLstLocations = lStrLocations.split('|')
-          rLstObjects = lStrObjects.split('|')
-          rLstCategories = lStrCategories.split('|')
-          @MySQLConnection.query('start transaction')
-          @MySQLConnection.query("DELETE FROM stats_orders WHERE id=#{lID}")
+      # Parameters:
+      # * *oStatsOrdersProxy* (_StatsOrdersProxy_): The stats orders proxy to be used to give stats orders
+      def getStatsOrders(oStatsOrdersProxy)
+        @StatementSelectFromStatsOrders.execute(DateTime.now.to_MySQLTime)
+        @StatementSelectFromStatsOrders.each do |iRow|
+          iID, iMySQLTimeStamp, iStrLocations, iStrObjects, iStrCategories, iStatus = iRow
+          oStatsOrdersProxy.addStatsOrder(
+            iID,
+            DateTime.civil(
+              iMySQLTimeStamp.year,
+              iMySQLTimeStamp.month,
+              iMySQLTimeStamp.day,
+              iMySQLTimeStamp.hour,
+              iMySQLTimeStamp.minute,
+              iMySQLTimeStamp.second),
+            iStrLocations.split('|'),
+            iStrObjects.split('|'),
+            iStrCategories.split('|'),
+            iStatus)
         end
+      end
 
-        return rTimeStamp, rLstLocations, rLstObjects, rLstCategories, rStatus
+      # Dequeue the given stat orders IDs.
+      # Code to begin a new transaction can be set in this method too. In this case, the dequeue should be part of the transaction, or it will have to be re-enqueued during rollback method call (otherwise orders will be lost).
+      #
+      # Parameters:
+      # * *iLstStatsOrderIDs* (<em>list<Integer></em>): The list of stats order IDs to dequeue
+      def dequeueStatsOrders(iLstStatsOrderIDs)
+        @MySQLConnection.query('start transaction')
+        iLstStatsOrderIDs.each do |iStatsOrderID|
+          @StatementDeleteFromStatsOrders.execute(iStatsOrderID)
+        end
       end
 
       # Get the list of known locations
@@ -105,9 +149,9 @@ module StatsCollect
       # Return:
       # * _Integer_: Its resulting ID
       def addLocation(iLocation)
-        @MySQLConnection.query("INSERT INTO stats_locations (name) VALUES ('#{@MySQLConnection.escape_string(iLocation)}')")
+        @StatementInsertIntoStatsLocations.execute(iLocation)
 
-        return @MySQLConnection.insert_id
+        return @StatementInsertIntoStatsLocations.insert_id
       end
 
       # Add a new category
@@ -118,9 +162,9 @@ module StatsCollect
       # Return:
       # * _Integer_: Its resulting ID
       def addCategory(iCategory, iValueType)
-        @MySQLConnection.query("INSERT INTO stats_categories (name, value_type) VALUES ('#{@MySQLConnection.escape_string(iCategory)}', #{iValueType})")
+        @StatementInsertIntoStatsCategories.execute(iCategory, iValueType)
 
-        return @MySQLConnection.insert_id
+        return @StatementInsertIntoStatsCategories.insert_id
       end
 
       # Add a new object
@@ -130,9 +174,9 @@ module StatsCollect
       # Return:
       # * _Integer_: Its resulting ID
       def addObject(iObject)
-        @MySQLConnection.query("INSERT INTO stats_objects (name) VALUES ('#{@MySQLConnection.escape_string(iObject)}')")
+        @StatementInsertIntoStatsObjects.execute(iObject)
 
-        return @MySQLConnection.insert_id
+        return @StatementInsertIntoStatsObjects.insert_id
       end
 
       # Add a new stat
@@ -145,6 +189,10 @@ module StatsCollect
       # * *iValue* (_Object_): The value to store
       # * *iValueType* (_Integer_): The value type
       def addStat(iTimeStamp, iLocationID, iObjectID, iCategoryID, iValue, iValueType)
+        # Do we need to store this value ID in the last keys ?
+        lStoreInLastKeys = false
+        lExistingLastKey = false
+        lInsertStatement = @StatementInsertIntoStatsValues
         # Convert the value to its internal representation
         lStrValue = nil
         case iValueType
@@ -156,12 +204,151 @@ module StatsCollect
           lStrValue = iValue.to_s
         when STATS_VALUE_TYPE_UNKNOWN
           lStrValue = iValue.to_s
+        when STATS_VALUE_TYPE_MAP
+          lInsertStatement = @StatementInsertIntoStatsBinaryValues
+          # This is a special case:
+          # We retrieve the last value of this statistic, and decide if we write it completely, or just write a diff.
+          lLastKeyStatsValueID = nil
+          @StatementSelectFromStatsLastKeys.execute(iLocationID, iObjectID, iCategoryID)
+          # Should be only 1 row, or none
+          @StatementSelectFromStatsLastKeys.each do |iRow|
+            lLastKeyStatsValueID = iRow[0]
+          end
+          if (lLastKeyStatsValueID == nil)
+            # First value to store: store a key
+            lStrValue = "#{DIFFDATA_KEY}#{Zlib::Deflate.new.deflate(Marshal.dump(iValue), Zlib::FINISH)}"
+            lStoreInLastKeys = true
+          else
+            # There was already a previous key for this value.
+            lExistingLastKey = true
+            # Reconstruct the value by getting all the stats_values since this key.
+            lExistingValue = nil
+            @StatementSelectFromStatsBinaryValues.execute(iLocationID, iObjectID, iCategoryID, lLastKeyStatsValueID)
+            # If too much rows, we just create a new key
+            lNbrRows = @StatementSelectFromStatsBinaryValues.num_rows
+            if ((lNbrRows == 0) or
+                (lNbrRows >= DIFFDATA_MAX_NUMBER_OF_ROWS))
+              lStrValue = "#{DIFFDATA_KEY}#{Zlib::Deflate.new.deflate(Marshal.dump(iValue), Zlib::FINISH)}"
+              lStoreInLastKeys = true
+            else
+              @StatementSelectFromStatsBinaryValues.each do |iRow|
+                iID, iRowValue = iRow
+                # Read the type of this diff data
+                case iRowValue[0..0]
+                when DIFFDATA_KEY
+                  lExistingValue = Marshal.load(Zlib::Inflate.new.inflate(iRowValue[1..-1]))
+                when DIFFDATA_MERGE
+                  lExistingValue.merge!(Marshal.load(iRowValue[1..-1]))
+                when DIFFDATA_DELETE
+                  lValuesToDelete = Marshal.load(iRowValue[1..-1])
+                  lExistingValue.delete_if do |iKey, iExistingValue|
+                    next (lValuesToDelete.include?(iKey))
+                  end
+                when DIFFDATA_MODIFY
+                  lValuesToDelete, lValuesToModify = Marshal.load(iRowValue[1..-1])
+                  lExistingValue.delete_if do |iKey, iExistingValue|
+                    next (lValuesToDelete.include?(iKey))
+                  end
+                  lExistingValue.merge!(lValuesToModify)
+                when DIFFDATA_SAME
+                  # Nothing to do
+                else
+                  logErr "Unknown diff value type: #{iRowValue[0..0]}"
+                  raise RuntimeError.new("Unknown diff value type: #{iRowValue[0..0]}")
+                end
+              end
+              # Now compute the difference between the existing value and the new one
+              lValuesToDelete = []
+              lValuesToMerge = {}
+              iValue.each do |iKey, iNewValue|
+                if (lExistingValue.has_key?(iKey))
+                  if (iNewValue != lExistingValue[iKey])
+                    # A modified value: add it
+                    lValuesToMerge[iKey] = iNewValue
+                  end
+                else
+                  # A new value: add it
+                  lValuesToMerge[iKey] = iNewValue
+                end
+              end
+              lExistingValue.each do |iKey, iExistingValue|
+                if (!iValue.has_key?(iKey))
+                  # A missing value: delete it
+                  lValuesToDelete << iKey
+                end
+              end
+              if (lValuesToDelete.empty?)
+                if (lValuesToMerge.empty?)
+                  lStrValue = DIFFDATA_SAME
+                else
+                  lStrValue = "#{DIFFDATA_MERGE}#{Marshal.dump(lValuesToMerge)}"
+                end
+              elsif (lValuesToMerge.empty?)
+                lStrValue = "#{DIFFDATA_DELETE}#{Marshal.dump(lValuesToDelete)}"
+              else
+                lStrValue = "#{DIFFDATA_MODIFY}#{Marshal.dump([lValuesToDelete,lValuesToMerge])}"
+              end
+            end
+          end
+        when STATS_VALUE_TYPE_STRING
+          lStrValue = iValue
         else
           logErr "Unknown category value type: #{iValueType}. It will be treated as Unknown."
           lStrValue = iValue.to_s
         end
         # Add the new stat in the DB for real
-        @MySQLConnection.query("INSERT INTO stats_values (timestamp, stats_object_id, stats_category_id, stats_location_id, value) VALUES ('#{iTimeStamp.strftime('%Y-%m-%d %H:%M:%S')}', #{iObjectID}, #{iCategoryID}, #{iLocationID}, '#{lStrValue}')")
+        lInsertStatement.execute(iTimeStamp.to_MySQLTime, iLocationID, iObjectID, iCategoryID, lStrValue)
+        # Store the last key idf needed
+        if (lStoreInLastKeys)
+          lNewStatValueID = lInsertStatement.insert_id
+          if (lExistingLastKey)
+            @StatementUpdateStatsLastKeys.execute(lNewStatValueID, iLocationID, iObjectID, iCategoryID)
+          else
+            @StatementInsertIntoStatsLastKeys.execute(iLocationID, iObjectID, iCategoryID, lNewStatValueID)
+          end
+        end
+      end
+
+      # Get an existing stat value
+      #
+      # Parameters:
+      # * *iTimeStamp* (_DateTime_): The timestamp
+      # * *iLocationID* (_Integer_): The location ID
+      # * *iObjectID* (_Integer_): The object ID
+      # * *iCategoryID* (_Integer_): The category ID
+      # * *iValueType* (_Integer_): The value type
+      # Return:
+      # * _Object_: The corresponding value, or nil if none
+      def getStat(iTimeStamp, iLocationID, iObjectID, iCategoryID, iValueType)
+        rValue = nil
+
+        @StatementSelectFromStatsValues.execute(iTimeStamp.to_MySQLTime, iLocationID, iObjectID, iCategoryID)
+        if (@StatementSelectFromStatsValues.num_rows > 0)
+          @StatementSelectFromStatsValues.each do |iRow|
+            lStrValue = iRow[0]
+            case iValueType
+            when STATS_VALUE_TYPE_INTEGER
+              rValue = Integer(lStrValue)
+            when STATS_VALUE_TYPE_FLOAT
+              rValue = Float(lStrValue)
+            when STATS_VALUE_TYPE_PERCENTAGE
+              rValue = Float(lStrValue)
+            when STATS_VALUE_TYPE_UNKNOWN
+              rValue = lStrValue
+            when STATS_VALUE_TYPE_MAP
+              # TODO
+              rValue = lStrValue
+            when STATS_VALUE_TYPE_STRING
+              rValue = lStrValue
+            else
+              logErr "Unknown category value type: #{iValueType}. It will be treated as Unknown."
+              rValue = lStrValue
+            end
+            break
+          end
+        end
+
+        return rValue
       end
 
       # Add a new stats order
@@ -173,7 +360,14 @@ module StatsCollect
       # * *iLstCategories* (<em>list<String></em>): List of categories
       # * *iStatus* (_Integer_): The order status
       def putNewStatsOrder(iTimeStamp, iLstLocations, iLstObjects, iLstCategories, iStatus)
-        @MySQLConnection.query("INSERT INTO stats_orders (timestamp, locations_list, objects_list, categories_list, status) VALUES ('#{iTimeStamp.strftime('%Y-%m-%d %H:%M:%S')}', '#{@MySQLConnection.escape_string(iLstLocations.join('|'))}', '#{@MySQLConnection.escape_string(iLstObjects.join('|'))}', '#{@MySQLConnection.escape_string(iLstCategories.join('|'))}', #{iStatus})")
+        lMySQLTime = Mysql::Time.new(
+          iTimeStamp.year,
+          iTimeStamp.month,
+          iTimeStamp.day,
+          iTimeStamp.hour,
+          iTimeStamp.min,
+          iTimeStamp.sec)
+        @StatementInsertIntoStatsOrders.execute(lMySQLTime, iLstLocations.join('|'), iLstObjects.join('|'), iLstCategories.join('|'), iStatus)
       end
 
       # Commit the current stats order transaction
@@ -186,6 +380,24 @@ module StatsCollect
         @MySQLConnection.query('rollback')
       end
 
+      # Close a session of this backend
+      def closeSession
+        closePreparedStatement(@MySQLConnection, @StatementSelectFromStatsOrders)
+        closePreparedStatement(@MySQLConnection, @StatementDeleteFromStatsOrders)
+        closePreparedStatement(@MySQLConnection, @StatementInsertIntoStatsLocations)
+        closePreparedStatement(@MySQLConnection, @StatementInsertIntoStatsCategories)
+        closePreparedStatement(@MySQLConnection, @StatementInsertIntoStatsObjects)
+        closePreparedStatement(@MySQLConnection, @StatementInsertIntoStatsValues)
+        closePreparedStatement(@MySQLConnection, @StatementSelectFromStatsValues)
+        closePreparedStatement(@MySQLConnection, @StatementInsertIntoStatsBinaryValues)
+        closePreparedStatement(@MySQLConnection, @StatementInsertIntoStatsOrders)
+        closePreparedStatement(@MySQLConnection, @StatementSelectFromStatsLastKeys)
+        closePreparedStatement(@MySQLConnection, @StatementSelectFromStatsBinaryValues)
+        closePreparedStatement(@MySQLConnection, @StatementInsertIntoStatsLastKeys)
+        closePreparedStatement(@MySQLConnection, @StatementUpdateStatsLastKeys)
+        closeMySQL(@MySQLConnection)
+      end
+
     end
 
   end