webroar 0.3.1 → 0.4.0

data/CHANGELOG

@@ -1,4 +1,51 @@
-V0.3.1 - 22-Mar-2010
+v0.4.0 - 09-Aug-2010
+--------------------
+
+New Features
+~~~~~~~~~~~~
+
+* Supports deflat encoding for static assets.
+* Support for passing environment variables to application.
+* Support to build server with static Ruby library.
+
+Fixes
+~~~~~
+
+* Tested on Ruby 1.9.2 RC2
+* Tested on Ubuntu 10.04.
+* Directory path expanded when application is added from command line. (It
+would allow to pass relative path)
+* Fixed incorrect response code of static assets by using 'timegm' function 
+instead of 'mktime'.
+* Requiring version.rb using relative path, to work with Ruby 1.9.2.
+* Added Config::CONFIG['rubyhdrdir'] in ruby headers search path for Ruby 1.9.
+* Sends '503 Service Unavailable' response, if pending message queue overflows.
+* Code cleanup in Rake tasks.
+* Enhanced SCGI request parsing in Admin Panel to handle chunked request.
+* Added tests for application add, remove and zero down time during restart.
+* Added Config::CONFIG['includedir'] in include directory list.
+* Supports Rails 3 application.
+* Created 'config.yml' file with default configuration if it is not found while
+importing.
+* Added support to start/stop/restart static-worker.
+* Support to view analytics data for all the application, earlier it was only 
+for the application which has analytics enabled.
+* Saving log files after executing load test.
+* Improved rake task to execute test-suite.
+* Set Expires headers from Admin Panel.
+* Server specification code cleanup in Admin Panel.
+* Passing application configuration parameters to worker using SCGI.
+* Email notification for the captured exceptions made configurable.
+* Made many server parameters configurable through config file 
+'server_internal_config.yml'.
+* Sends ERROR control message, if application could not be loaded by worker.
+* Wait for 30 minutes before creating new worker, if three consecutive newly 
+created worker got timed out.
+* Removed 'Cache-Control' response header from static assets. Its incorrect 
+handling chocking IE 6.
+
+
+v0.3.1 - 22-Mar-2010
 --------------------
 
 * Refactored and improved the code for handling restarts of an application.

data/README

@@ -25,14 +25,16 @@ Key Features
 * Provides run time performance data for the deployed applications. 
 * Generates notifications in case any exceptions occur in any of the deployed
  applications.
+* Zero Downtime Application Upgrades.
+* Static assets encoding.
 * SSL support. 
 
 Supported Operating Systems
 ---------------------------
 
-WebROaR has been tested on Ubuntu 8.10/9.04/9.10, Debian 5 (64 Bit), Mac OS X 
-(v10.5 & v10.6), Arch Linux 2009.08 and Cent OS 5.2. Basically, it should be 
-able to run on any *IX OS. 
+WebROaR has been tested on Ubuntu 8.10/9.04/9.10/10.04, Debian 5 (64 Bit),
+Mac OS X (v10.5 & v10.6), Arch Linux 2009.08 and Cent OS 5.2. Basically, it
+should be able to run on any *IX OS.
 
 Currently it does not support Microsoft(R) Windows.
 
@@ -53,17 +55,6 @@ Prerequisites
 - gnutls 2.4.1 or later (Only necessary in case SSL support is required) 
 - gnutls-dev 2.4.1 or later (Only necessary in case SSL support is required) 
 
-[NOTE]
-.Ruby Shared Library
-===============================
-The server needs the shared library - libruby.so to run the ruby web 
-applications.
-
-If you are building ruby from source, please ensure you pass the flag 
-*--enable-shared* while executing its ./configure script.
-
-===============================
-
 Procedure
 ~~~~~~~~~
 
@@ -114,3 +105,9 @@ Configure further SSL options in the server's admin panel
 After restarting the server, admin panel would now also be accessible over SSL.
 *https://<yourservername>:<port>/admin-panel*
 ===============================
+
+Known Issue
+-----------
+
+WebROaR with SSL build crashes on Ubuntu 10.04 upon execution of 
+'gnutls_handshake' by secure connection.

data/Rakefile

@@ -22,6 +22,6 @@ SUDO     = "sudo"
 require 'rubygems'
 require 'rake'
 require 'rake/clean'
-require 'src/ruby_lib/ruby_interface/version'
+require './src/ruby_lib/ruby_interface/version'
 
 Dir['tasks/*.rake'].each { |rake| load rake }

data/conf/mime_type.yml

@@ -1,166 +1,172 @@
-# File extension entry should be in lower case.
-eps: application/postscript
-mpg: video/mpeg
-ppt: application/vnd.ms-powerpoint
-h: text/x-c
-jpeg: image/jpeg
-aif: audio/x-aiff
-m3u: audio/x-mpegurl
-asx: video/x-ms-asf
-xml: application/xml
-3gp: video/3gpp
-csv: text/csv
-rtf: application/rtf
-mov: video/quicktime
-bz2: application/x-bzip2
-dmg: application/octet-stream
-gem: application/octet-stream
-mml: application/mathml+xml
-sh: application/x-sh
-ru: text/x-script.ruby
-rss: application/rss+xml
-iso: application/octet-stream
-pnm: image/x-portable-anymap
-msi: application/x-msdownload
-log: text/plain
-xpm: image/x-xpixmap
-djvu: image/vnd.djvu
-deb: application/x-debian-package
-odp: application/vnd.oasis.opendocument.presentation
-dot: application/msword
-xsl: application/xml
-aiff: audio/x-aiff
-au: audio/basic
-bat: application/x-msdownload
-for: text/x-fortran
-pl: text/x-script.perl
-wma: audio/x-ms-wma
-cab: application/vnd.ms-cab-compressed
-ifb: text/calendar
-pm: text/x-script.perl-module
-class: application/octet-stream
-xbm: image/x-xbitmap
-sgml: text/sgml
-ods: application/vnd.oasis.opendocument.spreadsheet
-text: text/plain
-p: text/x-pascal
-js: application/javascript
-odt: application/vnd.oasis.opendocument.text
-hh: text/x-c
-flv: video/x-flv
-bmp: image/bmp
-wrl: model/vrml
-torrent: application/x-bittorrent
-sgm: text/sgml
-roff: text/troff
-gif: image/gif
-vcf: text/x-vcard
-texinfo: application/x-texinfo
-so: application/octet-stream
-mng: video/x-mng
-ms: text/troff
-dvi: application/x-dvi
-tif: image/tiff
-s: text/x-asm
-json: application/json
-t: text/troff
-svg: image/svg+xml
-cc: text/x-c
-ps: application/postscript
-html: text/html
-tcl: application/x-tcl
-jpg: image/jpeg
-tex: application/x-tex
-tbz: application/x-bzip-compressed-tar
-com: application/x-msdownload
-gz: application/x-gzip
-f90: text/x-fortran
-m4v: video/mp4
-rake: text/x-script.ruby
-pdf: application/pdf
-jar: application/java-archive
-exe: application/x-msdownload
-war: application/java-archive
-snd: audio/basic
-atom: application/atom+xml
-dtd: application/xml-dtd
-mdoc: text/troff
-asc: application/pgp-signature
-djv: image/vnd.djvu
-mid: audio/midi
-rdf: application/rdf+xml
-mathml: application/mathml+xml
-midi: audio/midi
-py: text/x-script.python
-ico: image/vnd.microsoft.icon
-tiff: image/tiff
-ra: audio/x-pn-realaudio
-asf: video/x-ms-asf
-mime: message/rfc822
-wav: audio/x-wav
-vrml: model/vrml
-rb: text/x-script.ruby
-mpeg: video/mpeg
-mp3: audio/mpeg
-diff: text/x-diff
-gemspec: text/x-script.ruby
-yml: text/yaml
-xhtml: application/xhtml+xml
-mp4: video/mp4
-der: application/x-x509-ca-cert
-psd: image/vnd.adobe.photoshop
-svgz: image/svg+xml
-ics: text/calendar
-jnlp: application/x-java-jnlp-file
-ram: audio/x-pn-realaudio
-vcs: text/x-vcalendar
-pgm: image/x-portable-graymap
-crt: application/x-x509-ca-cert
-swf: application/x-shockwave-flash
-avi: video/x-msvideo
-doc: application/msword
-java: text/x-java-source
-pas: text/x-pascal
-tr: text/troff
-asm: text/x-asm
-ear: application/java-archive
-qt: video/quicktime
-pgp: application/pgp-encrypted
-rar: application/x-rar-compressed
-eml: message/rfc822
-wmv: video/x-ms-wmv
-bin: application/octet-stream
-ppm: image/x-portable-pixmap
-wsdl: application/wsdl+xml
-sig: application/pgp-signature
-ai: application/postscript
-a: application/octet-stream
-mp4v: video/mp4
-zip: application/zip
-wmx: video/x-ms-wmx
-tar: application/x-tar
-cpp: text/x-c
-cxx: text/x-c
-htm: text/html
-dll: application/x-msdownload
-pkg: application/octet-stream
-c: text/x-c
-xslt: application/xslt+xml
-xls: application/vnd.ms-excel
-rpm: application/x-redhat-package-manager
-f77: text/x-fortran
-pbm: image/x-portable-bitmap
-yaml: text/yaml
-png: image/png
-conf: text/plain
-me: text/troff
-texi: application/x-texinfo
-man: text/troff
-pem: application/x-x509-ca-cert
-chm: application/vnd.ms-htmlhelp
-ogg: application/ogg
-f: text/x-fortran
-txt: text/plain
-mbox: application/mbox
-pps: application/vnd.ms-powerpoint
-css: text/css
+################################################################################
+#   List of File Extensions and their Content-Type
+################################################################################
+
+# NOTE: File extension entry should be in lower case.
+
+File Extensions:
+  eps: application/postscript
+  mpg: video/mpeg
+  ppt: application/vnd.ms-powerpoint
+  h: text/x-c
+  jpeg: image/jpeg
+  aif: audio/x-aiff
+  m3u: audio/x-mpegurl
+  asx: video/x-ms-asf
+  xml: application/xml
+  3gp: video/3gpp
+  csv: text/csv
+  rtf: application/rtf
+  mov: video/quicktime
+  bz2: application/x-bzip2
+  dmg: application/octet-stream
+  gem: application/octet-stream
+  mml: application/mathml+xml
+  sh: application/x-sh
+  ru: text/x-script.ruby
+  rss: application/rss+xml
+  iso: application/octet-stream
+  pnm: image/x-portable-anymap
+  msi: application/x-msdownload
+  log: text/plain
+  xpm: image/x-xpixmap
+  djvu: image/vnd.djvu
+  deb: application/x-debian-package
+  odp: application/vnd.oasis.opendocument.presentation
+  dot: application/msword
+  xsl: application/xml
+  aiff: audio/x-aiff
+  au: audio/basic
+  bat: application/x-msdownload
+  for: text/x-fortran
+  pl: text/x-script.perl
+  wma: audio/x-ms-wma
+  cab: application/vnd.ms-cab-compressed
+  ifb: text/calendar
+  pm: text/x-script.perl-module
+  class: application/octet-stream
+  xbm: image/x-xbitmap
+  sgml: text/sgml
+  ods: application/vnd.oasis.opendocument.spreadsheet
+  text: text/plain
+  p: text/x-pascal
+  js: application/javascript
+  odt: application/vnd.oasis.opendocument.text
+  hh: text/x-c
+  flv: video/x-flv
+  bmp: image/bmp
+  wrl: model/vrml
+  torrent: application/x-bittorrent
+  sgm: text/sgml
+  roff: text/troff
+  gif: image/gif
+  vcf: text/x-vcard
+  texinfo: application/x-texinfo
+  so: application/octet-stream
+  mng: video/x-mng
+  ms: text/troff
+  dvi: application/x-dvi
+  tif: image/tiff
+  s: text/x-asm
+  json: application/json
+  t: text/troff
+  svg: image/svg+xml
+  cc: text/x-c
+  ps: application/postscript
+  html: text/html
+  tcl: application/x-tcl
+  jpg: image/jpeg
+  tex: application/x-tex
+  tbz: application/x-bzip-compressed-tar
+  com: application/x-msdownload
+  gz: application/x-gzip
+  f90: text/x-fortran
+  m4v: video/mp4
+  rake: text/x-script.ruby
+  pdf: application/pdf
+  jar: application/java-archive
+  exe: application/x-msdownload
+  war: application/java-archive
+  snd: audio/basic
+  atom: application/atom+xml
+  dtd: application/xml-dtd
+  mdoc: text/troff
+  asc: application/pgp-signature
+  djv: image/vnd.djvu
+  mid: audio/midi
+  rdf: application/rdf+xml
+  mathml: application/mathml+xml
+  midi: audio/midi
+  py: text/x-script.python
+  ico: image/vnd.microsoft.icon
+  tiff: image/tiff
+  ra: audio/x-pn-realaudio
+  asf: video/x-ms-asf
+  mime: message/rfc822
+  wav: audio/x-wav
+  vrml: model/vrml
+  rb: text/x-script.ruby
+  mpeg: video/mpeg
+  mp3: audio/mpeg
+  diff: text/x-diff
+  gemspec: text/x-script.ruby
+  yml: text/yaml
+  xhtml: application/xhtml+xml
+  mp4: video/mp4
+  der: application/x-x509-ca-cert
+  psd: image/vnd.adobe.photoshop
+  svgz: image/svg+xml
+  ics: text/calendar
+  jnlp: application/x-java-jnlp-file
+  ram: audio/x-pn-realaudio
+  vcs: text/x-vcalendar
+  pgm: image/x-portable-graymap
+  crt: application/x-x509-ca-cert
+  swf: application/x-shockwave-flash
+  avi: video/x-msvideo
+  doc: application/msword
+  java: text/x-java-source
+  pas: text/x-pascal
+  tr: text/troff
+  asm: text/x-asm
+  ear: application/java-archive
+  qt: video/quicktime
+  pgp: application/pgp-encrypted
+  rar: application/x-rar-compressed
+  eml: message/rfc822
+  wmv: video/x-ms-wmv
+  bin: application/octet-stream
+  ppm: image/x-portable-pixmap
+  wsdl: application/wsdl+xml
+  sig: application/pgp-signature
+  ai: application/postscript
+  a: application/octet-stream
+  mp4v: video/mp4
+  zip: application/zip
+  wmx: video/x-ms-wmx
+  tar: application/x-tar
+  cpp: text/x-c
+  cxx: text/x-c
+  htm: text/html
+  dll: application/x-msdownload
+  pkg: application/octet-stream
+  c: text/x-c
+  xslt: application/xslt+xml
+  xls: application/vnd.ms-excel
+  rpm: application/x-redhat-package-manager
+  f77: text/x-fortran
+  pbm: image/x-portable-bitmap
+  yaml: text/yaml
+  png: image/png
+  conf: text/plain
+  me: text/troff
+  texi: application/x-texinfo
+  man: text/troff
+  pem: application/x-x509-ca-cert
+  chm: application/vnd.ms-htmlhelp
+  ogg: application/ogg
+  f: text/x-fortran
+  txt: text/plain
+  mbox: application/mbox
+  pps: application/vnd.ms-powerpoint
+  css: text/css

data/conf/server_internal_config.yml

@@ -1,16 +1,38 @@
 # Server’s Internal Configuration
 
 starling:
-  host: 127.0.0.1  # host name that runs the starling message queue
-  port: 22122      # port number of the starling message queue
-  profiler_queue_name: profiler_queue  # queue name to read/write profiling data
-  exception_queue_name: exception_queue # queue name to read/write exceptions
-  pid_queue_name: pid_queue # queue to dispatch worker process id
-  max_queue_items: 30000 # Max number of unprocessed messages in queue. One message is approximately 1 Kb
+  host: 127.0.0.1  # Host that runs the starling message queue
+  port: 22122      # Port number of the starling message queue
+  profiler_queue_name: profiler_queue  # Queue to read/write profiling data
+  exception_queue_name: exception_queue # Queue to read/write exceptions
+  pid_queue_name: pid_queue # Queue to dispatch worker process id
+  max_queue_items: 30000 # Maximum number of unprocessed messages in queue. One message is approximately 1 Kb
+
 webroar_analyzer_script:
-  pid_file: /var/run/webroar_analyzer.pid   # pid file path to store pid of analyzer
+  pid_file: /var/run/webroar_analyzer.pid   # File to store pid of analyzer
   daemonize: true # true or false
   log_file: /var/log/webroar/analyzer.log
-  sampling_rate: 1 # sampling time (in mins)
+  sampling_rate: 1 # Sampling time (in mins)
   environment: production # to choose the database specific to environment
 
+## Application Configuration ##
+Application:
+  message_queue_size: 2048  # Queue size of pending requests for each application. Default is 2048
+  maximum_request_ratio: 1  # Ratio of pending requests to active workes to create new worker. Default is 1
+  minimum_request_ratio: 3  # Ratio of pending requests to active workes to destroy free worker. Default is 3
+  high_load_time: 2         # Number of seconds to check high load before creating new worker. Default is 2
+  low_load_time: 600        # Number of seconds to check low load before destroying free worker. Default is 600
+  maximum_hosts: 16         # Maximum number of hosts allowed. Default is 16
+
+## Worker Configuration ##
+Worker:
+  maximum_request_body_size: 65536  # If the request body is larger than this size, use file to read/write request body. Default is 65536
+  maximum_workers: 20               # Maximum number of workers allowed. Default is 20
+  pending_workers: 10               # Maximum number of pending workers. Default is 10
+  add_trials: 3                     # Number of consecutive tries to add worker. Default is 3
+  add_wait: 1800                    # Number of seconds to wait for creating new worker, if all consecutive trials are failed. Default is 1800
+  add_timeout: 25                   # Number of seconds to wait for a response form newly created worker. Default is 25. Set value to 0 to disable add timeout.
+  kill_timeout: 10                  # Number of seconds to wait before killing stucked worker. Default is 10
+  idle_time: 60                     # If worker is unable to process request within this time, send PING signal. Default is 60. Set value to 0 to disable idle timer.
+  ping_timeout: 15                  # Number of seconds to wait for a response of PING signal. Default is 15
+  ping_trials: 2                    # Number of PING signals to identify stuck workers. Default is 2