sm-transcript 0.0.3 → 0.0.4

data/README.txt

@@ -1,4 +1,4 @@
-$Id: README.txt 187 2010-03-22 19:32:07Z pwilkins $
+$Id: README.txt 194 2010-03-28 00:09:23Z pwilkins $
 
 sm-transcript reads results of SLS processing and produces transcripts for
 the SpokenMedia browser.  For each file in the source folder whose extension 
@@ -17,13 +17,13 @@ Installation:
 	You can get sm-transcript as either a RubyGem or as source from svn.
 	
 	The preferred way to install this package is as a Rubygem.  You can 
-	download the gem from this page:
+	download and install the gem with this command:  
 	
-	http://TBD
+	sudo gem install [--verbose] sm-transcript
 	
-	and install it with this command:  
-	
-	sudo gem install [--verbose]  <path to gem file>sm-transcript-n.n.n.gem
+	This command downloads the most recent version of the gem from rubygems.org
+	and makes it active.  Previous versions of the gem remain installed, but 
+	are deactivated.
 	
 	You must use "sudo" to properly install the gem.  If you execute "gem 
 	install" (omitting the "sudo") the gem is installed in your home gem 
@@ -75,14 +75,14 @@ Using the App:
      --srcdir PATH         Read files from this folder (Default: ./results)
      --destdir PATH        Write files to this folder (Default: ./transcripts)
      --srctype wrd | seg   Kind of file to process (Default: wrd)
-     --desttype html | ttml   Kind of file to output (Default: html)
+     --desttype html | ttml | datajs  Kind of file to output (Default: html)
      -h, --help            Show this message	
 
 
 Troubleshooting:
 	sm-transcript requires additional gems to operate.  The RubyGem 
-	installation instructions should install dependencies automatically, but
-	they may not.  If you get an error that includes 
+	installation should install dependencies automatically, but when it 
+	doesn't, you get an error that includes 
 	
 	... no such file to load -- builder (LoadError)
 	
@@ -112,11 +112,11 @@ Required Gems:
 	             the command is already part of the core.)
 	htmlentities - html parsing
 	json       - create JSON structured data
-	optparse   - option parsing
+	optparse   - option parsing of command line
 	ostruct    - open data structures
 	ppcommand  - pp is a pretty printer.  It is used only for debugging
 	rake       - make for Ruby
-	rubygems   - support for gems
+	rubygems   - support for gems (shouldn't be needed for Ruby 1.9)
 	shoulda    - enhancement for Test::Unit
 		
 	This command installs gems on OSX and Linux:

data/Rakefile

@@ -1,4 +1,4 @@
-# $Id: Rakefile 190 2010-03-26 22:00:32Z pwilkins $
+# $Id: Rakefile 195 2010-04-15 17:29:55Z pwilkins $
 
 require 'rake/gempackagetask'
 require 'rake'
@@ -8,7 +8,7 @@ spec = Gem::Specification.new do |s|
   s.summary    = "Convert word lists to transcripts"
   s.description= File.read(File.join(File.dirname(__FILE__), 'README.txt'))
   s.requirements = [ 'TBD' ]
-  s.version     = "0.0.3"
+  s.version     = "0.0.4"
   s.author      = "Peter Wilkins"
   s.email       = "pwilkins@mit.edu"
   s.homepage    = "http://spokenmedia.mit.edu"

data/lib/sm_transcript/LICENSE.txt

@@ -1,5 +1,4 @@
-# $Id$
-
+#
 Copyright (c) 2010 Massachusetts Institute of Technology
 
 Permission is hereby granted, free of charge, to any person obtaining a copy

data/lib/sm_transcript/wrd_reader.rb

@@ -32,7 +32,7 @@ module SmTranscript
         # line is expected to contain two integers separated by a space, 
         # followed by a space and one or more words.  The words may contain
         # characters or an apostrophe
-        ln.scan(/^\d* \d* [\w']* *[\w']*$/) do |t|
+        ln.scan(/^\d* \d* [\w']* *[\w']*/) do |t|
           arr = t.split
           @words << SmTranscript::Word.new(arr[0], arr[1], arr[2])
         end

data/test/results/GardnerRileyInterview.wrd

@@ -0,0 +1,540 @@
+1630 1815 this
+1815 1970 is
+1970 3055 kathie
+3055 3605 lee
+5400 5520 it's
+5520 5780 just
+5780 6685 such
+7094 7369 today
+7369 7589 i'm
+7589 7839 going
+7839 8944 to
+8944 9599 be
+9599 9805 some
+9805 9879 of
+9879 10044 you
+10044 10484 already
+10484 10634 know
+10634 11669 which
+11669 12154 teaches
+15324 15714 child
+18364 18494 my
+18494 18934 research
+18934 19424 focuses
+19424 19924 on
+20375 20590 most
+20590 21000 nineteen
+21000 22520 forty
+22520 23300 cheer
+23300 23760 larry
+23760 24178 theory
+24967 28012 particularly
+28012 28727 systems
+28727 29192 feminist
+29192 29897 theory
+29897 30082 to
+30082 31092 analyze
+31361 31559 how
+31559 32264 contemporary
+32264 32699 parisian
+32699 33139 two
+33139 33539 issues
+33539 33839 right
+35895 36125 okay
+36125 36250 and
+36250 36485 it's
+36485 36810 fairly
+36810 37085 clear
+37085 37270 to
+37270 37780 me
+37780 38315 why
+38315 38785 research
+38785 39020 is
+40425 40910 engineering
+42784 42953 i
+42953 43567 think
+43567 43763 it's
+43763 43923 fair
+43923 44003 to
+44003 44198 this
+44198 44608 for
+44608 44668 a
+44668 44948 couple
+44948 45023 of
+45023 45413 reasons
+45413 45618 one
+45618 45788 it's
+45788 46013 my
+46013 47223 approach
+47223 47353 to
+47353 47553 just
+48642 49222 trying
+49222 49957 to
+49957 50477 theoretical
+50477 51232 perspectives
+51232 51762 engineering
+51762 52552 disciplines
+52817 53407 that
+53407 54137 really
+54137 54652 elaborate
+54652 54987 leases
+54987 55953 together
+55953 56157 so
+56157 56352 for
+56352 56517 my
+56517 57808 analysis
+58590 58777 also
+58777 58892 i
+58892 59457 think
+60838 61068 it's
+61068 62288 very
+62288 62738 ways
+63400 63631 just
+63631 63745 from
+63745 63985 where
+63985 64455 start
+64455 64630 my
+64630 65030 research
+65030 65615 questions
+65615 65790 to
+65790 65952 the
+65952 66370 absolute
+66370 66610 large
+66610 67395 exactly
+67612 67797 no
+67797 68117 kidding
+68117 68687 example
+68687 68842 i
+68842 69387 just
+69387 70272 recently
+70602 70972 conversely
+70972 71097 an
+71097 72127 article
+72377 72767 professor
+72767 73352 season
+73352 73677 volt
+73677 73785 is
+73785 74433 also
+74433 75242 interested
+75242 75407 in
+75407 75822 hearing
+75822 76662 master
+76967 77085 as
+77085 77615 opposed
+77615 77704 to
+77704 78415 circumvent
+78415 78895 weren't
+78895 79246 use
+79246 79470 a
+79470 80350 visiting
+80350 80920 professor
+80920 81021 of
+81021 81410 us
+81410 81490 who
+81490 82545 studies
+82545 82690 did
+82690 82800 in
+82800 83035 our
+83035 83240 group
+83240 83900 together
+85368 85709 vision
+85709 85829 of
+85829 86119 social
+86119 87014 justice
+87014 87554 integrate
+87554 88269 picture
+88639 88812 so
+88812 88937 we
+88937 89268 came
+89268 89707 together
+89707 89792 in
+89792 89827 a
+89827 90042 way
+90042 90337 the
+90337 90797 system
+90797 91035 that
+91035 91322 has
+91322 91487 that
+91487 91787 kind
+91787 91872 of
+91872 92367 justice
+92367 93007 background
+93007 93226 and
+93226 93567 issues
+93567 93652 the
+93652 94082 justice
+94082 94787 studies
+95052 95512 kathleen
+95512 96333 brothers
+96333 96739 rhetoric
+96739 97002 can
+97002 97242 help
+97242 97697 language
+97697 98252 works
+98252 98358 we
+98358 99267 conceptualize
+99267 99767 justice
+99767 100027 to
+100027 100752 language
+101044 101268 i
+101268 101463 wrote
+101463 101955 feminist
+101955 102770 theory
+102770 102838 and
+102838 103143 talked
+103143 103368 about
+103368 103508 how
+103508 103658 we
+103658 103764 can
+103764 104208 start
+104208 104447 thinking
+104447 104558 of
+104558 104973 social
+104973 105923 justice
+105923 106183 to
+106183 106563 balance
+106563 107178 principles
+107178 108038 suggests
+108474 109432 equality
+109432 110162 generous
+110396 110712 thinking
+110712 110972 about
+110972 111062 the
+111062 112046 justice
+112046 112222 is
+112222 112522 less
+112522 113542 individualized
+113542 114127 rationals
+114127 114902 thirty
+114902 114987 or
+114987 115437 about
+116647 117237 care
+117719 117834 we
+117834 118935 mentioned
+118935 118989 the
+118989 119294 ways
+119294 119464 in
+119464 119714 which
+119714 119889 we
+119889 120669 entrance
+121162 121510 social
+121510 122760 justice
+122760 122880 we
+122880 123072 did
+123072 123305 so
+123305 123475 by
+123475 123720 looking
+123720 124420 at
+124420 124777 work
+124777 124845 i
+124845 125200 actually
+125200 125590 person
+125590 126025 in
+126025 126895 charge
+127142 127252 and
+127252 127842 markings
+127842 128232 sort of
+128232 128522 talk
+128522 128737 about
+128737 128947 what
+128947 129066 the
+129066 129587 messages
+129587 129747 to
+129747 129932 me
+129932 130250 see
+130250 130327 in
+130327 130557 this
+130557 131107 text
+131479 131765 about
+131765 132085 ways
+132085 132215 in
+132215 132615 which
+132615 133285 changes
+134614 134719 yeah
+134719 135013 that's
+135013 135945 interesting
+135945 136124 i
+136124 136371 hope
+136371 137109 everybody
+137109 137289 think
+137289 137832 there's
+137832 138069 no
+138069 139294 chance
+140973 141817 around
+141817 141964 the
+141964 142232 sort
+142232 142432 of
+142432 142797 sorry
+144677 144957 the
+144957 146297 patience
+146297 146952 to
+147407 148607 mainstream
+148607 149837 education
+158425 158663 is
+158663 159050 english
+159050 159210 so
+159210 159465 i
+159465 160074 necessarily
+160074 160474 star
+160474 161525 cluster
+161525 162085 making
+162085 162520 any
+162520 162715 do
+163310 164055 switcher
+164055 164565 necessarily
+164565 164661 to
+164661 166315 start
+166315 166720 reading
+167993 168097 and
+168097 168537 then
+168537 168617 he
+168617 168773 was
+168773 168912 a
+168912 170077 very
+170077 170822 various
+170822 171237 feminist
+171237 171627 theory
+171627 171807 that
+171807 172072 might
+172072 172317 help
+172317 172762 me
+173267 173887 developed
+173887 174152 fourier
+174152 174715 analysis
+174715 174827 of
+174827 175507 intense
+175507 176253 exactly
+178108 178303 and
+178303 178408 you
+178408 178711 know
+178711 179568 article
+179568 180446 in
+180446 180513 the
+180513 181223 summer
+181442 181641 they've
+181641 181891 looked
+181891 182216 at
+182216 182606 nature
+182606 182891 writing
+182891 183526 environmental
+183526 183926 times
+183926 184126 their
+184126 184546 readers
+184546 184681 it's
+184681 184936 a
+184936 185270 very
+185270 185436 all
+185436 185806 over
+185806 186026 the
+186026 186311 famous
+186311 186558 for
+187494 188089 terrigenous
+188089 188634 millions
+188634 189513 of
+189513 189854 fiction
+189854 190333 writers
+191527 191637 the
+191637 192046 united
+192046 193032 states
+193539 193673 and
+193673 193903 let's
+193903 194083 look
+194083 194253 at
+194253 194403 the
+194403 195228 particularly
+195228 195388 think
+195388 196433 about
+197037 197347 what's
+197347 197872 happening
+197872 198202 in
+198202 198627 nature
+198627 199442 reading
+199857 200402 because
+200402 200712 people
+200712 200932 to
+200932 201237 react
+201237 201437 to
+201437 201672 the
+201672 202267 genes
+202267 202827 gauguin
+203457 204172 are
+204172 204442 willing
+204442 204687 to
+204687 204977 was
+204977 205334 running
+205334 205667 you
+205667 205832 know
+205832 206027 it's
+206027 206672 very
+206932 207067 to
+207067 207366 talk
+207366 207673 about
+207673 207776 how
+207776 208017 these
+208017 208417 writers
+208417 208538 are
+208538 208917 actually
+208917 209427 modeling
+209427 209737 first
+209737 210438 principles
+210438 210557 of
+210557 211767 collaboration
+212280 212860 principles
+212860 213000 that
+213000 214160 diffusing
+215381 215831 our
+215831 216928 relationships
+216928 217032 in
+217032 217246 our
+217246 218083 world
+218083 218396 into
+218396 218691 just
+218691 218877 had
+218877 218961 a
+218961 219431 breakdown
+219431 219631 those
+219631 220680 boundaries
+220680 221156 actually
+221156 221581 came
+221581 222131 from
+222659 222853 so
+222853 223102 that
+223102 223436 focus
+223436 223636 on
+223636 224427 interdependence
+224427 225787 collaboration
+226185 226330 no
+226330 226645 longer
+226645 226825 have
+226825 226995 a
+226995 227640 higher
+228501 229291 relationships
+229291 229476 as
+229476 229523 a
+229523 230211 teenager
+230211 231866 culture
+231866 231971 is
+231971 232456 so
+232572 232996 it's
+232996 234035 going to
+234035 234371 argue
+234371 234602 is
+234602 234692 one
+234692 234742 of
+234742 235197 these
+235440 235995 contemporary
+235995 236505 parisian
+236505 236956 julius
+236956 237380 create
+237380 237415 a
+237415 237985 dipole
+237985 238239 kick
+238239 238375 up
+238375 238675 there
+239249 239378 a
+239378 239643 new
+239643 239903 way
+239903 240123 of
+240123 240538 thinking
+240538 240803 about
+241270 242225 nature
+242225 242430 was
+242430 242565 there
+242565 242770 was
+242770 243440 definitely
+243440 244260 for
+244260 245190 us
+245190 245505 here
+246376 246652 okay
+246652 247563 yeah
+247563 248148 it's
+248148 248333 it's
+248333 248593 very
+248593 249173 clear
+249173 249393 i
+249393 249524 mean
+249524 249683 how
+249683 249963 how
+249963 250798 james
+251968 252667 it's
+252667 253573 way
+261413 261552 oh
+261552 262502 jeez
+263969 264034 i
+264034 264495 think
+264695 266155 humanities
+266155 267095 perspective
+268395 268530 he
+268530 269260 anteks
+269260 270215 paralyzing
+270215 270360 where
+270360 270450 it
+270450 271345 says
+271345 272320 experiences
+272320 272735 to
+272735 272920 look
+272920 273070 at
+273070 273160 the
+273160 273515 issues
+273515 273893 of
+273893 274940 sexuality
+275102 275225 and
+275225 276310 difference
+276310 276555 of
+276555 276925 ways
+276925 277015 in
+277015 277215 which
+277215 277360 we
+277360 277520 think
+277520 277835 about
+277835 278805 identity
+278805 278885 in
+278885 279010 the
+279010 279403 united
+279403 280780 states
+280780 280990 how
+280990 281071 to
+281071 281975 change
+282365 282446 and
+282446 282850 its
+282850 283460 relationship
+283460 283595 to
+283595 283836 be
+283836 284890 our
+284890 285420 relationship
+285420 285555 to
+285555 285701 each
+285701 286269 other
+286269 287075 require
+287075 287630 individual
+287630 287800 or
+287800 288690 person
+288690 289355 rapes
+289923 290542 ethnicity
+290542 291257 sex
+291257 292142 nationality
+292142 292912 resonance
+293485 293975 challenge
+293975 294180 how
+294180 294385 we
+294385 294980 operate
+294980 295595 world
+296066 296226 as
+296226 296876 individuals
+296876 297011 and
+297011 297486 also
+297486 297669 we
+297669 298166 operate
+302660 302810 and
+302810 303380 later
+303380 303510 the
+303510 304185 semester
+312555 312800 it
+312800 313645 wasn't
+314017 314297 to
+314297 314767 see
+314767 315792 commonality
+315792 316232 between
+316232 317082 questions
+321525 321696 thank
+321696 321785 you