codemodels 0.2.2-java → 0.2.3-java

data/LICENSE

@@ -1,20 +1,191 @@
-The MIT License (MIT)
-
-Copyright (c) 2013 ftomassetti
-
-Permission is hereby granted, free of charge, to any person obtaining a copy of
-this software and associated documentation files (the "Software"), to deal in
-the Software without restriction, including without limitation the rights to
-use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of
-the Software, and to permit persons to whom the Software is furnished to do so,
-subject to the following conditions:
-
-The above copyright notice and this permission notice shall be included in all
-copies or substantial portions of the Software.
-
-THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
-IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS
-FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR
-COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER
-IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN
-CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
+Apache License
+Version 2.0, January 2004
+http://www.apache.org/licenses/
+
+TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
+
+1. Definitions.
+
+"License" shall mean the terms and conditions for use, reproduction, and
+distribution as defined by Sections 1 through 9 of this document.
+
+"Licensor" shall mean the copyright owner or entity authorized by the copyright
+owner that is granting the License.
+
+"Legal Entity" shall mean the union of the acting entity and all other entities
+that control, are controlled by, or are under common control with that entity.
+For the purposes of this definition, "control" means (i) the power, direct or
+indirect, to cause the direction or management of such entity, whether by
+contract or otherwise, or (ii) ownership of fifty percent (50%) or more of the
+outstanding shares, or (iii) beneficial ownership of such entity.
+
+"You" (or "Your") shall mean an individual or Legal Entity exercising
+permissions granted by this License.
+
+"Source" form shall mean the preferred form for making modifications, including
+but not limited to software source code, documentation source, and configuration
+files.
+
+"Object" form shall mean any form resulting from mechanical transformation or
+translation of a Source form, including but not limited to compiled object code,
+generated documentation, and conversions to other media types.
+
+"Work" shall mean the work of authorship, whether in Source or Object form, made
+available under the License, as indicated by a copyright notice that is included
+in or attached to the work (an example is provided in the Appendix below).
+
+"Derivative Works" shall mean any work, whether in Source or Object form, that
+is based on (or derived from) the Work and for which the editorial revisions,
+annotations, elaborations, or other modifications represent, as a whole, an
+original work of authorship. For the purposes of this License, Derivative Works
+shall not include works that remain separable from, or merely link (or bind by
+name) to the interfaces of, the Work and Derivative Works thereof.
+
+"Contribution" shall mean any work of authorship, including the original version
+of the Work and any modifications or additions to that Work or Derivative Works
+thereof, that is intentionally submitted to Licensor for inclusion in the Work
+by the copyright owner or by an individual or Legal Entity authorized to submit
+on behalf of the copyright owner. For the purposes of this definition,
+"submitted" means any form of electronic, verbal, or written communication sent
+to the Licensor or its representatives, including but not limited to
+communication on electronic mailing lists, source code control systems, and
+issue tracking systems that are managed by, or on behalf of, the Licensor for
+the purpose of discussing and improving the Work, but excluding communication
+that is conspicuously marked or otherwise designated in writing by the copyright
+owner as "Not a Contribution."
+
+"Contributor" shall mean Licensor and any individual or Legal Entity on behalf
+of whom a Contribution has been received by Licensor and subsequently
+incorporated within the Work.
+
+2. Grant of Copyright License.
+
+Subject to the terms and conditions of this License, each Contributor hereby
+grants to You a perpetual, worldwide, non-exclusive, no-charge, royalty-free,
+irrevocable copyright license to reproduce, prepare Derivative Works of,
+publicly display, publicly perform, sublicense, and distribute the Work and such
+Derivative Works in Source or Object form.
+
+3. Grant of Patent License.
+
+Subject to the terms and conditions of this License, each Contributor hereby
+grants to You a perpetual, worldwide, non-exclusive, no-charge, royalty-free,
+irrevocable (except as stated in this section) patent license to make, have
+made, use, offer to sell, sell, import, and otherwise transfer the Work, where
+such license applies only to those patent claims licensable by such Contributor
+that are necessarily infringed by their Contribution(s) alone or by combination
+of their Contribution(s) with the Work to which such Contribution(s) was
+submitted. If You institute patent litigation against any entity (including a
+cross-claim or counterclaim in a lawsuit) alleging that the Work or a
+Contribution incorporated within the Work constitutes direct or contributory
+patent infringement, then any patent licenses granted to You under this License
+for that Work shall terminate as of the date such litigation is filed.
+
+4. Redistribution.
+
+You may reproduce and distribute copies of the Work or Derivative Works thereof
+in any medium, with or without modifications, and in Source or Object form,
+provided that You meet the following conditions:
+
+You must give any other recipients of the Work or Derivative Works a copy of
+this License; and
+You must cause any modified files to carry prominent notices stating that You
+changed the files; and
+You must retain, in the Source form of any Derivative Works that You distribute,
+all copyright, patent, trademark, and attribution notices from the Source form
+of the Work, excluding those notices that do not pertain to any part of the
+Derivative Works; and
+If the Work includes a "NOTICE" text file as part of its distribution, then any
+Derivative Works that You distribute must include a readable copy of the
+attribution notices contained within such NOTICE file, excluding those notices
+that do not pertain to any part of the Derivative Works, in at least one of the
+following places: within a NOTICE text file distributed as part of the
+Derivative Works; within the Source form or documentation, if provided along
+with the Derivative Works; or, within a display generated by the Derivative
+Works, if and wherever such third-party notices normally appear. The contents of
+the NOTICE file are for informational purposes only and do not modify the
+License. You may add Your own attribution notices within Derivative Works that
+You distribute, alongside or as an addendum to the NOTICE text from the Work,
+provided that such additional attribution notices cannot be construed as
+modifying the License.
+You may add Your own copyright statement to Your modifications and may provide
+additional or different license terms and conditions for use, reproduction, or
+distribution of Your modifications, or for any such Derivative Works as a whole,
+provided Your use, reproduction, and distribution of the Work otherwise complies
+with the conditions stated in this License.
+
+5. Submission of Contributions.
+
+Unless You explicitly state otherwise, any Contribution intentionally submitted
+for inclusion in the Work by You to the Licensor shall be under the terms and
+conditions of this License, without any additional terms or conditions.
+Notwithstanding the above, nothing herein shall supersede or modify the terms of
+any separate license agreement you may have executed with Licensor regarding
+such Contributions.
+
+6. Trademarks.
+
+This License does not grant permission to use the trade names, trademarks,
+service marks, or product names of the Licensor, except as required for
+reasonable and customary use in describing the origin of the Work and
+reproducing the content of the NOTICE file.
+
+7. Disclaimer of Warranty.
+
+Unless required by applicable law or agreed to in writing, Licensor provides the
+Work (and each Contributor provides its Contributions) on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied,
+including, without limitation, any warranties or conditions of TITLE,
+NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A PARTICULAR PURPOSE. You are
+solely responsible for determining the appropriateness of using or
+redistributing the Work and assume any risks associated with Your exercise of
+permissions under this License.
+
+8. Limitation of Liability.
+
+In no event and under no legal theory, whether in tort (including negligence),
+contract, or otherwise, unless required by applicable law (such as deliberate
+and grossly negligent acts) or agreed to in writing, shall any Contributor be
+liable to You for damages, including any direct, indirect, special, incidental,
+or consequential damages of any character arising as a result of this License or
+out of the use or inability to use the Work (including but not limited to
+damages for loss of goodwill, work stoppage, computer failure or malfunction, or
+any and all other commercial damages or losses), even if such Contributor has
+been advised of the possibility of such damages.
+
+9. Accepting Warranty or Additional Liability.
+
+While redistributing the Work or Derivative Works thereof, You may choose to
+offer, and charge a fee for, acceptance of support, warranty, indemnity, or
+other liability obligations and/or rights consistent with this License. However,
+in accepting such obligations, You may act only on Your own behalf and on Your
+sole responsibility, not on behalf of any other Contributor, and only if You
+agree to indemnify, defend, and hold each Contributor harmless for any liability
+incurred by, or claims asserted against, such Contributor by reason of your
+accepting any such warranty or additional liability.
+
+END OF TERMS AND CONDITIONS
+
+APPENDIX: How to apply the Apache License to your work
+
+To apply the Apache License to your work, attach the following boilerplate
+notice, with the fields enclosed by brackets "[]" replaced with your own
+identifying information. (Don't include the brackets!) The text should be
+enclosed in the appropriate comment syntax for the file format. We also
+recommend that a file or class name and description of purpose be included on
+the same "printed page" as the copyright notice for easier identification within
+third-party archives.
+
+   Copyright [yyyy] [name of copyright owner]
+
+   Licensed under the Apache License, Version 2.0 (the "License");
+   you may not use this file except in compliance with the License.
+   You may obtain a copy of the License at
+
+     http://www.apache.org/licenses/LICENSE-2.0
+
+   Unless required by applicable law or agreed to in writing, software
+   distributed under the License is distributed on an "AS IS" BASIS,
+   WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+   See the License for the specific language governing permissions and
+   limitations under the License.

data/README.md

@@ -7,10 +7,10 @@ It is based on [RGen](http://github.com/mthiede/rgen) and it supportes the conve
 
 There are different gems which transform source code in models of the code. Currently they are:
 * [html-lightmodels](http://github.com/ftomassetti/html-lightmodels)
-* [java-lightmodels](http://github.com/ftomassetti/java-lightmodels)
+* [codemodels-java](http://github.com/ftomassetti/codemodels-java)
 * [js-lightmodels](http://github.com/ftomassetti/js-lightmodels)
 * [properties-lightmodels](http://github.com/ftomassetti/properties-lightmodels)
-* [ruby-lightmodels](http://github.com/ftomassetti/ruby-lightmodels)
+* [codemodels-ruby](http://github.com/ftomassetti/codemodels-ruby)
 * [xml-lightmodels](http://github.com/ftomassetti/xml-lightmodels)
 
 Therefore it can be used to perform analysis on different languages.

data/codemodels.gemspec

@@ -7,13 +7,12 @@ Gem::Specification.new do |s|
   s.platform    = 'java'
   s.name        = 'codemodels'
   s.version     = CodeModels::VERSION
-  s.date        = '2013-08-27'
   s.summary     = "Library to build models of code"
   s.description = "Library to build models of code of different languages in a uniform way."
   s.authors     = ["Federico Tomassetti"]
   s.email       = 'f.tomassetti@gmail.com'
   s.homepage    = 'https://github.com/ftomassetti/codemodels'
-  s.license     = "APACHE 2"
+  s.license     = "Apache v2"
 
   s.files         = `git ls-files`.split($/)
   s.executables   = s.files.grep(%r{^bin/}) { |f| File.basename(f) }
@@ -26,4 +25,4 @@ Gem::Specification.new do |s|
   s.add_development_dependency "bundler", "1.3.5"
   s.add_development_dependency "rake"  
   s.add_development_dependency "simplecov"
-end
+end

data/lib/codemodels/info_extraction.rb

@@ -131,9 +131,5 @@ module InfoExtractionFunctionalities
 
 end
 
-class ::RGen::MetamodelBuilder::MMBase
-	include InfoExtractionFunctionalities
-end
-
 end
 end

data/lib/codemodels/language.rb

@@ -2,34 +2,6 @@ module CodeModels
 
 @@languages = []
 
-class Parser
-
-	def parse_file(path)
-		code = IO.read(path)
-		parse_code(code)
-	end
-
-end
-
-module CodeModelsReflectionInfo
-	attr_accessor :source
-	attr_accessor :language
-end
-
-class Position
-	attr_accessor :line, :column
-end
-
-class SourceInfo
-	attr_accessor :filename
-	attr_accessor :begin_pos, :end_pos
-
-	def to_code
-		raise "Unimplemented"
-	end
-
-end
-
 class Language
 	attr_reader :name
 	attr_reader :extensions
@@ -48,7 +20,9 @@ class Language
 
 end
 
+# It avoids multiple registration of the same class
 def self.register_language(language)
+	return if @@languages.find {|l| l.is_a?(language.class)}
 	@@languages << language
 end
 
@@ -56,9 +30,17 @@ def self.registered_languages
 	@@languages
 end
 
+class NoLanguageRegistered < Exception
+	attr_reader :path
+
+	def initialize(path)
+		@path = path
+	end
+end
+
 def self.parse_file(path)
 	l = @@languages.find {|l| l.can_parse?(path) }
-	raise "I don't know how to parse #{path}. Languages known: #{@@languages.map(&:name)}" unless l
+	raise NoLanguageRegistered.new(path) unless l
 	l.parser.parse_file(path)
 end
 

data/lib/codemodels/metamodel.rb

@@ -1,11 +1,19 @@
 require 'rgen/metamodel_builder'
-require 'codemodels/language'
+require 'codemodels/source_info'
+require 'codemodels/navigation'
+require 'codemodels/info_extraction'
+require 'codemodels/serialization'
 
 module CodeModels
 
-# All nodes should derive from this one
+# All AST nodes built with CodeModels should derive from this one
 class CodeModelsAstNode < RGen::MetamodelBuilder::MMBase
-	include CodeModelsReflectionInfo
+	include SourceInfoExtensions
+	include ForeignAstExtensions
+	include HostPositionExtensions
+	include NavigationExtensions
+	include InfoExtraction::InfoExtractionFunctionalities
+	include Serialization::SerializationFunctionalities
 end
 
 end

data/lib/codemodels/model_building.rb

@@ -2,75 +2,71 @@ require 'codemodels/serialization'
 
 module CodeModels
 
+class FilesSource
+	
+	def initialize(dir,extension)
+		@dir = dir
+		@extension = extension
+	end
+
+	def each(&block)
+		Dir["#{@dir}/**/*.#{@extension}"].each do |f|
+			block.call(f)
+		end
+	end
+end
+
+class FileMapper
+
+	def initialize(src,dest,src_extension,dest_extension)
+		@src  = src
+		@dest = dest
+		@src_ext = src_extension
+		@dest_ext = dest_extension
+	end
+
+	def map(f)
+		f_in_dest_dir = File.join(@dest,f.remove_prefix(@src))
+		f_in_dest_dir.remove_postfix(@src_ext)+@dest_ext
+	end
+
+end
+
 module ModelBuilding
 
 class << self
 	attr_accessor :verbose
+	attr_accessor :max_nesting
 end
 
+@@verbose     = false
+@@max_nesting = 500
+
 def self.verbose_warn(msg)
 	warn(msg) if verbose
 end
 
-def self.handle_serialized_models_in_dir(src,src_extension,error_handler=nil,model_handler,&model_creator)
-	Dir["#{src}/**/*.#{src_extension}"].each do |fd|
-		verbose_warn "== #{fd} =="
-		handle_serialized_model_per_file(fd,error_handler,model_handler,&model_creator)		
-	end
-end
-
-def self.handle_models_in_dir(src,src_extension,error_handler=nil,model_handler,&model_creator)
-	Dir["#{src}/**/*.#{src_extension}"].each do |fd|	
-		verbose_warn "== #{fd} =="			
-		handle_model_per_file(fd,error_handler,model_handler,&model_creator)		
-	end
-end
-
-def self.generate_models_in_dir(src,dest,src_extension,dest_extension,max_nesting=500,error_handler=nil,&model_creator)
+def self.generate_models_in_dir(src,dest,src_extension,dest_extension,&model_creator)
 	verbose_warn "== #{src} -> #{dest} =="
-	Dir["#{src}/**/*.#{src_extension}"].each do |fd|		
-		if File.directory? fd
-			basename = File.basename(fd)
-			generate_models_in_dir("#{src}/#{basename}","#{dest}/#{basename}",src_extension,dest_extension,max_nesting,error_handler,&model_creator)
-		else
-			if File.extname(fd)==".#{src_extension}"
-				translated_simple_name = "#{File.basename(fd, ".#{src_extension}")}.#{dest_extension}"
-				translated_name = "#{dest}/#{translated_simple_name}"
-				verbose_warn "* #{fd} --> #{translated_name}"
-				generate_model_per_file(fd,translated_name,max_nesting,error_handler,&model_creator)
-			end
-		end
+	FilesSource.new(src,src_extension).each do |f|		
+		dest_name = FileMapper.new(src,dest,src_extension,dest_extension).map(f)
+		verbose_warn "* #{f} --> #{dest_name}"
+		generate_model_per_file(f,dest_name,&model_creator)
 	end
 end
 
-def self.handle_model_per_file(src,error_handler=nil,model_handler,&models_generator)
+def self.handle_model_per_file(src,model_handler,&models_generator)
 	verbose_warn "<Model from #{src}>"
-	begin
-		m = models_generator.call(src)
-		model_handler.call(src,m)
-	rescue => e
-		if error_handler
-			error_handler.call(src,e)
-		else
-			raise e
-		end
-	end
+	
+	m = models_generator.call(src)
+	model_handler.call(src,m) if m
 end
 
-def self.generate_model_per_file(src,dest,max_nesting=500,error_handler=nil,&models_generator)
+def self.generate_model_per_file(src,dest,&models_generator)
 	if not File.exist? dest 
-		verbose_warn "<Model from #{src}>"
-		
-		begin
-			m = models_generator.call(src)
-			LightModels::Serialization.save_model(m,dest,max_nesting)
-		rescue Exception => e
-			if error_handler
-				error_handler.call(src,e)
-			else
-				raise e
-			end
-		end		
+		verbose_warn "<Model from #{src}>"				
+		m = models_generator.call(src)
+		LightModels::Serialization.save_model(m,dest,@@max_nesting) if m			
 	else
 		verbose_warn "skipping #{src} because #{dest} found"
 	end

data/lib/codemodels/navigation.rb

@@ -0,0 +1,121 @@
+module CodeModels
+
+module NavigationExtensions
+
+	def all_children(flag=nil)
+		also_foreign = (flag==:also_foreign)
+		arr = []
+		ecore = self.class.ecore
+		# Awful hack to forbid the same reference is visited twice when
+		# two references with the same name are found
+		already_used_references = []
+		ecore.eAllReferences.select {|r| r.containment}.each do |ref|
+			#raise "Too many features with name #{ref.name}. Count: #{features_by_name(ref.name).count}" if features_by_name(ref.name).count!=1
+			unless already_used_references.include?(ref.name)
+				res = self.send(ref.name.to_sym)
+				if ref.many
+					d = arr.count
+					res.each do |el|
+						arr << el unless res==nil
+					end
+				elsif res!=nil
+					d = arr.count
+					arr << res
+				end
+				already_used_references << ref.name
+			end
+		end
+		if also_foreign
+			arr.concat(self.foreign_asts)
+		end
+		arr
+	end
+
+	def all_children_deep(flag=nil)
+		arr = []
+		all_children(flag).each do |c|
+			arr << c
+			c.all_children_deep(flag).each do |cc|
+				arr << cc
+			end
+		end			
+		arr
+	end
+
+	def traverse(flag=nil,&op)
+		op.call(self)
+		all_children_deep(flag).each do |c|
+			op.call(c)
+		end
+	end
+
+	def collect_values_with_count
+		values = Hash.new {|h,k| h[k]=0}
+		self.class.ecore.eAllAttributes.each do |a|
+			v = self.send(:"#{a.name}")
+			if v!=nil
+				if a.many
+					v.each {|el| values[el]+=1}
+				else
+					values[v]+=1
+				end
+			end
+		end
+		values			
+	end
+
+	def collect_values_with_count_subtree(flag=nil)
+		values = collect_values_with_count
+		all_children_deep(flag).each do |c|
+			c.collect_values_with_count.each do |k,v|
+				values[k]+=v
+			end
+		end
+		values
+	end		
+
+	def all_children_of_type(flag=nil,type)
+		all_children(flag).select {|c| c and c.is_a?(type)}
+	end
+
+	def all_children_deep_of_type(flag=nil,type)
+		all_children_deep(flag).select {|c| c and c.is_a?(type)}
+	end
+
+	def only_child_of_type(flag=nil,type)
+		selected = all_children_of_type(flag,type)
+		raise "Exactly one child of type #{type} expected, #{selected.count} found on #{self}" unless selected.count==1
+		selected[0]
+	end
+
+	def only_child_deep_of_type(flag=nil,type)
+		selected = all_children_deep_of_type(flag,type)
+		raise "Exactly one child of type #{type} expected, #{selected.count} found on #{self}" unless selected.count==1
+		selected[0]
+	end
+
+	def container(flag=nil)
+		also_foreign = (flag==:also_foreign)
+		return self.eContainer if self.eContainer
+		if also_foreign
+			self.foreign_container
+		else
+			nil
+		end
+	end
+
+	def all_children_also_foreign
+		all_children(:also_foreign)
+	end
+
+	def all_children_deep_also_foreign
+		all_children_deep(:also_foreign)
+	end		
+
+	def traverse_also_foreign(&block)
+		traverse(:also_foreign,block)
+	end
+
+end
+
+end