Task #8461
closedCheck social-data-indexer-se-plugin installation on node22.d4science.org
100%
Description
In order to upgrade the plugin above in production environment it's need to check if it works on node22 with the following configuration:
- smart-executor version 1.5.0-4.4.0-144722;
- Java7;
- smartgears-distribution 2.1.2-4.4.0-146408
If all works fine I'm going to update the plugin in production environment
Related issues
Updated by Roberto Cirillo about 8 years ago
- Blocks Task #8433: social-data-indexer-se-plugin service to test : node22.d4science.org added
Updated by Costantino Perciante about 8 years ago
- Status changed from New to In Progress
I've done some more tests:
- the staging artefact of the plugin still throws the following exception when the plugin itself is launched
17:00:54.036 [pool-8-thread-1] DEBUG OrientDBPersistenceConnector: Preparing Connection for OrientDBPersistenceConnector 17:00:54.505 [pool-8-thread-1] DEBUG SmartExecutorInitializator: Going to get Orphan Scheduled Tasks 17:00:55.737 [pool-8-thread-1] DEBUG DefaultScopeProvider: resetting scope in thread 37 17:00:56.032 [Thread-5] DEBUG PluginManager: Trying to instantiate a Plugin named social-data-indexer-plugin 17:00:56.132 [Thread-5] DEBUG SmartExecutorScheduler: Going to persist Scheduled Task org.gcube.vremanagement.executor.scheduledtask.ScheduledTask@37f8bcba : {} 17:00:56.526 [DefaultQuartzScheduler_Worker-1] DEBUG SmartExecutorTask: Execute of org.gcube.vremanagement.executor.scheduler.SmartExecutorTask@5a71dc96 17:00:56.527 [DefaultQuartzScheduler_Worker-1] DEBUG SmartExecutorTask: Execute of org.gcube.vremanagement.executor.scheduler.SmartExecutorTask@5a71dc96 with org.quartz.JobDataMap@e964567a 17:00:56.527 [DefaultQuartzScheduler_Worker-1] DEBUG PluginManager: Trying to instantiate a Plugin named social-data-indexer-plugin 17:00:56.529 [DefaultQuartzScheduler_Worker-1] DEBUG PluginManager: The class which will run the execution will be org.gcube.socialnetworking.socialdataindexer.SocialDataIndexerPlugin 17:00:56.540 [DefaultQuartzScheduler_Worker-1] DEBUG SocialDataIndexerPlugin: Constructor 17:00:56.540 [DefaultQuartzScheduler_Worker-1] DEBUG PluginManager: Plugin named social-data-indexer-plugin has been instantiated 17:00:56.549 [DefaultQuartzScheduler_Worker-1] DEBUG RunnablePlugin: Notifing Plugin State Evolution {uuid:2550db03-ba9b-49b0-9ce1-3b9c74e2582e,iteration:1,timestamp:1494342056548,pluginDeclaration:SocialDataIndexerPluginDeclaration : social-data-indexer-plugin - 1.2.0 - The social-data-indexer-plugin has the role to index data contained into a Cassandra cluster using an Elasticsearch index to support full-text search. - {} - Class,pluginState:CREATED,percentage:0} to OrientDBPersistenceConnector. 17:00:56.567 [DefaultQuartzScheduler_Worker-1] DEBUG RunnablePlugin: Notifing Plugin State Evolution {uuid:2550db03-ba9b-49b0-9ce1-3b9c74e2582e,iteration:1,timestamp:1494342056548,pluginDeclaration:SocialDataIndexerPluginDeclaration : social-data-indexer-plugin - 1.2.0 - The social-data-indexer-plugin has the role to index data contained into a Cassandra cluster using an Elasticsearch index to support full-text search. - {} - Class,pluginState:CREATED,percentage:0} to SendNotification. 17:00:56.568 [DefaultQuartzScheduler_Worker-1] INFO SendNotification: No notification is going to be sent, because the status of the plugin execution is CREATED 17:00:56.568 [DefaultQuartzScheduler_Worker-1] DEBUG SmartExecutorTask: Going to run Job with ID 2550db03-ba9b-49b0-9ce1-3b9c74e2582e (iteration 1) 17:00:56.599 [DefaultQuartzScheduler_Worker-1] DEBUG RunnablePlugin: Notifing Plugin State Evolution {uuid:2550db03-ba9b-49b0-9ce1-3b9c74e2582e,iteration:1,timestamp:1494342056598,pluginDeclaration:SocialDataIndexerPluginDeclaration : social-data-indexer-plugin - 1.2.0 - The social-data-indexer-plugin has the role to index data contained into a Cassandra cluster using an Elasticsearch index to support full-text search. - {} - Class,pluginState:RUNNING,percentage:0} to OrientDBPersistenceConnector. 17:00:56.603 [DefaultQuartzScheduler_Worker-1] DEBUG RunnablePlugin: Notifing Plugin State Evolution {uuid:2550db03-ba9b-49b0-9ce1-3b9c74e2582e,iteration:1,timestamp:1494342056598,pluginDeclaration:SocialDataIndexerPluginDeclaration : social-data-indexer-plugin - 1.2.0 - The social-data-indexer-plugin has the role to index data contained into a Cassandra cluster using an Elasticsearch index to support full-text search. - {} - Class,pluginState:RUNNING,percentage:0} to SendNotification. 17:00:56.603 [DefaultQuartzScheduler_Worker-1] INFO SendNotification: No notification is going to be sent, because the status of the plugin execution is RUNNING 17:00:56.604 [DefaultQuartzScheduler_Worker-1] INFO SocialDataIndexerPlugin: Reading scope from ScopeProvider 17:00:56.605 [DefaultQuartzScheduler_Worker-1] INFO SocialDataIndexerPlugin: Scope read is /gcube 17:00:56.753 [DefaultQuartzScheduler_Worker-1] DEBUG PersistenceBackendFactory: Creating FallbackPersistenceBackend for context /gcube 17:00:56.763 [AccountingAggregationThread-0] WARN CalculateTaskWallDurationAction: wallDuration is automatically computed using taskStartTime and taskEndTime. This invocation has the only effect of recalculating the value. Any provided value is ignored. 17:00:56.764 [AccountingAggregationThread-0] DEBUG AbstractRecord: wallDuration is a computed field. To be calculated all the required fields to calcutalate it MUST be set. In any case the provided value will be ignored. 17:00:56.769 [DefaultQuartzScheduler_Worker-1] ERROR JobRunShell: Job DEFAULT.2550db03-ba9b-49b0-9ce1-3b9c74e2582e threw an unhandled Exception: java.lang.NoClassDefFoundError: javax/portlet/PortletRequest at org.gcube.portal.databook.server.RunningCluster.getConfigurationFromIS(RunningCluster.java:105) ~[social-data-indexer-se-plugin-1.2.0-4.4.0-144777-jar-with-dependencies.jar:na] at org.gcube.portal.databook.server.RunningCluster.<init>(RunningCluster.java:77) ~[social-data-indexer-se-plugin-1.2.0-4.4.0-144777-jar-with-dependencies.jar:na] at org.gcube.portal.databook.server.RunningCluster.getInstance(RunningCluster.java:68) ~[social-data-indexer-se-plugin-1.2.0-4.4.0-144777-jar-with-dependencies.jar:na] at org.gcube.portal.databook.server.CassandraClusterConnection.<init>(CassandraClusterConnection.java:104) ~[social-data-indexer-se-plugin-1.2.0-4.4.0-144777-jar-with-dependencies.jar:na] at org.gcube.portal.databook.server.DBCassandraAstyanaxImpl.<init>(DBCassandraAstyanaxImpl.java:202) ~[social-data-indexer-se-plugin-1.2.0-4.4.0-144777-jar-with-dependencies.jar:na] at org.gcube.socialnetworking.socialdataindexer.SocialDataIndexerPlugin.launch(SocialDataIndexerPlugin.java:86) ~[social-data-indexer-se-plugin-1.2.0-4.4.0-144777-jar-with-dependencies.jar:na] at org.gcube.vremanagement.executor.pluginmanager.RunnablePlugin.run(RunnablePlugin.java:114) ~[RunnablePlugin.class:na] at org.gcube.vremanagement.executor.scheduler.SmartExecutorTask.execute(SmartExecutorTask.java:252) ~[SmartExecutorTask.class:na] at org.quartz.core.JobRunShell.run(JobRunShell.java:202) ~[quartz-2.2.1.jar:na] at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:573) [quartz-2.2.1.jar:na] Caused by: java.lang.ClassNotFoundException: javax.portlet.PortletRequest at org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1719) ~[tomcat-catalina-7.0.52.jar:7.0.52] at org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1570) ~[tomcat-catalina-7.0.52.jar:7.0.52] ... 10 common frames omitted 17:00:56.771 [DefaultQuartzScheduler_Worker-1] ERROR ErrorLogger: Job (DEFAULT.2550db03-ba9b-49b0-9ce1-3b9c74e2582e threw an exception. org.quartz.SchedulerException: Job threw an unhandled exception. at org.quartz.core.JobRunShell.run(JobRunShell.java:213) ~[quartz-2.2.1.jar:na] at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:573) [quartz-2.2.1.jar:na] Caused by: java.lang.NoClassDefFoundError: javax/portlet/PortletRequest at org.gcube.portal.databook.server.RunningCluster.getConfigurationFromIS(RunningCluster.java:105) ~[social-data-indexer-se-plugin-1.2.0-4.4.0-144777-jar-with-dependencies.jar:na] at org.gcube.portal.databook.server.RunningCluster.<init>(RunningCluster.java:77) ~[social-data-indexer-se-plugin-1.2.0-4.4.0-144777-jar-with-dependencies.jar:na] at org.gcube.portal.databook.server.RunningCluster.getInstance(RunningCluster.java:68) ~[social-data-indexer-se-plugin-1.2.0-4.4.0-144777-jar-with-dependencies.jar:na] at org.gcube.portal.databook.server.CassandraClusterConnection.<init>(CassandraClusterConnection.java:104) ~[social-data-indexer-se-plugin-1.2.0-4.4.0-144777-jar-with-dependencies.jar:na] at org.gcube.portal.databook.server.DBCassandraAstyanaxImpl.<init>(DBCassandraAstyanaxImpl.java:202) ~[social-data-indexer-se-plugin-1.2.0-4.4.0-144777-jar-with-dependencies.jar:na] at org.gcube.socialnetworking.socialdataindexer.SocialDataIndexerPlugin.launch(SocialDataIndexerPlugin.java:86) ~[social-data-indexer-se-plugin-1.2.0-4.4.0-144777-jar-with-dependencies.jar:na] at org.gcube.vremanagement.executor.pluginmanager.RunnablePlugin.run(RunnablePlugin.java:114) ~[RunnablePlugin.class:na] at org.gcube.vremanagement.executor.scheduler.SmartExecutorTask.execute(SmartExecutorTask.java:252) ~[SmartExecutorTask.class:na] at org.quartz.core.JobRunShell.run(JobRunShell.java:202) ~[quartz-2.2.1.jar:na] ... 1 common frames omitted Caused by: java.lang.ClassNotFoundException: javax.portlet.PortletRequest at org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1719) ~[tomcat-catalina-7.0.52.jar:7.0.52] at org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1570) ~[tomcat-catalina-7.0.52.jar:7.0.52] ... 10 common frames omitted 17:00:56.772 [DefaultQuartzScheduler_Worker-1] DEBUG SmartExecutorTask: Job with ID 2550db03-ba9b-49b0-9ce1-3b9c74e2582e (iteration 1)terminated
- I've re-builded the artefact locally with snapshot dependencies and releases dependencies and both work ok
Updated by Roberto Cirillo about 8 years ago
- Status changed from In Progress to Feedback
- % Done changed from 0 to 100
The problem is due to a bad social-networking-library artifact released in 4.5.0 (version 1.15.0-4.5.0-142236). This library is not compatible with indexer plugin.
I've rebuilded the plugin forcing the old social-networking-library dependency and it works (now deployed on node22). Please check the social-networking-library released in 4.5.0
Updated by Roberto Cirillo about 8 years ago
- % Done changed from 100 to 50
I've tried to build the artifact from my eclipse and using only the gcore-staging repository and it also works with the last socialnetworking library so the problem is not the last version of socialnetworking library. From etics build I've the exception above from my eclipse it run properly.
Updated by Roberto Cirillo about 8 years ago
The dependency tree used in my local build is the following:
INFO] org.gcube.socialnetworking:social-data-indexer-se-plugin:jar:1.2.0-SNAPSHOT [INFO] +- javax.servlet:javax.servlet-api:jar:4.0.0-b05:provided [INFO] +- org.gcube.socialnetworking:social-data-indexing-common:jar:1.0.1-4.5.0-142325:compile [INFO] +- org.gcube.portal:social-networking-library:jar:1.15.0-4.5.0-142236:compile [INFO] +- org.elasticsearch:elasticsearch:jar:2.2.0:compile [INFO] | +- org.apache.lucene:lucene-core:jar:5.4.1:compile [INFO] | +- org.apache.lucene:lucene-backward-codecs:jar:5.4.1:compile [INFO] | +- org.apache.lucene:lucene-analyzers-common:jar:5.4.1:compile [INFO] | +- org.apache.lucene:lucene-queries:jar:5.4.1:compile [INFO] | +- org.apache.lucene:lucene-memory:jar:5.4.1:compile [INFO] | +- org.apache.lucene:lucene-highlighter:jar:5.4.1:compile [INFO] | +- org.apache.lucene:lucene-queryparser:jar:5.4.1:compile [INFO] | | \- org.apache.lucene:lucene-sandbox:jar:5.4.1:compile [INFO] | +- org.apache.lucene:lucene-suggest:jar:5.4.1:compile [INFO] | | \- org.apache.lucene:lucene-misc:jar:5.4.1:compile [INFO] | +- org.apache.lucene:lucene-join:jar:5.4.1:compile [INFO] | | \- org.apache.lucene:lucene-grouping:jar:5.4.1:compile [INFO] | +- org.apache.lucene:lucene-spatial:jar:5.4.1:compile [INFO] | | +- org.apache.lucene:lucene-spatial3d:jar:5.4.1:compile [INFO] | | \- com.spatial4j:spatial4j:jar:0.5:compile [INFO] | +- org.elasticsearch:securesm:jar:1.0:compile [INFO] | +- com.carrotsearch:hppc:jar:0.7.1:compile [INFO] | +- joda-time:joda-time:jar:2.8.2:compile [INFO] | +- org.joda:joda-convert:jar:1.2:compile [INFO] | +- com.fasterxml.jackson.core:jackson-core:jar:2.6.2:compile [INFO] | +- com.fasterxml.jackson.dataformat:jackson-dataformat-smile:jar:2.6.2:compile [INFO] | +- com.fasterxml.jackson.dataformat:jackson-dataformat-yaml:jar:2.6.2:compile [INFO] | | \- org.yaml:snakeyaml:jar:1.15:compile [INFO] | +- com.fasterxml.jackson.dataformat:jackson-dataformat-cbor:jar:2.6.2:compile [INFO] | +- io.netty:netty:jar:3.10.5.Final:compile [INFO] | +- com.tdunning:t-digest:jar:3.0:compile [INFO] | +- org.hdrhistogram:HdrHistogram:jar:2.1.6:compile [INFO] | +- commons-cli:commons-cli:jar:1.3.1:compile [INFO] | \- com.twitter:jsr166e:jar:1.1.0:compile [INFO] +- com.google.guava:guava:jar:18.0:provided [INFO] +- com.ning:compress-lzf:jar:1.0.3:compile [INFO] +- org.gcube.resources.discovery:ic-client:jar:1.0.3-4.5.0-142544:provided [INFO] | +- org.gcube.core:common-scope:jar:1.2.0-4.5.0-125717:provided [INFO] | | +- org.gcube.core:common-configuration-scanner:jar:1.0.0-4.5.0-144261:provided [INFO] | | \- org.gcube.core:common-scope-maps:jar:1.0.6-4.5.0-142513:provided [INFO] | +- org.gcube.resources.discovery:discovery-client:jar:1.0.1-4.5.0-125857:provided [INFO] | +- org.gcube.resources:common-gcore-resources:jar:1.3.3-4.5.0-144114:provided [INFO] | \- org.gcube.core:common-gcore-stubs:jar:1.2.2-4.5.0-132342:provided [INFO] | \- org.gcube.common:common-authorization:jar:2.0.2-4.5.0-144378:provided [INFO] +- org.gcube.common.portal:portal-manager:jar:1.2.0-4.0.0-125735:compile [INFO] | \- org.slf4j:slf4j-log4j12:jar:1.6.4:compile [INFO] | \- log4j:log4j:jar:1.2.16:compile [INFO] +- org.gcube.vremanagement:smart-executor-api:jar:1.5.0-4.5.0-144292:compile [INFO] | +- com.thoughtworks.xstream:xstream:jar:1.4.4:compile [INFO] | | +- xmlpull:xmlpull:jar:1.1.3.1:compile [INFO] | | \- xpp3:xpp3_min:jar:1.1.4c:compile [INFO] | +- org.quartz-scheduler:quartz:jar:2.2.1:compile [INFO] | | \- c3p0:c3p0:jar:0.9.1.1:compile [INFO] | +- com.fasterxml.jackson.core:jackson-databind:jar:2.6.0:compile [INFO] | \- com.fasterxml.jackson.core:jackson-annotations:jar:2.6.0:compile [INFO] +- org.slf4j:slf4j-api:jar:1.7.5:provided [INFO] +- com.netflix.astyanax:astyanax:jar:2.0.2:compile [INFO] | +- com.netflix.astyanax:astyanax-thrift:jar:2.0.2:compile [INFO] | | +- org.apache.thrift:libthrift:jar:0.7.0:compile [INFO] | | \- org.apache.cassandra:cassandra-thrift:jar:1.2.11:compile [INFO] | +- com.eaio.uuid:uuid:jar:3.2:compile [INFO] | +- commons-codec:commons-codec:jar:1.5:compile [INFO] | +- com.googlecode.concurrentlinkedhashmap:concurrentlinkedhashmap-lru:jar:1.3:compile [INFO] | +- com.netflix.astyanax:astyanax-cassandra:jar:2.0.2:compile [INFO] | | \- org.apache.servicemix.bundles:org.apache.servicemix.bundles.commons-csv:jar:1.0-r706900_3:compile [INFO] | +- com.netflix.astyanax:astyanax-core:jar:2.0.2:compile [INFO] | +- com.netflix.astyanax:astyanax-queue:jar:2.0.2:compile [INFO] | +- org.codehaus.jackson:jackson-mapper-asl:jar:1.9.2:compile [INFO] | +- com.netflix.astyanax:astyanax-contrib:jar:2.0.2:compile [INFO] | | +- com.netflix.eureka:eureka-client:jar:1.1.110:compile [INFO] | | | +- javax.ws.rs:jsr311-api:jar:1.1.1:compile [INFO] | | | +- com.netflix.servo:servo-core:jar:0.4.36:compile [INFO] | | | +- com.sun.jersey:jersey-bundle:jar:1.9.1:compile [INFO] | | | \- com.sun.jersey.contribs:jersey-apache-client4:jar:1.8:compile [INFO] | | | \- com.sun.jersey:jersey-client:jar:1.8:compile [INFO] | | | \- com.sun.jersey:jersey-core:jar:1.8:compile [INFO] | | \- com.netflix.archaius:archaius-core:jar:0.5.12:compile [INFO] | | +- commons-configuration:commons-configuration:jar:1.8:compile [INFO] | | \- com.google.code.findbugs:annotations:jar:2.0.0:compile [INFO] | +- com.netflix.astyanax:astyanax-entity-mapper:jar:2.0.2:compile [INFO] | | \- javax.persistence:persistence-api:jar:1.0:compile [INFO] | +- com.netflix.astyanax:astyanax-examples:jar:2.0.2:compile [INFO] | +- com.github.stephenc.high-scale-lib:high-scale-lib:jar:1.1.2:compile [INFO] | +- org.apache.cassandra:cassandra-all:jar:1.2.11:compile [INFO] | | +- net.jpountz.lz4:lz4:jar:1.1.0:compile [INFO] | | +- org.antlr:antlr:jar:3.2:compile [INFO] | | | \- org.antlr:antlr-runtime:jar:3.2:compile [INFO] | | | \- org.antlr:stringtemplate:jar:3.2:compile [INFO] | | | \- antlr:antlr:jar:2.7.7:compile [INFO] | | +- org.apache.cassandra.deps:avro:jar:1.4.0-cassandra-1:compile [INFO] | | | \- org.mortbay.jetty:jetty:jar:6.1.22:compile [INFO] | | | \- org.mortbay.jetty:jetty-util:jar:6.1.22:compile [INFO] | | +- jline:jline:jar:1.0:compile [INFO] | | +- com.googlecode.json-simple:json-simple:jar:1.1:compile [INFO] | | +- edu.stanford.ppl:snaptree:jar:0.1:compile [INFO] | | +- org.mindrot:jbcrypt:jar:0.3m:compile [INFO] | | +- com.yammer.metrics:metrics-core:jar:2.2.0:compile [INFO] | | \- com.github.stephenc:jamm:jar:0.2.5:compile [INFO] | +- com.netflix.astyanax:astyanax-test:jar:2.0.2:compile [INFO] | +- com.netflix.astyanax:astyanax-cql:jar:2.0.2:compile [INFO] | | \- com.datastax.cassandra:cassandra-driver-core:jar:2.0.3:compile [INFO] | | \- com.codahale.metrics:metrics-core:jar:3.0.2:compile [INFO] | +- org.xerial.snappy:snappy-java:jar:1.0.4.1:compile [INFO] | +- commons-lang:commons-lang:jar:2.4:compile [INFO] | +- org.codehaus.jackson:jackson-core-asl:jar:1.9.2:compile [INFO] | +- org.codehaus.jettison:jettison:jar:1.2:compile [INFO] | | \- stax:stax-api:jar:1.0.1:compile [INFO] | \- com.netflix.astyanax:astyanax-recipes:jar:2.0.2:compile [INFO] +- com.sun.mail:javax.mail:jar:1.6.0-rc1:compile [INFO] | \- javax.activation:activation:jar:1.1:compile [INFO] +- junit:junit:jar:4.11:test [INFO] | \- org.hamcrest:hamcrest-core:jar:1.3:test [INFO] \- org.apache.httpcomponents:httpclient:jar:4.3:compile [INFO] +- org.apache.httpcomponents:httpcore:jar:4.3:compile [INFO] \- commons-logging:commons-logging:jar:1.1.3:compile
Updated by Gabriele Giammatteo about 8 years ago
I see that you are using:
[INFO] +- org.gcube.common.portal:portal-manager:jar:1.2.0-4.0.0-125735:compile
while the portal-manager version in gCube 4.5.0 is 2.2.0. Could the problem be related to this difference?
Updated by Roberto Cirillo about 8 years ago
Gabriele Giammatteo wrote:
I see that you are using:
[INFO] +- org.gcube.common.portal:portal-manager:jar:1.2.0-4.0.0-125735:compilewhile the portal-manager version in gCube 4.5.0 is 2.2.0. Could the problem be related to this difference?
I think this is a good point.
I've found on social-indexer pom the following dep:
<dependency> <groupId>org.gcube.common.portal</groupId> <artifactId>portal-manager</artifactId> <version>[1.0.0-SNAPSHPT, 2.0.0-SNAPSHOT)</version> </dependency>
with a wrong snapshot string version
Updated by Roberto Cirillo about 8 years ago
@costantino.perciante@isti.cnr.it could you fix the version and check the range, please?
Updated by Costantino Perciante about 8 years ago
Ok, I've fixed the range and let etics build it. I've put it into node22 and now I get the same error (java.lang.NoClassDefFoundError: javax/portlet/PortletRequest), and that's ok. I will check what's the real problem now
Updated by Maria Di Girolamo about 8 years ago
- Blocks deleted (Task #8433: social-data-indexer-se-plugin service to test : node22.d4science.org)
Updated by Maria Di Girolamo about 8 years ago
- Related to Task #8433: social-data-indexer-se-plugin service to test : node22.d4science.org added
Updated by Costantino Perciante about 8 years ago
- Status changed from Feedback to Closed
- % Done changed from 50 to 100
Ok, I've fixed the pom.xml and added a couple more of dependencies. Now it is running ok on node22