Project

General

Profile

Actions

Incident #13215

closed

Some DataMiners not working in PerformFish-KPIs scope

Added by Gianpaolo Coro over 6 years ago. Updated about 6 years ago.

Status:
Closed
Priority:
Immediate
Category:
High-Throughput-Computing
Start date:
Jan 24, 2019
Due date:
% Done:

100%

Estimated time:
Infrastructure:
Production

Description

Some DataMiner instances in the dataminer.garr cluster are not working in the FARM/PerformFISH-KPIs VRE. They do not answer to specific requests of computations and to Get Capabilities calls.

This is one sample call in the mentioned VRE that sometimes fails:

http://dataminer.garr.d4science.org/wps/WebProcessingService?request=Execute&service=WPS&Version=1.0.0&gcube-token=c4431436-7859-4abe-a202-6eec9a34714f-843339462&lang=en-US&Identifier=org.gcube.dataanalysis.wps.statisticalmanager.synchserver.mappedclasses.transducerers.PERFORMFISH_DATA_VALIDATOR_V2&DataInputs=CompanyData=https%3A%2F%2Fdata.d4science.org%2Fshub%2Fee871665-1e7a-483d-ad75-969b196ebdee;Template=PRE_ONGROWING;Overwrite=true;LatestCompanyData=https%3A%2F%2Fdata.d4science.org%2Fshub%2Fee871665-1e7a-483d-ad75-969b196ebdee;

I have not identified the exact machines. The error I get is:

Error (500) : unexpected error
Stacktrace:
org.gcube.smartgears.handlers.application.request.RequestException: error contacting authorization service

Perhaps some DMs are not in that scope?


Files

ghn.log (68.3 KB) ghn.log Roberto Cirillo, Jan 28, 2019 04:13 PM
Screenshot 2019-02-04 at 11.01.34.png (102 KB) Screenshot 2019-02-04 at 11.01.34.png Massimiliano Assante, Feb 04, 2019 11:05 AM

Related issues

Related to D4Science Infrastructure - Incident #13265: StorageHub - Error in accessing to public linksClosedLucio LeliiFeb 04, 2019

Actions
Actions #1

Updated by Massimiliano Assante over 6 years ago

From the portlet on the tomcat log I can see the following:

2019-01-24 10:56:37,186 WARN performfish.SubmittedFormValidation [ajp-bio-8009-exec-22,sendGet:310] %10:56:37,186 WARN [ajp-bio-8009-exec-22][SubmittedFormValidation:310] response from Dataminer is empty or an error occurred, retry tentative: 4 of 3
2019-01-24 10:56:37,187 ERROR performfish.SubmittedFormValidation [ajp-bio-8009-exec-22,sendGet:311] %10:56:37,187 ERROR [ajp-bio-8009-exec-22][SubmittedFormValidation:311] here is the faulty response from Dataminer=Error (500) : unexpected errorStacktrace:org.gcube.smartgears.handlers.application.request.RequestException: error contacting authorization service at org.gcube.smartgears.handlers.application.request.RequestError.toException(RequestError.java:110) at org.gcube.smartgears.handlers.application.request.RequestError.fire(RequestError.java:94) at org.gcube.smartgears.handlers.application.request.RequestContextRetriever.retreiveAndSetInfo(RequestContextRetriever.java:80) at org.gcube.smartgears.handlers.application.request.RequestContextRetriever.handleRequest(RequestContextRetriever.java:56) at org.gcube.smartgears.handlers.application.RequestHandler.onEvent(RequestHandler.java:58) at org.gcube.smartgears.handlers.application.RequestHandler.onEvent(RequestHandler.java:21) at org.gcube.smartgears.handlers.Pipeline.forward(Pipeline.java:65) at org.gcube.smartgears.managers.RequestManager.doFilter(RequestManager.java:86) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:501) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:98) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950) at org.apache.catalina.valves.RemoteIpValve.invoke(RemoteIpValve.java:683) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1041) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:607) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:313) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)Error (500) : unexpected errorStacktrace:org.gcube.smartgears.handlers.application.request.RequestException: error contacting authorization service at org.gcube.smartgears.handlers.application.request.RequestError.toException(RequestError.java:110) at org.gcube.smartgears.handlers.application.request.RequestError.fire(RequestError.java:94) at org.gcube.smartgears.handlers.application.request.RequestContextRetriever.retreiveAndSetInfo(RequestContextRetriever.java:80) at org.gcube.smartgears.handlers.application.request.RequestContextRetriever.handleRequest(RequestContextRetriever.java:56) at org.gcube.smartgears.handlers.application.RequestHandler.onEvent(RequestHandler.java:58) at org.gcube.smartgears.handlers.application.RequestHandler.onEvent(RequestHandler.java:21) at org.gcube.smartgears.handlers.Pipeline.forward(Pipeline.java:65) at org.gcube.smartgears.managers.RequestManager.doFilter(RequestManager.java:86) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:501) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:98) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950) at org.apache.catalina.valves.RemoteIpValve.invoke(RemoteIpValve.java:683) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1041) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:607) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:313) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)<?xml version="1.0" encoding="UTF-8"?> ows:Identifierorg.gcube.dataanalysis.wps.statisticalmanager.synchserver.mappedclasses.transducerers.PERFORMFISH_DATA_VALIDATOR_V2/ows:Identifier ows:TitlePERFORMFISH_DATA_VALIDATOR_V2/ows:Title /wps:Process wps:ProcessSucceededProcess successful/wps:ProcessSucceeded /wps:Status wps:ProcessOutputs wps:Output ows:Identifiernon_deterministic_output/ows:Identifier ows:TitleNonDeterministicOutput/ows:Title wps:Data gml:featureMember d4science:Datahttp://data.d4science.org/QkNSaklYc2ZMcmZGbFkwMVF5dnBYSHYwblZ0Q09YOWxHbWJQNStIS0N6Yz0-VLT/d4science:Data d4science:DescriptionLog of the computation/d4science:Description d4science:MimeTypetext/csv/d4science:MimeType /ogr:Result d4science:Datahttp://data.d4science.org/QkNSaklYc2ZMcmZGbFkwMVF5dnBYQTBITXVnQXBranpHbWJQNStIS0N6Yz0-VLT/d4science:Data d4science:DescriptionValidationResult/d4science:Description d4science:MimeTypetext/csv/d4science:MimeType /ogr:Result /gml:featureMember /ogr:FeatureCollection /wps:ComplexData /wps:Data /wps:Output /wps:ProcessOutputs/wps:ExecuteResponse
[Fatal Error] :1:1: Content is not allowed in prolog.
org.xml.sax.SAXParseException; lineNumber: 1; columnNumber: 1; Content is not allowed in prolog.
at com.sun.org.apache.xerces.internal.parsers.DOMParser.parse(DOMParser.java:257)
at com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderImpl.parse(DocumentBuilderImpl.java:339)
at org.gcube.portlets.user.performfish.SubmittedFormValidation.parseResult(SubmittedFormValidation.java:254)
at org.gcube.portlets.user.performfish.SubmittedFormValidation.doWPSCallToDataMiner(SubmittedFormValidation.java:222)
at org.gcube.portlets.user.performfish.SubmittedFormValidation.serveResource(SubmittedFormValidation.java:152)
at com.liferay.portlet.FilterChainImpl.doFilter(FilterChainImpl.java:122)
at com.liferay.portlet.ScriptDataPortletFilter.doFilter(ScriptDataPortletFilter.java:82)
at com.liferay.portlet.FilterChainImpl.doFilter(FilterChainImpl.java:116)
at com.liferay.portal.kernel.portlet.PortletFilterUtil.doFilter(PortletFilterUtil.java:71)
at com.liferay.portal.kernel.servlet.PortletServlet.service(PortletServlet.java:112)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)

Actions #2

Updated by Andrea Dell'Amico over 6 years ago

From the errors that I see into the ghn.log file, it could be a registry problem. @roberto.cirillo@isti.cnr.it @lucio.lelii@isti.cnr.it are you able to check?

Actions #3

Updated by Roberto Cirillo over 6 years ago

  • Status changed from New to In Progress
  • Assignee changed from _InfraScience Systems Engineer to Roberto Cirillo

I'm going to check the logs.

Actions #4

Updated by Roberto Cirillo over 6 years ago

  • % Done changed from 0 to 40

The problem seems to be related to the dataminer service state on some instances deployed at garr.

2019-01-28 11:24:47,117 [catalina-exec-6] WARN  RequestValidator: rejecting call to DataMiner in invalid context /d4science.research-infrastructures.eu/FARM/PerformFISH-KPIs, allowed context are [/d4science.research-infrastructures.eu/D4OS, /d4science.research-infrastructures.eu/OpenAIRE, /d4science.research-infrastructures.eu/gCubeApps, /d4science.research-infrastructures.eu/D4Research, /d4science.research-infrastructures.eu/ParthenosVO]

and the container.xml contains the FARM scope.
For the moment I've found two VMs with the same problem:

dm-192-168-100-14
dm-192-168-100-7

I'm going to clean the state and retry

Actions #5

Updated by Roberto Cirillo over 6 years ago

  • Status changed from In Progress to Closed
  • % Done changed from 40 to 100

After the clean state I've seen the same problem on the log:

2019-01-28 14:43:05,955 [pool-9-thread-11] INFO  ScopedPublisherImpl: [UPDATE] call to registryPublisher upadate method on resource 465144c9-4867-49cc-86cf-49e71cc6301e in scope null with scopes [/d4science.research-infrastructures.eu/D4OS, /d4science.research-infrastructures.eu/SoBigData, /d4science.research-infrastructures.eu/gCubeApps, /d4science.research-infrastructures.eu/ParthenosVO, /d4science.research-infrastructures.eu/D4Research, /d4science.research-infrastructures.eu/SmartArea, /d4science.research-infrastructures.eu/OpenAIRE]
2019-01-28 14:42:33,302 [catalina-exec-6] WARN  RequestValidator: rejecting call to DataMiner in invalid context /d4science.research-infrastructures.eu/FARM/PerformFISH-KPIs, allowed context are [/d4science.research-infrastructures.eu/D4OS, /d4science.research-infrastructures.eu/SmartArea, /d4science.research-infrastructures.eu/OpenAIRE, /d4science.research-infrastructures.eu/gCubeApps, /d4science.research-infrastructures.eu/D4Research, /d4science.research-infrastructures.eu/ParthenosVO, /d4science.research-infrastructures.eu/SoBigData]

this means that the instance was no more running on FARM.
It's not clear to me but I think this happen when in initialization phase a registry instance or maybe the authorization instance is unreachable.

In attachment an extracted of ghn.log. The FARM scope after some exceptions (authorization and registry) disappears from the application scopes. I've solved the problem deleting again the container state and restarting the FARM registry instance.
@lucio.lelii@isti.cnr.it, @andrea.dellamico@isti.cnr.it any opinion? For the moment I'm going to close this incident.

Actions #6

Updated by Roberto Cirillo over 6 years ago

Actions #7

Updated by Gianpaolo Coro over 6 years ago

  • Status changed from Closed to In Progress

Unfortunately, this is happening again.

Actions #8

Updated by Gianpaolo Coro over 6 years ago

  • % Done changed from 100 to 0
Actions #9

Updated by Pasquale Pagano over 6 years ago

  • Priority changed from Urgent to Immediate
Actions #10

Updated by Roberto Cirillo about 6 years ago

Are you sure the error is the same?

Actions #11

Updated by Roberto Cirillo about 6 years ago

I've found another kind of error on the portal:

2019-01-30 18:00:56,617 ERROR performfish.SubmittedFormValidation [ajp-bio-8009-exec-81,sendGet:300] %18:00:56,617 ERROR [ajp-bio-8009-exec-81][SubmittedFormValidation:300] here is the faulty response from Dataminer=Error (500) : unexpected errorStacktrace:org.gcube.smartgears.handlers.application.request.RequestException: error contacting authorization service     at org.gcube.smartgears.handlers.application.request.RequestError.toException(RequestError.java:110)    at org.gcube.smartgears.handlers.application.request.RequestError.fire(RequestError.java:94)    at org.gcube.smartgears.handlers.application.request.RequestContextRetriever.retreiveAndSetInfo(RequestContextRetriever.java:80)        at org.gcube.smartgears.handlers.application.request.RequestContextRetriever.handleRequest(RequestContextRetriever.java:56)     at org.gcube.smartgears.handlers.application.RequestHandler.onEvent(RequestHandler.java:58)
     at org.gcube.smartgears.handlers.application.RequestHandler.onEvent(RequestHandler.java:21)     at org.gcube.smartgears.handlers.Pipeline.forward(Pipeline.java:65)     at org.gcube.smartgears.managers.RequestManager.doFilter(RequestManager.java:86)        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)    at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)  at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)  at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:501)       at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170)        at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:98) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950)    at org.apache.catalina.valves.RemoteIpValve.invoke(RemoteIpValve.java:683)      at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116)    at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408)  at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1041)  at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:607)      at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:313)     at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)      at java.lang.Thread.run(Thread.java:748)
2019-01-30 18:00:56,618 INFO  performfish.SubmittedFormValidation [ajp-bio-8009-exec-81,sendGet:279] %18:00:56,618 INFO  [ajp-bio-8009-exec-81][SubmittedFormValidation:279] request to=GET http://dataminer.garr.d4science.org/wps/WebProcessingService?request=Execute&service=WPS&Version=1.0.0&gcube-token=9c6711bc-e0ff-4968-9888-a51688ef510b-843339462&lang=en-US&Identifier=org.gcube.dataanalysis.wps.statisticalmanager.synchserver.mappedclasses.transducerers.PERFORMFISH_DATA_VALIDATOR_V2&DataInputs=CompanyData=http%3A%2F%2Fdata.d4science.org%2FaEZoNFFjOE9ON2VwSnJXbFUvbmdJSDM1YnF2TFEvU29HbWJQNStIS0N6Yz0;Template=GROW_OUT_AGGREGATED_CLOSED_BATCHES;Overwrite=false;LatestCompanyData=http%3A%2F%2Fdata.d4science.org%2FaEZoNFFjOE9ON2VwSnJXbFUvbmdJSDM1YnF2TFEvU29HbWJQNStIS0N6Yz0; HTTP/1.1

This seems to be a communication problem between dataminer instance (@garr) and authorization service (@cnr).

Actions #12

Updated by Roberto Cirillo about 6 years ago

@lucio.lelii@isti.cnr.it, @andrea.dellamico@isti.cnr.it any opinion?

Actions #13

Updated by Andrea Dell'Amico about 6 years ago

It happens sometimes, when they happen at tomcat startup time the container fails the deploy so it's automatically restarted by the nagios handler or the problem is notified. If it happens at runtime, I don't know what the behaviour is. The service still answers correctly to the checks, so we do not get anything in the monitoring system.

Actions #14

Updated by Lucio Lelii about 6 years ago

I agree with Roberto, if it happens randomly it is a comunication problem

Actions #16

Updated by Massimiliano Assante about 6 years ago

as of today the DataMiner in this scope is still not working ...

Actions #17

Updated by Roberto Cirillo about 6 years ago

Massimiliano Assante wrote:

as of today the DataMiner in this scope is still not working ...

@massimiliano.assante@isti.cnr.it please, could you check the portal logs and report the exception here?

Actions #18

Updated by Massimiliano Assante about 6 years ago

Roberto Cirillo wrote:

Massimiliano Assante wrote:

as of today the DataMiner in this scope is still not working ...

@massimiliano.assante@isti.cnr.it please, could you check the portal logs and report the exception here?

Can't help today sorry, i'm abroad and in a working meeting. The logs are located either in infra-gateway or infra-gateway1 tomcat catalina.out. @gianpaolo.coro@isti.cnr.it can help in reproducing the issue as he can submit forms and other algorithms in that scope.

Actions #19

Updated by Roberto Cirillo about 6 years ago

Massimiliano Assante wrote:

Roberto Cirillo wrote:

Massimiliano Assante wrote:

as of today the DataMiner in this scope is still not working ...

@massimiliano.assante@isti.cnr.it please, could you check the portal logs and report the exception here?

Can't help today sorry, i'm abroad and in a working meeting. The logs are located either in infra-gateway or infra-gateway1 tomcat catalina.out. @gianpaolo.coro@isti.cnr.it can help in reproducing the issue as he can submit forms and other algorithms in that scope.

Now the problem should be solved. The problem was due to a public link problem as reported here: #13265
I'm going to close this ticket

Actions #20

Updated by Roberto Cirillo about 6 years ago

  • Related to Incident #13265: StorageHub - Error in accessing to public links added
Actions #21

Updated by Roberto Cirillo about 6 years ago

  • Status changed from In Progress to Closed
  • % Done changed from 0 to 100
Actions #22

Updated by Massimiliano Assante about 6 years ago

  • Status changed from Closed to In Progress
  • % Done changed from 100 to 0

Right now no instance at all seem working in this scope. The exception looks different though, it says Exception exceptionCode="NoApplicableCode"

2019-02-04 17:04:54,059 INFO  performfish.SubmittedFormValidation [ajp-bio-8009-exec-5,doWPSCallToDataMiner:205] %17:04:54,059 INFO  [ajp-bio-8009-exec-5][SubmittedFormValidation:205] got DataMiner instance=http://dataminer.garr.d4science.org/wps/WebProcessingService
2019-02-04 17:04:54,060 INFO  performfish.SubmittedFormValidation [ajp-bio-8009-exec-5,doWPSCallToDataMiner:208] %17:04:54,060 INFO  [ajp-bio-8009-exec-5][SubmittedFormValidation:208] inputFileLink at: http%3A%2F%2Fdata.d4science.org%2FNUw4b2I5cExoNTNkQXdDUnlSS0JkUUxxcXl0VEtxbzdHbWJQNStIS0N6Yz0
2019-02-04 17:04:54,062 INFO  performfish.SubmittedFormValidation [ajp-bio-8009-exec-5,sendGet:279] %17:04:54,062 INFO  [ajp-bio-8009-exec-5][SubmittedFormValidation:279] request to=GET http://dataminer.garr.d4science.org/wps/WebProcessingService?request=Execute&service=WPS&Version=1.0.0&gcube-token=9c6711bc-e0ff-4968-9888-a51688ef510b-843339462&lang=en-US&Identifier=org.gcube.dataanalysis.wps.statisticalmanager.synchserver.mappedclasses.transducerers.PERFORMFISH_DATA_VALIDATOR_V2&DataInputs=CompanyData=http%3A%2F%2Fdata.d4science.org%2FNUw4b2I5cExoNTNkQXdDUnlSS0JkUUxxcXl0VEtxbzdHbWJQNStIS0N6Yz0;Template=PRE_ONGROWING_CLOSED_BATCHES;Overwrite=false;LatestCompanyData=http%3A%2F%2Fdata.d4science.org%2FNUw4b2I5cExoNTNkQXdDUnlSS0JkUUxxcXl0VEtxbzdHbWJQNStIS0N6Yz0; HTTP/1.1
2019-02-04 17:04:54,861 INFO  performfish.SubmittedFormValidation [ajp-bio-8009-exec-5,doWPSCallToDataMiner:212] %17:04:54,861 INFO  [ajp-bio-8009-exec-5][SubmittedFormValidation:212] PARSED OK resultFileURL: <ExceptionReport version="1.0.0">  <Exception exceptionCode="NoApplicableCode">    <ExceptionText>Error while executing the embedded process for: org.gcube.dataanalysis.wps.statisticalmanager.synchserver.mappedclasses.transducerers.PERFORMFISH_DATA_VALIDATOR_V2</ExceptionText>  </Exception>  <Exception exceptionCode="JAVA_StackTrace">    <ExceptionText>org.n52.wps.server.ExceptionReport: Error while executing the embedded process for: org.gcube.dataanalysis.wps.statisticalmanager.synchserver.mappedclasses.transducerers.PERFORMFISH_DATA_VALIDATOR_V2 at org.gcube.data.analysis.wps.ExecuteRequest.call(ExecuteRequest.java:646) at org.gcube.data.analysis.wps.ExecuteRequest.call(ExecuteRequest.java:68)  at org.gcube.common.authorization.library.AuthorizedTasks$1.call(AuthorizedTasks.java:41)   at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)  at java.lang.Thread.run(Thread.java:748)Caused by: java.lang.RuntimeException: http://data.d4science.org/NUw4b2I5cExoNTNkQXdDUnlSS0JkUUxxcXl0VEtxbzdHbWJQNStIS0N6Yz0    at org.n52.wps.algorithm.annotation.AnnotationBinding$ExecuteMethodBinding.execute(AnnotationBinding.java:96)   at org.n52.wps.server.AbstractAnnotatedAlgorithm.run(AbstractAnnotatedAlgorithm.java:54)    at org.gcube.data.analysis.wps.ExecuteRequest.call(ExecuteRequest.java:615) ... 6 moreCaused by: java.io.FileNotFoundException: http://data.d4science.org/NUw4b2I5cExoNTNkQXdDUnlSS0JkUUxxcXl0VEtxbzdHbWJQNStIS0N6Yz0   at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1872) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1474)  at org.gcube.dataanalysis.wps.statisticalmanager.synchserver.mapping.InputsManager.getLocalFiles(InputsManager.java:246)    at org.gcube.dataanalysis.wps.statisticalmanager.synchserver.mapping.InputsManager.mergeWpsAndEcologicalInputs(InputsManager.java:123)  at org.gcube.dataanalysis.wps.statisticalmanager.synchserver.mapping.AbstractEcologicalEngineMapper.run(AbstractEcologicalEngineMapper.java:401)    at org.gcube.dataanalysis.wps.statisticalmanager.synchserver.mappedclasses.transducerers.PERFORMFISH_DATA_VALIDATOR_V2.run(PERFORMFISH_DATA_VALIDATOR_V2.java:30)   at sun.reflect.GeneratedMethodAccessor138.invoke(Unknown Source)    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)    at java.lang.reflect.Method.invoke(Method.java:498) at org.n52.wps.algorithm.annotation.AnnotationBinding$ExecuteMethodBinding.execute(AnnotationBinding.java:89)   ... 8 more</ExceptionText>  </Exception>  <Exception exceptionCode="JAVA_RootCause">    <ExceptionText>http://data.d4science.org/NUw4b2I5cExoNTNkQXdDUnlSS0JkUUxxcXl0VEtxbzdHbWJQNStIS0N6Yz0</ExceptionText>    <ExceptionText>java.lang.RuntimeException: http://data.d4science.org/NUw4b2I5cExoNTNkQXdDUnlSS0JkUUxxcXl0VEtxbzdHbWJQNStIS0N6Yz0    at org.n52.wps.algorithm.annotation.AnnotationBinding$ExecuteMethodBinding.execute(AnnotationBinding.java:96)   at org.n52.wps.server.AbstractAnnotatedAlgorithm.run(AbstractAnnotatedAlgorithm.java:54)    at org.gcube.data.analysis.wps.ExecuteRequest.call(ExecuteRequest.java:615) at org.gcube.data.analysis.wps.ExecuteRequest.call(ExecuteRequest.java:68)  at org.gcube.common.authorization.library.AuthorizedTasks$1.call(AuthorizedTasks.java:41)   at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)  at java.lang.Thread.run(Thread.java:748)Caused by: java.io.FileNotFoundException: http://data.d4science.org/NUw4b2I5cExoNTNkQXdDUnlSS0JkUUxxcXl0VEtxbzdHbWJQNStIS0N6Yz0 at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1872) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1474)  at org.gcube.dataanalysis.wps.statisticalmanager.synchserver.mapping.InputsManager.getLocalFiles(InputsManager.java:246)    at org.gcube.dataanalysis.wps.statisticalmanager.synchserver.mapping.InputsManager.mergeWpsAndEcologicalInputs(InputsManager.java:123)  at org.gcube.dataanalysis.wps.statisticalmanager.synchserver.mapping.AbstractEcologicalEngineMapper.run(AbstractEcologicalEngineMapper.java:401)    at org.gcube.dataanalysis.wps.statisticalmanager.synchserver.mappedclasses.transducerers.PERFORMFISH_DATA_VALIDATOR_V2.run(PERFORMFISH_DATA_VALIDATOR_V2.java:30)   at sun.reflect.GeneratedMethodAccessor138.invoke(Unknown Source)    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)    at java.lang.reflect.Method.invoke(Method.java:498) at org.n52.wps.algorithm.annotation.AnnotationBinding$ExecuteMethodBinding.execute(AnnotationBinding.java:89)   ... 8 more</ExceptionText>  </Exception></ExceptionReport>
java.net.MalformedURLException: no protocol: <ExceptionReport version="1.0.0">  <Exception exceptionCode="NoApplicableCode">    <ExceptionText>Error while executing the embedded process for: org.gcube.dataanalysis.wps.statisticalmanager.synchserver.mappedclasses.transducerers.PERFORMFISH_DATA_VALIDATOR_V2</ExceptionText>  </Exception>  <Exception exceptionCode="JAVA_StackTrace">    <ExceptionText>org.n52.wps.server.ExceptionReport: Error while executing the embedded process for: org.gcube.dataanalysis.wps.statisticalmanager.synchserver.mappedclasses.transducerers.PERFORMFISH_DATA_VALIDATOR_V2 at org.gcube.data.analysis.wps.ExecuteRequest.call(ExecuteRequest.java:646) at org.gcube.data.analysis.wps.ExecuteRequest.call(ExecuteRequest.java:68)  at org.gcube.common.authorization.library.AuthorizedTasks$1.call(AuthorizedTasks.java:41)   at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)  at java.lang.Thread.run(Thread.java:748)Caused by: java.lang.RuntimeException: http://data.d4science.org/NUw4b2I5cExoNTNkQXdDUnlSS0JkUUxxcXl0VEtxbzdHbWJQNStIS0N6Yz0    at org.n52.wps.algorithm.annotation.AnnotationBinding$ExecuteMethodBinding.execute(AnnotationBinding.java:96)   at org.n52.wps.server.AbstractAnnotatedAlgorithm.run(AbstractAnnotatedAlgorithm.java:54)    at org.gcube.data.analysis.wps.ExecuteRequest.call(ExecuteRequest.java:615) ... 6 moreCaused by: java.io.FileNotFoundException: http://data.d4science.org/NUw4b2I5cExoNTNkQXdDUnlSS0JkUUxxcXl0VEtxbzdHbWJQNStIS0N6Yz0   at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1872) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1474)  at org.gcube.dataanalysis.wps.statisticalmanager.synchserver.mapping.InputsManager.getLocalFiles(InputsManager.java:246)    at org.gcube.dataanalysis.wps.statisticalmanager.synchserver.mapping.InputsManager.mergeWpsAndEcologicalInputs(InputsManager.java:123)  at org.gcube.dataanalysis.wps.statisticalmanager.synchserver.mapping.AbstractEcologicalEngineMapper.run(AbstractEcologicalEngineMapper.java:401)    at org.gcube.dataanalysis.wps.statisticalmanager.synchserver.mappedclasses.transducerers.PERFORMFISH_DATA_VALIDATOR_V2.run(PERFORMFISH_DATA_VALIDATOR_V2.java:30)   at sun.reflect.GeneratedMethodAccessor138.invoke(Unknown Source)    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)    at java.lang.reflect.Method.invoke(Method.java:498) at org.n52.wps.algorithm.annotation.AnnotationBinding$ExecuteMethodBinding.execute(AnnotationBinding.java:89)   ... 8 more</ExceptionText>  </Exception>  <Exception exceptionCode="JAVA_RootCause">    <ExceptionText>http://data.d4science.org/NUw4b2I5cExoNTNkQXdDUnlSS0JkUUxxcXl0VEtxbzdHbWJQNStIS0N6Yz0</ExceptionText>    <ExceptionText>java.lang.RuntimeException: http://data.d4science.org/NUw4b2I5cExoNTNkQXdDUnlSS0JkUUxxcXl0VEtxbzdHbWJQNStIS0N6Yz0    at org.n52.wps.algorithm.annotation.AnnotationBinding$ExecuteMethodBinding.execute(AnnotationBinding.java:96)   at org.n52.wps.server.AbstractAnnotatedAlgorithm.run(AbstractAnnotatedAlgorithm.java:54)    at org.gcube.data.analysis.wps.ExecuteRequest.call(ExecuteRequest.java:615) at org.gcube.data.analysis.wps.ExecuteRequest.call(ExecuteRequest.java:68)  at org.gcube.common.authorization.library.AuthorizedTasks$1.call(AuthorizedTasks.java:41)   at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)  at java.lang.Thread.run(Thread.java:748)Caused by: java.io.FileNotFoundException: http://data.d4science.org/NUw4b2I5cExoNTNkQXdDUnlSS0JkUUxxcXl0VEtxbzdHbWJQNStIS0N6Yz0 at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1872) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1474)  at org.gcube.dataanalysis.wps.statisticalmanager.synchserver.mapping.InputsManager.getLocalFiles(InputsManager.java:246)    at org.gcube.dataanalysis.wps.statisticalmanager.synchserver.mapping.InputsManager.mergeWpsAndEcologicalInputs(InputsManager.java:123)  at org.gcube.dataanalysis.wps.statisticalmanager.synchserver.mapping.AbstractEcologicalEngineMapper.run(AbstractEcologicalEngineMapper.java:401)    at org.gcube.dataanalysis.wps.statisticalmanager.synchserver.mappedclasses.transducerers.PERFORMFISH_DATA_VALIDATOR_V2.run(PERFORMFISH_DATA_VALIDATOR_V2.java:30)   at sun.reflect.GeneratedMethodAccessor138.invoke(Unknown Source)    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)    at java.lang.reflect.Method.invoke(Method.java:498) at org.n52.wps.algorithm.annotation.AnnotationBinding$ExecuteMethodBinding.execute(AnnotationBinding.java:89)   ... 8 more</ExceptionText>  </Exception></ExceptionReport>
    at java.net.URL.<init>(URL.java:593)
    at java.net.URL.<init>(URL.java:490)
    at java.net.URL.<init>(URL.java:439)
    at org.gcube.portlets.user.performfish.SubmittedFormValidation.doWPSCallToDataMiner(SubmittedFormValidation.java:214)
    at org.gcube.portlets.user.performfish.SubmittedFormValidation.serveResource(SubmittedFormValidation.java:141)
    at com.liferay.portlet.FilterChainImpl.doFilter(FilterChainImpl.java:122)
    at com.liferay.portlet.ScriptDataPortletFilter.doFilter(ScriptDataPortletFilter.java:82)
    at com.liferay.portlet.FilterChainImpl.doFilter(FilterChainImpl.java:116)
    at com.liferay.portal.kernel.portlet.PortletFilterUtil.doFilter(PortletFilterUtil.java:71)
    at com.liferay.portal.kernel.servlet.PortletServlet.service(PortletServlet.java:112)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
    at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
    at com.liferay.portal.kernel.servlet.filters.invoker.InvokerFilterChain.doFilter(InvokerFilterChain.java:116)
    at com.liferay.portal.kernel.servlet.filters.invoker.InvokerFilter.doFilter(InvokerFilter.java:119)
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
    at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:748)
    at org.apache.catalina.core.ApplicationDispatcher.processRequest(ApplicationDispatcher.java:486)
    at org.apache.catalina.core.ApplicationDispatcher.doForward(ApplicationDispatcher.java:411)
    at org.apache.catalina.core.ApplicationDispatcher.forward(ApplicationDispatcher.java:338)
    at com.liferay.portlet.InvokerPortletImpl.invoke(InvokerPortletImpl.java:580)
    at com.liferay.portlet.InvokerPortletImpl.invokeResource(InvokerPortletImpl.java:675)
    at com.liferay.portlet.InvokerPortletImpl.serveResource(InvokerPortletImpl.java:441)
    at com.liferay.portlet.PortletContainerImpl._doServeResource(PortletContainerImpl.java:775)
    at com.liferay.portlet.PortletContainerImpl.serveResource(PortletContainerImpl.java:149)
    at com.liferay.portlet.SecurityPortletContainerWrapper.serveResource(SecurityPortletContainerWrapper.java:166)
    at com.liferay.portlet.RestrictPortletContainerWrapper.serveResource(RestrictPortletContainerWrapper.java:166)
    at com.liferay.portal.kernel.portlet.PortletContainerUtil.serveResource(PortletContainerUtil.java:164)
    at com.liferay.portal.action.LayoutAction.processLayout(LayoutAction.java:394)
    at com.liferay.portal.action.LayoutAction.doExecute(LayoutAction.java:200)
    at com.liferay.portal.action.LayoutAction.execute(LayoutAction.java:95)
    at org.apache.struts.action.RequestProcessor.processActionPerform(RequestProcessor.java:431)
    at org.apache.struts.action.RequestProcessor.process(RequestProcessor.java:236)
    at com.liferay.portal.struts.PortalRequestProcessor.process(PortalRequestProcessor.java:168)
    at org.apache.struts.action.ActionServlet.process(ActionServlet.java:1196)
    at org.apache.struts.action.ActionServlet.doPost(ActionServlet.java:432)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:650)
    at com.liferay.portal.servlet.MainServlet.callParentService(MainServlet.java:557)
Actions #23

Updated by Massimiliano Assante about 6 years ago

@g.panichi@isti.cnr.it what about exceptionCode="NoApplicableCode"? What Does this mean

Actions #24

Updated by Giancarlo Panichi about 6 years ago

Hi @massimiliano.assante@isti.cnr.it , there is always a public link problem regarding the volatile area. For example:

https://data.d4science.org/S3hTWWlMa2t4WXRLaHZQWXRlaG54Q1Y4YzFEQzBEVTBHbWJQNStIS0N6Yz0-VLT

Actions #26

Updated by Andrea Dell'Amico about 6 years ago

  • % Done changed from 0 to 100

Does the solution to #13267 fixes the dataminers?

Actions #27

Updated by Roberto Cirillo about 6 years ago

  • Status changed from In Progress to Feedback
  • Assignee changed from Roberto Cirillo to Massimiliano Assante
Actions #29

Updated by Massimiliano Assante about 6 years ago

  • Assignee changed from Massimiliano Assante to Gianpaolo Coro

cannot test it today nor tomorrow, reassigning to GP

Actions #30

Updated by Gianpaolo Coro about 6 years ago

  • Status changed from Feedback to Resolved

I have tested in the PF-KPIs VRE with all test files and it worked.

Actions #31

Updated by Roberto Cirillo about 6 years ago

  • Status changed from Resolved to Closed
Actions

Also available in: Atom PDF

Add picture from clipboard (Maximum size: 8.91 MB)