Incident #4200
closedIS not responding
100%
Description
The IS/Registry is not responding on https://dev.d4science.org/web/guest/monitor
This is needed to add and manage the many requests for algorithms integration that arrive every day.
Updated by Roberto Cirillo almost 10 years ago
- Status changed from New to In Progress
- % Done changed from 0 to 100
The problem seems to be the same happened in production: a memory leak on accounting libs.
There were a lot of accounting exceptions but I cannot see the cause because the log level was set to ERROR:
2016-06-01 18:02:35,843 ERROR persistence.PersistenceBackendConfiguration [pool-1017-thread-1,getInstance:57] AccountingPersistenceConfiguration not initialized correctly. It will not be used. Trying the next one if any.
java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedConstructorAccessor123.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
at org.gcube.documentstore.persistence.PersistenceBackendConfiguration.getInstance(PersistenceBackendConfiguration.java:51)
at org.gcube.documentstore.persistence.PersistenceBackendFactory.discoverPersistenceBackend(PersistenceBackendFactory.java:117)
at org.gcube.documentstore.persistence.PersistenceBackendFactory.rediscoverPersistenceBackend(PersistenceBackendFactory.java:169)
at org.gcube.documentstore.persistence.PersistenceBackendRediscover.run(PersistenceBackendRediscover.java:38)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
Caused by: java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
at java.util.ArrayList.rangeCheck(ArrayList.java:635)
at java.util.ArrayList.get(ArrayList.java:411)
at org.gcube.accounting.persistence.AccountingPersistenceConfiguration.getServiceEndpoint(AccountingPersistenceConfiguration.java:68)
at org.gcube.accounting.persistence.AccountingPersistenceConfiguration.<init>(AccountingPersistenceConfiguration.java:42)
... 14 more
I've restarted the container with the log level set to debug. Now the IS-Collector is up and running but it's need to monitoring this container because the problem is not solved. I guess there are several VRE scope without accounting service endpoint that cause a memory leak in accounting lib.
Updated by Roberto Cirillo almost 10 years ago
- Status changed from In Progress to Resolved
Updated by Gianpaolo Coro almost 10 years ago
- Status changed from Resolved to In Progress
The problem is again there, just after few minutes.
The devsec environment has never worked, instead.
Updated by Roberto Cirillo almost 10 years ago
- Status changed from In Progress to Feedback
Could you give me more details, please?
From monitor I see that the IS-Collector is working and also the registry service. In addition the ghn containers are correctly updated
https://preprod.d4science.org/web/guest/monitor https://dev.d4science.org/web/guest/monitor
Updated by Gianpaolo Coro almost 10 years ago
- Status changed from Feedback to Closed
- % Done changed from 0 to 100
it seems to be working now, but just after a restart of the portal. I don't know if this is related.
Updated by Pasquale Pagano over 9 years ago
- Target version deleted (
gCube related support)