Bug #12036
closed
Error while updating GRSF records
Added by Yannis Marketakis almost 7 years ago.
Updated almost 7 years ago.
Description
The following error occurred while updating several GRSF records (around 100 of them failed)
java.lang.Exception: Method failed: HTTP/1.1 500 Internal Server Error; Response body: {"id":null,"knowledge_base_id":null,"product_url":null,"error":"You are not authorized to create a product. Please check you have the Catalogue-Administrator role!"}
at gr.forth.ics.isl.grsfservicescore.GrsfPublisher.updateRecord(GrsfPublisher.java:151)
at gr.forth.ics.isl.grsfservicescore.clients.UpdateClient.updateRecords(UpdateClient.java:631)
at gr.forth.ics.isl.grsfservicescore.clients.UpdateClient.updateGrsfStocks(UpdateClient.java:219)
at gr.forth.ics.isl.grsfservicescore.clients.UpdateClient.main(UpdateClient.java:773)
2018-06-25 13:59:52 ERROR UpdateClient:644 - An error occured while re-publishing stock records for grsf
gr.forth.ics.isl.grsfservicescore.exception.GrsfPublishingException: Fatal transport error
at gr.forth.ics.isl.grsfservicescore.GrsfPublisher.updateRecord(GrsfPublisher.java:161)
at gr.forth.ics.isl.grsfservicescore.clients.UpdateClient.updateRecords(UpdateClient.java:631)
at gr.forth.ics.isl.grsfservicescore.clients.UpdateClient.updateGrsfStocks(UpdateClient.java:219)
at gr.forth.ics.isl.grsfservicescore.clients.UpdateClient.main(UpdateClient.java:773)
Caused by: java.lang.Exception: Method failed: HTTP/1.1 500 Internal Server Error; Response body: {"id":null,"knowledge_base_id":null,"product_url":null,"error":"You are not authorized to create a product. Please check you have the Catalogue-Administrator role!"}
at gr.forth.ics.isl.grsfservicescore.GrsfPublisher.updateRecord(GrsfPublisher.java:151)
... 3 more
Files
- Related to Task #11973: Please start the submission of GRSF from Knowledge base. added
Can you please provide me the json of the records you want to update?
Can you also provide me your token (via another private channel)
Attached you will find an indicative record that had failed.
FYI: I managed to update ~ 2000 GRSF records and ~ 100 failed to update
I'm sending you my token on skype
- Status changed from New to In Progress
@marketak@ics.forth.gr told me that it works on retrying. Maybe this is related to the provided hardware resources.
- Related to deleted (Incident #12043: ckan-grsf-admin2: more memory is needed)
- Related to Task #11982: Increase RAM on ckan-grsf-admin2.d4science.org added
- Status changed from In Progress to Paused
Maybe this issue is related with the HW resources which during massive submission are very stressed.
I'm pausing the ticket so we already have it for next publishing if it happens again.
Please note that the creation/update of attached resources (the files) is an asynchronous task, so even you serialize the requests the service, as well as CKAN are still working to complete the previous request.
I think that it is hard to reproduce the same problem.
It only appeared within a 5-minute window during the update GRSF records process (that lasted approximately 4 hours).
Therefore if it is OK, I can try to update the missing errors (~ 100)
I confirm that I managed to update the problematic records without any issues
- Status changed from Paused to Closed
- % Done changed from 0 to 100
I'm going to close this ticket. We will reopen a new one if it happens again. Thank a lot @marketak@ics.forth.gr
I agree! Thanks for your support!
- Project changed from 8 to StocksAndFisheriesKB
- Category deleted (
Default)
- Target version deleted (
Unsprintable )
- Tracker changed from Task to Bug
Also available in: Atom
PDF