Project

General

Profile

Actions

Bug #12036

closed

Error while updating GRSF records

Added by Yannis Marketakis almost 7 years ago. Updated almost 7 years ago.

Status:
Closed
Priority:
Normal
Assignee:
Target version:
-
Start date:
Jun 26, 2018
Due date:
% Done:

100%

Estimated time:

Description

The following error occurred while updating several GRSF records (around 100 of them failed)

java.lang.Exception: Method failed: HTTP/1.1 500 Internal Server Error; Response body: {"id":null,"knowledge_base_id":null,"product_url":null,"error":"You are not authorized to create a product. Please check you have the Catalogue-Administrator role!"}
at gr.forth.ics.isl.grsfservicescore.GrsfPublisher.updateRecord(GrsfPublisher.java:151)
at gr.forth.ics.isl.grsfservicescore.clients.UpdateClient.updateRecords(UpdateClient.java:631)
at gr.forth.ics.isl.grsfservicescore.clients.UpdateClient.updateGrsfStocks(UpdateClient.java:219)
at gr.forth.ics.isl.grsfservicescore.clients.UpdateClient.main(UpdateClient.java:773)
2018-06-25 13:59:52 ERROR UpdateClient:644 - An error occured while re-publishing stock records for grsf
gr.forth.ics.isl.grsfservicescore.exception.GrsfPublishingException: Fatal transport error
at gr.forth.ics.isl.grsfservicescore.GrsfPublisher.updateRecord(GrsfPublisher.java:161)
at gr.forth.ics.isl.grsfservicescore.clients.UpdateClient.updateRecords(UpdateClient.java:631)
at gr.forth.ics.isl.grsfservicescore.clients.UpdateClient.updateGrsfStocks(UpdateClient.java:219)
at gr.forth.ics.isl.grsfservicescore.clients.UpdateClient.main(UpdateClient.java:773)
Caused by: java.lang.Exception: Method failed: HTTP/1.1 500 Internal Server Error; Response body: {"id":null,"knowledge_base_id":null,"product_url":null,"error":"You are not authorized to create a product. Please check you have the Catalogue-Administrator role!"}
at gr.forth.ics.isl.grsfservicescore.GrsfPublisher.updateRecord(GrsfPublisher.java:151)
... 3 more


Files


Related issues

Related to StocksAndFisheriesKB - Task #11973: Please start the submission of GRSF from Knowledge base.ClosedYannis MarketakisJun 18, 2018

Actions
Related to D4Science Infrastructure - Task #11982: Increase RAM on ckan-grsf-admin2.d4science.orgClosed_InfraScience Systems EngineerJun 19, 2018

Actions
Actions #1

Updated by Yannis Marketakis almost 7 years ago

  • Related to Task #11973: Please start the submission of GRSF from Knowledge base. added
Actions #2

Updated by Luca Frosini almost 7 years ago

Can you please provide me the json of the records you want to update?

Can you also provide me your token (via another private channel)

Actions #3

Updated by Yannis Marketakis almost 7 years ago

Attached you will find an indicative record that had failed.

FYI: I managed to update ~ 2000 GRSF records and ~ 100 failed to update

I'm sending you my token on skype

Actions #4

Updated by Luca Frosini almost 7 years ago

  • Status changed from New to In Progress

@marketak@ics.forth.gr told me that it works on retrying. Maybe this is related to the provided hardware resources.

Actions #5

Updated by Luca Frosini almost 7 years ago

  • Related to Incident #12043: ckan-grsf-admin2: more memory is needed added
Actions #6

Updated by Luca Frosini almost 7 years ago

  • Related to deleted (Incident #12043: ckan-grsf-admin2: more memory is needed)
Actions #7

Updated by Luca Frosini almost 7 years ago

  • Related to Task #11982: Increase RAM on ckan-grsf-admin2.d4science.org added
Actions #8

Updated by Luca Frosini almost 7 years ago

  • Status changed from In Progress to Paused

Maybe this issue is related with the HW resources which during massive submission are very stressed.
I'm pausing the ticket so we already have it for next publishing if it happens again.

Actions #9

Updated by Luca Frosini almost 7 years ago

Please note that the creation/update of attached resources (the files) is an asynchronous task, so even you serialize the requests the service, as well as CKAN are still working to complete the previous request.

Actions #11

Updated by Yannis Marketakis almost 7 years ago

I think that it is hard to reproduce the same problem.
It only appeared within a 5-minute window during the update GRSF records process (that lasted approximately 4 hours).

Therefore if it is OK, I can try to update the missing errors (~ 100)

Actions #12

Updated by Yannis Marketakis almost 7 years ago

I confirm that I managed to update the problematic records without any issues

Actions #13

Updated by Luca Frosini almost 7 years ago

  • Status changed from Paused to Closed
  • % Done changed from 0 to 100

I'm going to close this ticket. We will reopen a new one if it happens again. Thank a lot @marketak@ics.forth.gr

Actions #14

Updated by Yannis Marketakis almost 7 years ago

I agree! Thanks for your support!

Actions #15

Updated by Luca Frosini almost 7 years ago

  • Project changed from 8 to StocksAndFisheriesKB
  • Category deleted (Default)
  • Target version deleted (Unsprintable )
Actions #16

Updated by Luca Frosini almost 7 years ago

  • Tracker changed from Task to Bug
Actions

Also available in: Atom PDF

Add picture from clipboard (Maximum size: 8.91 MB)