StocksAndFisheriesKB

I found that the same issue occurs for many fishery records (more than 1000).
Some indicative ones are:

• http://data.d4science.org/ctlg/GRSF_Admin/c82b4687-a8d6-3287-89c0-12ed87ade577 (it should contain NEFMC)
• http://data.d4science.org/ctlg/GRSF_Admin/af4f624b-7623-3fae-8d3f-2fadfb71b4a2 (it should contain ASMFC
• http://data.d4science.org/ctlg/GRSF_Admin/4cdb5ef3-9058-3f2a-8f5c-e753f7c3a62c (it should contain PRODUCE)
• http://data.d4science.org/ctlg/GRSF_Admin/25330c89-7ea9-3184-988a-74faf85a7a51 (it should contain FWRI)
• http://data.d4science.org/ctlg/GRSF_Admin/e9da1446-c40f-3caa-b15c-28624db3d7fa (it should contain DFO)
• http://data.d4science.org/ctlg/GRSF_Admin/e1a70970-bc69-3af2-bdaa-9fee92c48b6d (it should contain SUBPESCA).

I can update them programmatically.
@aureliano.gentile@fao.org what do you think?

Aureliano, your recommendation is not clear to me.
Do you propose adding the acronym of the acronym of the management entity when the ISO3 country code is missing?
If yes, your proposal is to add it under the Management Body/Authority(ies) field, in the semantic identifier or both?

1) the semantic identifier has to be filled with the following logic authority:NAT:
if you check the json form Merul above in this ticket, you see it is "country": "HND" therefore the semantic identifier would be like "... + authority:NAT:HND + ..."

2) the management authority field is already reporting the name of whatever national institute, therefore I am simply suggest to append also the acronym as per the screenshot. In the json example it would correspond to "acronym": "DIGEPESCA"

if not clear (my apologies for that), I am available to briefly discuss in skype

OK.

I just checked why the country code is missing and I found out that this type of information was null, by the time of harvesting FishSource (March 2018). Below you can see the parts of the harvested contents in XML.

    <management_unit>
      <name>Honduras Western Central Atlantic</name>
      <organizations>
        <country>null</country>
        <acronym>DIGEPESCA</acronym>
        <name>Honduran Directorate of Fisheries and Aquaculture</name>
        <id>4518</id>
      </organizations>
      <id>2083</id>
    </management_unit>

I will update this in the GRSF KB and the GRSF VREs, which means that we will update the records.

There's an issue with the updating of the legacy records (the ones coming from FishSource). I've opened a ticket assigned to CNR. As soon as we fix it I'll update the records accordingly.

With many thanks for this work.
I see a strange "-" following the authority:NAT:HND in the semantic identifier of this record http://data.d4science.org/ctlg/GRSF_Admin/08b5d29f-71e1-31be-9399-1164785593d2 can you check please?

asfis:SLC+fao:31+authority:NAT:HND - +iso3:HND+isscfg:08.2

You are right!
Just updated it.

Thanks, I trust that fix is applied to all records and future records generation

In example here the iso3 country code for the authority is still missing http://data.d4science.org/ctlg/GRSF_Admin/f8fb17c8-cfb3-3079-a071-ae3509e5e12a

GRSF Semantic identifier: asfis:ABS+fao:31+authority:NAT:-+iso3:USA+isscfg:03.12

Code: authority:NAT:-, System: unk, Name: Florida Fish and Wildlife Conservation Commission

I guess it should be "USA"

So why is it missing? Maybe because this info is not supplied by fishsource or what else? Thanks again.

Aureliano Gentile wrote:

In example here the iso3 country code for the authority is still missing http://data.d4science.org/ctlg/GRSF_Admin/f8fb17c8-cfb3-3079-a071-ae3509e5e12a

GRSF Semantic identifier: asfis:ABS+fao:31+authority:NAT:-+iso3:USA+isscfg:03.12

Code: authority:NAT:-, System: unk, Name: Florida Fish and Wildlife Conservation Commission

I guess it should be "USA"

The proper one should be authority:NAT:FWCC.

Ignore the following, my mistake

Yannis Marketakis wrote:

The proper one should be authority:NAT:FWCC.

This type of information (the ISO3 code of the country) is missing from the sources that have been harvested from Fishsource. Below you'll find the corresponding part.

    <management_unit>
      <name>Florida Atlantic</name>
      <organizations>
        <country>null</country>
        <acronym>FWCC</acronym>
        <name>Florida Fish and Wildlife Conservation Commission</name>
        <id>2428</id>
      </organizations>
      <id>823</id>
    </management_unit>

I'm not sure if FishSource currently has this type of information in their databases.
If yes, and since updating them one by one is not a good option, we could perform a bulk update, if Fishsource colleagues provide us a list with the corresponding mappings (organization ID - country)

The majority of the Management Units in FishSource have country information associated with the Organisations. As an example, here's the output for the entity above from the /api/bluebridge/v4/management_units endpoint:

{
"id": 823,
"name": "Florida Atlantic",
"type": null,
"organisations": [
{
"id": 2428,
"name": "Florida Fish and Wildlife Conservation Commission",
"acronym": "FWCC",
"country": "USA"
}
],
"stock": {
"id": 656,
"name": "American shad - Florida Atlantic"
},
"exploiting_fisheries": [
1385
],
"fishing_areas": [
{
"name": "FAO 31",
"type": "FAO"
},
{
"name": "Florida Atlantic waters (

The same country information is being returned in the stocks endpoint:

"management_units": [
{
"id": 823,
"name": "Florida Atlantic",
"organizations": [
{
"id": 2428,
"name": "Florida Fish and Wildlife Conservation Commission",
"acronym": "FWCC",
"country": "USA"
}
]
}
]

well, in grsf we said standard should be iso3, if FishSource can provide directly iso3 codes, then it would be better (if possible, thanks)

Not sure what you mean Yannis. The samples above in comment 23 show the data returned is ISO3, eg. USA not US.

This is what I get back from https://www.fishsource.org/api/bluebridge/v2/fisheries/3695

{
    "management_unit": {
        "id": 1912,
        "name": "BCO10",
        "organizations": [{
            "id": 3555,
            "name": "NZ Ministry for Primary Industries",
            "acronym": "MPI",
            "country": "NZ"
        }]
    }
}

However, I wouldn't worry since the transformation from ISO2 to ISO3 is something that can be automated from our side (during the harvesting/transformation of data from FishSource)

You're using the V2 version of the API. Not the V4. This is the latest version that has all modifications requested during the GRSF work.

thanks Merul, in the GRSF wiki I see we have this URL https://www.fishsource.org/apipie/
can you tell us which should be the right one?
Or, would it be better to update this generic url https://www.fishsource.org/apipie/ so to have the latest version?
or please advice what you deem is more appropriate

The docs will always be at https://www.fishsource.org/apipie. It should by default open the v4 docs - but something is wrong there and I'll look into that. Apologies.

Thank you Merul for the answer. I was totally unaware of V4.
I will use that instead.

I've updated the management entities with the missing country codes.
In addition, I've updated the semantic IDs of the defected GRSF fishery records.
As a proof-of-concept I've updated http://data.d4science.org/ctlg/GRSF_Admin/88454692-27bb-3b3e-a890-ab8c92420d0f

There are 1052 more GRSF fishery records to be updated.
I'll start updating them today.

Thanks a lot. I checked randomly a few fisheries and the fix seems fine.

One concern on FFA which should be INT not national management authority
Management Body/Authority(ies) Code: authority:NAT:SLB, System: grsf-org, Name: Forum Fisheries Agency (FFA)
(see https://www.ffa.int/about)

In example in this record: http://data.d4science.org/ctlg/GRSF_Admin/fe0691c8-e686-3396-aa47-62ac1cf19f27 OR this one http://data.d4science.org/ctlg/GRSF_Admin/12ad80fd-b23e-3c0f-a362-834179a8a95f
Can it be fixed? I understand this is a content related issue rather than the application logic

Thanks a lot,

so from

Management Body/Authority(ies) Code: authority:NAT:SLB, System: grsf-org, Name: Forum Fisheries Agency (FFA)

it will become

Management Body/Authority(ies) Code: authority:INT:FFA, System: grsf-org, Name: Forum Fisheries Agency (FFA)

The mapping file on management entities has been updated accordingly https://data.d4science.org/shub/E_cGxRWVJoSm1KZjhWOUUyM1p1ZllOQVk0by9wVGZuNzJqemVsSWo4YjJQTTMzdW5QNWpOL0lLRmhHYUlzaUdRbw==

(Workspace > VRE Folders > StocksAndFisheriesKB > Requirements > DSDs_and_Mapping_to_GRSF-Standards)

Apologies for the oversight, but definitely that is an international organization (see also http://www.fao.org/fishery/rfb/ffa/en)

Thanks a lot, I checked a few of them, all fine. Then I made a search by "authority:INT:FFA" and I got 1,789 records found for ""authority:INT:FFA"" which indeed is the number of records you were mentioning, hence it should be all good.
I understand all these fixes and updates are reflected in the GSRF VRE, or you may want to refresh it completely at the end of this work.

Thanks.
You are right. For the time being, we are updating everything that needs to be updated in GRSF Admin and afterwards we'll do the same with GRSF VRE. Although for the particular case GRSF VRE is not affected (GRSF Fisheries are not yet approved)

ok, thanks
btw note that so far we have already 31 fishing unit approved in grsf admin:
31 records found Status of the GRSF record: Approved Organisations: GRSF Admin Types: Fishing Unit

You are right.
I'll make sure they are published in GRSF VRE as well.

one more record missing the national authority - Vice Ministry of Aquaculture and Fisheries of Ecuador (MAGAP) - in the semantic identifier asfis:WEP+fao:87.1++iso3:ECU+isscfg:07.9
http://data.d4science.org/ctlg/GRSF_Admin/bab04278-1066-3903-8ffc-5a15d16cb3d7
which is available in FS as well as below in the API
"fishery_name": "Peruvian weakfish | Ecuador | Ecuador | Ecuador | Gillnets and entangling nets",
"exploiting_stocks": 2024,
"prod_system_type": "",
"flag_state": "ECU",
"fishing_gear": {
"id": 3,
"name": "Gillnets and entangling nets",
"standard_abbreviation": "GEN",
"isscfg": "07.9",
"gear_type": "GearGroup",
"sfp_gear": null
},
"management_unit": {
"id": 2430,
"name": "Ecuador",
"organizations": [
{
"id": 2488,
"name": "Vice Ministry of Aquaculture and Fisheries of Ecuador",
"acronym": "MAGAP",
"country": "ECU"
}

the same as above:
http://data.d4science.org/ctlg/GRSF_Admin/2416cbc0-c31b-397e-951f-a30ea4cd0f4c
"fishery_name": "Whiteleg shrimp | Ecuador | Ecuador artisanal | Ecuador | Pushnets",
"exploiting_stocks": 1464,
"prod_system_type": "Artisanal",
"flag_state": "ECU",
"fishing_gear": {
"id": 83,
"name": "Pushnets",
"standard_abbreviation": "MPN",
"isscfg": "10.5",
"gear_type": "Gear",
"sfp_gear": null
},
"management_unit": {
"id": 1758,
"name": "Ecuador artisanal",
"organizations": [
{
"id": 2488,
"name": "Vice Ministry of Aquaculture and Fisheries of Ecuador",
"acronym": "MAGAP",
"country": "ECU"
}
]

As described in previous comments we face those issues because the GRSF has been created using an older harvest from Fishsource.

Instead of fixing them one-by-one, I propose updating all the management entities that have missing information using a more recent harvest from FishSource.
I'll open a new issue describing this and the management entities (and the corresponding records) that has to be updated.