D4Science Infrastructure

Yes, it's slow. The first move will be to move the database on a different server. We are going to build a dedicate postgresql instance to host all the infrastructure databases.

Ok thanks for the prompt feedback. No problem to wait for it.

Can we start with 45 minutes? I think 3 hours is too much.

I do have objections, the portal exports to LDAP the user and groups every 10 minutes, in my understanding if you schedule every 3 hours then then a user that register to a VRE is not going to be able to access the Redmine project associated (if any) for a very long time. On the other hand it is also true that the majority of VREs do not have a Redmine project associated. I'm not sure how is best to proceed in this case, can the LDAP plugin be selective? I mean can it just sync the groups we tell it to? If not than you can schedule every 30 minutes instead of 10 as a compromise perhaps

Massimiliano Assante wrote:

I do have objections, the portal exports to LDAP the user and groups every 10 minutes, in my understanding if you schedule every 3 hours then then a user that register to a VRE is not going to be able to access the Redmine project associated (if any) for a very long time. On the other hand it is also true that the majority of VREs do not have a Redmine project associated. I'm not sure how is best to proceed in this case, can the LDAP plugin be selective? I mean can it just sync the groups we tell it to? If not than you can schedule every 30 minutes instead of 10 as a compromise perhaps

I added you as a watcher because I suspected it.
The sync process cannot be more efficient than this without a rewrite, something smarter could be done from the portal maybe.
The sync activity not only adds new users, but also updates the groups of the existing ones. And the only way it can be done is by reading them all, with all their groups. They are a lot right now, each sync process lasts many minutes.
Every 30 minutes is better that every 5, we can start with that.

Yes, there is something smarter and it is the Redmine Connector for which @lucio.lelii@isti.cnr.it 7 months ago told us that it would be ready October 15th, https://support.d4science.org/issues/7353. The Redmine connector id the user does not exist could create it.

Massimiliano Assante wrote:

Yes, there is something smarter and it is the Redmine Connector for which @lucio.lelii@isti.cnr.it 7 months ago told us that it would be ready October 15th, https://support.d4science.org/issues/7353. The Redmine connector id the user does not exist could create it.

The users are active immediately after they appear on ldap. The synchronization is about groups, and without the groups no actions can be made by anyone.

The users are active immediately after they appear on ldap. The synchronization is about groups, and without the groups no actions can be made by anyone.

Well, the connector receives the user token, and could add the user to the group extracted from the token in redmine.

Massimiliano Assante wrote:

The users are active immediately after they appear on ldap. The synchronization is about groups, and without the groups no actions can be made by anyone.

Well, the connector receives the user token, and could add the user to the group extracted from the token in redmine.

That's not enough: a user can be associated to more than one VRE, and on redmine have to be added to every group.

Andrea Dell'Amico wrote:

Massimiliano Assante wrote:

The users are active immediately after they appear on ldap. The synchronization is about groups, and without the groups no actions can be made by anyone.

Well, the connector receives the user token, and could add the user to the group extracted from the token in redmine.

That's not enough: a user can be associated to more than one VRE, and on redmine have to be added to every group.

I didn't mean to remove completely the LDAP Sync plugin, but if the connector were in place than we could extend the ldap sync time to 3 hours without problems.

Anyway, in the mean while we can schedule every 45 minutes. What do you think?

Massimiliano Assante wrote:

Andrea Dell'Amico wrote:

Massimiliano Assante wrote:

The users are active immediately after they appear on ldap. The synchronization is about groups, and without the groups no actions can be made by anyone.

Well, the connector receives the user token, and could add the user to the group extracted from the token in redmine.

That's not enough: a user can be associated to more than one VRE, and on redmine have to be added to every group.

I didn't mean to remove completely the LDAP Sync plugin, but if the connector were in place than we could extend the ldap sync time to 3 hours without problems.

Yes, that could work. @lucio.lelii@isti.cnr.it so you don't need any additional information

Luca Frosini wrote:

Anyway, in the mean while we can schedule every 45 minutes. What do you think?

I already moved it to 30 minutes. Later today I'll change some postgresql options so that we will start logging some slow queries, if there are any.

The additional information is that it is written in Ruby on Rails, It is a new language for me. I don't thing it will be immediate to realize and I also don't know if it is feasible to skip the authentication System used by redmine.

Andrea Dell'Amico wrote:

I'll change some postgresql options so that we will start logging some slow queries, if there are any.

I just modified the postgresql configuration and lowered the redmine log level, that was very verbose.

It's more and more something that's caused by some plugin to me. This page: https://support.d4science.org/s2b_issues/index?project_id=d4science is rendered after many seconds (it remained completely void for at least 15 seconds, to me). In that time, no postgresql query lasted more than 1000ms (the limit I set for the query logger), and the load on the server didn't grow in a significant way.

Luca Frosini wrote:

Redmine is continuing to degrade. Please find attached the image containing the complete list of installed Redmine plugins.

• Issue To-do Lists Plugin (Andrea do you need it?)
• Redmine Login Audit plugin (is this needed)

Those ones are needed

I believe that any plugin that was installed and then not used intensively can be undeployed.

One that should be quite invasive is Scrum2B. Nice to have but we not using it. So, I would remove it as well.

The GANTT is used but I don't know what the plugin you mention add to it.

I would proceed incrementally to see if things change by undeploying plugins.

@pasquale.pagano@isti.cnr.it if we remove scrum2B we remove the sprints. Even we don't use sprints in the proper way, we use them.

Are you really sure that you want to remove scrum2B plugin?

If yes, we have to find some solution to group tickets, the category is not enough. Please note that the solution to have one master ticket is not always usable.

in that case we cannot remove it.

Do you remember why we installed the Global Roles plugin.

I cannot find a related ticket. There was a spreadsheet with a list of potential plugins at some point, but I cannot find it anymore.

I just removed the plugin on the redmine dev instance, https://redmine-d.d4science.org without any apparent loss of functionalities.

I just remember that we installed such a plugin to avoid to grant them admin role to people which has to be manager in many projects and especially to avoid to add them every time we create a project.
I think that we can remove the plugin and we will evaluate how to behave for each person.

In particular we have to evaluate:
Roberto Cirillo
Claudio Atzori
Alessia Bardi
Michele Artini
Paolo Manghi

Instead the following the has to be admin
Pasquale Pagano
Luca Frosini
Andrea Dell'Amico
Tommaso Piccioli

Luca Frosini wrote:

Instead the following the has to be admin
Pasquale Pagano
Luca Frosini
Andrea Dell'Amico
Tommaso Piccioli

The admins are managed by the ldap group redmine_admins and they currently are:

Pasquale Pagano
Luca Frosini
Andrea Dell'Amico
Tommaso Piccioli
Leonardo Candela
Massimiliano Assante

So I think we cam manage the rest of the people manually.

OK, I'll do it at the start of the downtime window.

@andrea.dellamico@isti.cnr.it Repository tab in gcube project seems not working properly anymore. The revision and the comment are not displayed (only last commit time) so the commit is not linked to ticket. Do you have any ideas?

Luca Frosini wrote:

Repository tab in gcube project seems not working properly anymore. The revision and the comment are not displayed (only last commit time) so the commit is not linked to ticket. Do you have any ideas?

Nope. Any of the removed plugins, even if there seems not to be a direct link? I can reinstall

• Advanced roadmap & milestones plugin
• Redmine Code Review plugin (is anyone using this?)

anyway, we've seen that don't make a difference.

I added again Redmine Code Review plugin. While the other one was already installed.

But I think I've found the culprit: http://www.redmine.org/issues/14906
I think we can live without that.

I just applied the fix suggested here: http://www.redmine.org/issues/17700

I also see that we are using both the problematic configurations reported in the ticket:

• Allow issue assignment to groups
• a custom field with user format

I added again the global_roles plugin too, btw.

I confirm it is better now, I think we reduced the waiting time of 50% in average

ok