Task #10273: DataMiner algorithms local testing - D4Science Infrastructure - D4science

Actions

Copy link

Task #10273

closed

DataMiner algorithms local testing

Added by Gianpaolo Coro over 7 years ago. Updated about 6 years ago.

Status:

Closed

Priority:

Normal

Assignee:

Lucio Lelii

Category:

High-Throughput-Computing

Target version:

Data Processing

Start date:

Nov 08, 2017

Due date:

% Done:

100%

Estimated time:

Infrastructure:

Production

Description

Local machine testing of DM algorithms does not work anymore. Further, there are sudden issues now on the Support Vector Machines algorithms that are preventing their correct work

Exception in thread "Thread-3259" java.lang.IllegalAccessError: libsvm/Solver$SolutionInfo
 at libsvm.svm.svm_train_one(svm.java:1506)
 at libsvm.svm.svm_train(svm.java:2067)
 at org.gcube.data.analysis.algorithms.supportvectormachine.SVM2ClassOperations.runModel(SVM2ClassOperations.java:1229)
 at org.gcube.data.analysis.algorithms.supportvectormachine.SVM2ClassOperations.runSingleModel(SVM2ClassOperations.java:270)
 at org.gcube.data.analysis.algorithms.supportvectormachine.SVM2ClassOperations.run(SVM2ClassOperations.java:198)

The algorithms implementation Wiki is also based on the testing part. Is it possible to restore the old way?

Actions

Copy link

Updated by Lucio Lelii over 7 years ago

Status changed from New to In Progress
% Done changed from 0 to 10

Actions

Copy link

Updated by Lucio Lelii over 7 years ago

I have found the problem. An old version of libsvm is embedded in the rapidminer-custom jar. With the dynamic classloader for algorithms introduced in Dataminer it create a conflict.
I really don't know how to solve it. Uberjars are evil, the solution is to remove the uberjars from everywhere.

Actions

Copy link

Updated by Giancarlo Panichi over 7 years ago

A simple solution could be to implement the algorithm as Java Black-Box using the SAI

Actions

Copy link

Updated by Pasquale Pagano over 7 years ago

can we rebuild the rapidminer-custom jar with an up-to-date version of libsvm?

Actions

Copy link

Updated by Lucio Lelii over 7 years ago

Assignee changed from Lucio Lelii to Giancarlo Panichi

@g.panichi@isti.cnr.it try it on proto and let me know. In case it doesn't work reassign the ticket to me

Actions

Copy link

Updated by Giancarlo Panichi over 7 years ago

Assignee changed from Giancarlo Panichi to Lucio Lelii

@lucio.lelii@isti.cnr.it you know that this algorithm is not developed by me. @scarponi@isti.cnr.it is evaluating the best solution.

Actions

Copy link

Updated by Paolo Scarponi over 7 years ago

Priority changed from Urgent to Normal

We may have found a solution, in any case this is not urgent anymore. It's up to Lucio to decide whether to close the incident and open a task, or switch this one to a task.

Actions

Copy link