Task #10273
closed
DataMiner algorithms local testing
Added by Gianpaolo Coro over 7 years ago.
Updated about 6 years ago.
Category:
High-Throughput-Computing
Infrastructure:
Production
Description
Local machine testing of DM algorithms does not work anymore. Further, there are sudden issues now on the Support Vector Machines algorithms that are preventing their correct work
Exception in thread "Thread-3259" java.lang.IllegalAccessError: libsvm/Solver$SolutionInfo
at libsvm.svm.svm_train_one(svm.java:1506)
at libsvm.svm.svm_train(svm.java:2067)
at org.gcube.data.analysis.algorithms.supportvectormachine.SVM2ClassOperations.runModel(SVM2ClassOperations.java:1229)
at org.gcube.data.analysis.algorithms.supportvectormachine.SVM2ClassOperations.runSingleModel(SVM2ClassOperations.java:270)
at org.gcube.data.analysis.algorithms.supportvectormachine.SVM2ClassOperations.run(SVM2ClassOperations.java:198)
The algorithms implementation Wiki is also based on the testing part. Is it possible to restore the old way?
- Status changed from New to In Progress
- % Done changed from 0 to 10
I have found the problem. An old version of libsvm is embedded in the rapidminer-custom jar. With the dynamic classloader for algorithms introduced in Dataminer it create a conflict.
I really don't know how to solve it. Uberjars are evil, the solution is to remove the uberjars from everywhere.
A simple solution could be to implement the algorithm as Java Black-Box using the SAI
can we rebuild the rapidminer-custom jar with an up-to-date version of libsvm?
- Assignee changed from Lucio Lelii to Giancarlo Panichi
@g.panichi@isti.cnr.it try it on proto and let me know. In case it doesn't work reassign the ticket to me
- Assignee changed from Giancarlo Panichi to Lucio Lelii
@lucio.lelii@isti.cnr.it you know that this algorithm is not developed by me. @scarponi@isti.cnr.it is evaluating the best solution.
- Priority changed from Urgent to Normal
We may have found a solution, in any case this is not urgent anymore. It's up to Lucio to decide whether to close the incident and open a task, or switch this one to a task.
- Tracker changed from Incident to Task
- Status changed from In Progress to Closed
Also available in: Atom
PDF