Data Mining tools
Transcription
Data Mining tools
DataMiningTools Jean-GabrielGanascia LIP6–UniversityPierreetMarieCurie 4,placeJussieu,75252Paris,Cedex05 [email protected] Extraction Data mining DATA BASES Interpretation/ Visualization Evaluation… Datamining Pre-treatment Selection DB DB DB DB Graphs Rules, 3D, RA, VR... Reformulation K. domain Reducing dimensions.supervised non-supervised SQL / OQL adhoc Google, Yahoo, AltaVista, ... Jean-GabrielGANASCIA sequences symbolic symbolic sequences CHARADE Cobweb, Wspot ID3, C4.5, EquipeACASA–LIP6–UPMC–SorbonneUniversités FLEXPAT FOIL, REMO,... COING FreeTools R-project:statisticallibrary TANAGRA–Sipina(Lyon), http://eric.univ-lyon2.fr/~ricco/tanagra/fr/tanagra.html Weka–NewZeeland(Javalanguage) Orange–Slovania(Pythonlanguage) RapidMiner(Yale) AlphaMiner Mallet–MachineLearningforLanguageToolkit(Javalanguage) http://mallet.cs.umass.eduUniversityMassachusetts … Jean-GabrielGANASCIA EquipeACASA–LIP6–UPMC–SorbonneUniversités Whatdothose toolscontain? Input[ile Fileformat “.tab” “arff” etc. Jean-GabrielGANASCIA EquipeACASA–LIP6–UPMC–SorbonneUniversités Input–type“.tab” Line1attributename Line2attributetype Line3class Separation:tab Example–[ile“lenses.tab” age prescription discrete discrete astigmatic tear_rate lenses discrete discrete discrete class young myope no reduced none young myope no normal soft … presbyopic hypermetrope Jean-GabrielGANASCIA yes normal none EquipeACASA–LIP6–UPMC–SorbonneUniversités Entrée«ARFF» Attribute-RelationFileFormat Entête Commentaires–précédéspar% @RELATION<nomrelation>(1ligne) @ATTRIBUTE<nomattribut><Typeattribut>(listedetousles attributs–1parligne) @DATA<valA1>,<valA2>,…(listedetouslesexemples–1par ligne) Type: Numeric <nominal-speciMication>-ensemblevaleurs String–entreapostrophess’illachaînecontientdesblancs Date[<formatdate>] Jean-GabrielGANASCIA EquipeACASA–LIP6–UPMC–SorbonneUniversités ExampleARFF Header % 1. Title: Plants data base IRIS % % 2. Sources: % (A) Creator: RA Fisher % (B) Donor: Michael Marshall (MARSHALL%[email protected]) % (C) Date: July, 1988 % @ Iris RELATION @ Attribute sepallength NUMERIC @ Attribute sepalwidth NUMERIC @ Attribute petallength NUMERIC @ Attribute petalwidth NUMERIC @ Class Attribute {Iris-setosa, Iris versicolor, Iris-virginica} Jean-GabrielGANASCIA EquipeACASA–LIP6–UPMC–SorbonneUniversités ExampleARFF Data @ Data 5.1,3.5,1.4,0.2, 4.9,3.0,1.4,0.2, 4.7,3.2,1.3,0.2, 4.6,3.1,1.5,0.2, 5.0,3.6,1.4,0.2, 5.4,3.9,1.7,0.4, 4.6,3.4,1.4,0.3, 5.0,3.4,1.5,0.2, 4.4,2.9,1.4,0.2, 4.9,3.1,1.5,0.1, Jean-GabrielGANASCIA Iris-setosa Iris-setosa Iris-setosa Iris-setosa Iris-setosa Iris-setosa Iris-setosa Iris-setosa Iris-setosa Iris-setosa EquipeACASA–LIP6–UPMC–SorbonneUniversités SparseARFF Iftherearemanynullvalues Thesame,exceptfordata Nonnullattributesareidenti[iedbytheirrank ExampleARFF @data 0, X, 0, Y, ‘class A’ 0, 0, W, 0, ‘class B’ ExampleSparseARFF @data {1 X, 3 Y, 4 ‘class A’} {2 W, 4 ‘class B’} Remark:theabsentvaluescorrespondto0–missingvaluesareidentiMiedwith‘?’ Jean-GabrielGANASCIA EquipeACASA–LIP6–UPMC–SorbonneUniversités Othersteps • Data preparation – Feature selection – Data selection – Digitalization – Sampling – Outliers – File fusion (joint) – Concatenation – … Jean-GabrielGANASCIA • Data visualization • Classification • Regression • Evaluation • Non supervised learning • Association rules • Text mining EquipeACASA–LIP6–UPMC–SorbonneUniversités Data visualization ExploratoryDataAnalysis Distributions Linearprojection Attributestatistics Correspondenceanalysis Mosaicdiagrams … Jean-GabrielGANASCIA EquipeACASA–LIP6–UPMC–SorbonneUniversités Classi[ication • Bayesian classification • Visualization of the classification • Logistic regression – Trees • K nearest neighbor – CN2 rules • Trees – … • C4.5 • CN2 • SVM Jean-GabrielGANASCIA EquipeACASA–LIP6–UPMC–SorbonneUniversités Nonsupervised learning • Matrix distance from examples • Matrix distance from attributes Jean-GabrielGANASCIA • Dendrograms • K-means • … EquipeACASA–LIP6–UPMC–SorbonneUniversités Evaluation– supervisedlearning • Separation – Random – Leave one out – Cross validation • Indices – Precision-recall – ROC – … • Confusion matrix • ROC analysis • Prediction • … • Test training set/ test set • … Jean-GabrielGANASCIA EquipeACASA–LIP6–UPMC–SorbonneUniversités Association rules Extractionofassociationrules Visualizationofassociationrules Frequentsets … Jean-GabrielGANASCIA EquipeACASA–LIP6–UPMC–SorbonneUniversités Specialized applications • Bioinformatics – Genomes data bases – Gene selection – Profiles – … Jean-GabrielGANASCIA • Text mining – Text file – Preprocessing (TF.IDF, lemmatization, stemmatization, …) – Bags of words – N-grams of characters – N-grams of words – Feature extraction – Distance… EquipeACASA–LIP6–UPMC–SorbonneUniversités Weka WritteninJava Jean-GabrielGANASCIA EquipeACASA–LIP6–UPMC–SorbonneUniversités Weka http://www.cs.waikato.ac.nz/ml/weka/ Jean-GabrielGANASCIA EquipeACASA–LIP6–UPMC–SorbonneUniversités Orange UniversityofLjubljana–Slovenia ProgrammedwithPython http://www.ailab.si/orange/ Machine ARI: orange-canvas Jean-GabrielGANASCIA EquipeACASA–LIP6–UPMC–SorbonneUniversités