Data Mining tools

Transcription

Data Mining tools
DataMiningTools
Jean-GabrielGanascia
LIP6–UniversityPierreetMarieCurie
4,placeJussieu,75252Paris,Cedex05
[email protected]
Extraction
Data mining
DATA BASES
Interpretation/
Visualization
Evaluation…
Datamining
Pre-treatment
Selection
DB
DB
DB
DB
Graphs
Rules,
3D, RA, VR...
Reformulation
K. domain
Reducing dimensions.supervised non-supervised
SQL / OQL
adhoc
Google, Yahoo, AltaVista, ...
Jean-GabrielGANASCIA
sequences symbolic
symbolic
sequences
CHARADE Cobweb,
Wspot ID3, C4.5, EquipeACASA–LIP6–UPMC–SorbonneUniversités
FLEXPAT
FOIL, REMO,...
COING
FreeTools
R-project:statisticallibrary
TANAGRA–Sipina(Lyon),
http://eric.univ-lyon2.fr/~ricco/tanagra/fr/tanagra.html
Weka–NewZeeland(Javalanguage)
Orange–Slovania(Pythonlanguage)
RapidMiner(Yale)
AlphaMiner
Mallet–MachineLearningforLanguageToolkit(Javalanguage)
http://mallet.cs.umass.eduUniversityMassachusetts
…
Jean-GabrielGANASCIA
EquipeACASA–LIP6–UPMC–SorbonneUniversités
Whatdothose
toolscontain?
Input[ile
Fileformat
“.tab”
“arff”
etc.
Jean-GabrielGANASCIA
EquipeACASA–LIP6–UPMC–SorbonneUniversités
Input–type“.tab”
Line1attributename
Line2attributetype
Line3class
Separation:tab
Example–[ile“lenses.tab”
age
prescription
discrete
discrete
astigmatic tear_rate
lenses
discrete
discrete
discrete
class
young
myope
no
reduced
none
young
myope
no
normal
soft
…
presbyopic hypermetrope
Jean-GabrielGANASCIA
yes
normal
none
EquipeACASA–LIP6–UPMC–SorbonneUniversités
Entrée«ARFF»
Attribute-RelationFileFormat
Entête
Commentaires–précédéspar%
@RELATION<nomrelation>(1ligne)
@ATTRIBUTE<nomattribut><Typeattribut>(listedetousles
attributs–1parligne)
@DATA<valA1>,<valA2>,…(listedetouslesexemples–1par
ligne)
Type:
Numeric
<nominal-speciMication>-ensemblevaleurs
String–entreapostrophess’illachaînecontientdesblancs
Date[<formatdate>]
Jean-GabrielGANASCIA
EquipeACASA–LIP6–UPMC–SorbonneUniversités
ExampleARFF
Header
% 1. Title: Plants data base IRIS
%
% 2. Sources:
% (A) Creator: RA Fisher
% (B) Donor: Michael Marshall (MARSHALL%[email protected])
% (C) Date: July, 1988
%
@ Iris RELATION
@ Attribute sepallength NUMERIC
@ Attribute sepalwidth NUMERIC
@ Attribute petallength NUMERIC
@ Attribute petalwidth NUMERIC
@ Class Attribute {Iris-setosa, Iris versicolor, Iris-virginica}
Jean-GabrielGANASCIA
EquipeACASA–LIP6–UPMC–SorbonneUniversités
ExampleARFF
Data
@ Data
5.1,3.5,1.4,0.2,
4.9,3.0,1.4,0.2,
4.7,3.2,1.3,0.2,
4.6,3.1,1.5,0.2,
5.0,3.6,1.4,0.2,
5.4,3.9,1.7,0.4,
4.6,3.4,1.4,0.3,
5.0,3.4,1.5,0.2,
4.4,2.9,1.4,0.2,
4.9,3.1,1.5,0.1,
Jean-GabrielGANASCIA
Iris-setosa
Iris-setosa
Iris-setosa
Iris-setosa
Iris-setosa
Iris-setosa
Iris-setosa
Iris-setosa
Iris-setosa
Iris-setosa
EquipeACASA–LIP6–UPMC–SorbonneUniversités
SparseARFF
Iftherearemanynullvalues
Thesame,exceptfordata
Nonnullattributesareidenti[iedbytheirrank
ExampleARFF
@data
0, X, 0, Y, ‘class A’
0, 0, W, 0, ‘class B’
ExampleSparseARFF
@data
{1 X, 3 Y, 4 ‘class A’}
{2 W, 4 ‘class B’}
Remark:theabsentvaluescorrespondto0–missingvaluesareidentiMiedwith‘?’
Jean-GabrielGANASCIA
EquipeACASA–LIP6–UPMC–SorbonneUniversités
Othersteps
• Data preparation
– Feature selection
– Data selection
– Digitalization
– Sampling
– Outliers
– File fusion (joint)
– Concatenation
– …
Jean-GabrielGANASCIA
• Data visualization
• Classification
• Regression
• Evaluation
• Non supervised
learning
• Association rules
• Text mining
EquipeACASA–LIP6–UPMC–SorbonneUniversités
Data
visualization
ExploratoryDataAnalysis
Distributions
Linearprojection
Attributestatistics
Correspondenceanalysis
Mosaicdiagrams
…
Jean-GabrielGANASCIA
EquipeACASA–LIP6–UPMC–SorbonneUniversités
Classi[ication
• Bayesian classification • Visualization of the
classification
• Logistic regression
– Trees
• K nearest neighbor
– CN2 rules
• Trees
– …
• C4.5
• CN2
• SVM
Jean-GabrielGANASCIA
EquipeACASA–LIP6–UPMC–SorbonneUniversités
Nonsupervised
learning
• Matrix distance from
examples
• Matrix distance from
attributes
Jean-GabrielGANASCIA
• Dendrograms
• K-means
• …
EquipeACASA–LIP6–UPMC–SorbonneUniversités
Evaluation–
supervisedlearning
• Separation
– Random
– Leave one out
– Cross validation
• Indices
– Precision-recall
– ROC
– …
• Confusion matrix
• ROC analysis
• Prediction
• …
• Test training set/ test set
• …
Jean-GabrielGANASCIA
EquipeACASA–LIP6–UPMC–SorbonneUniversités
Association
rules
Extractionofassociationrules
Visualizationofassociationrules
Frequentsets
…
Jean-GabrielGANASCIA
EquipeACASA–LIP6–UPMC–SorbonneUniversités
Specialized
applications
• Bioinformatics
– Genomes data bases
– Gene selection
– Profiles
– …
Jean-GabrielGANASCIA
• Text mining
– Text file
– Preprocessing (TF.IDF,
lemmatization,
stemmatization, …)
– Bags of words
– N-grams of characters
– N-grams of words
– Feature extraction
– Distance…
EquipeACASA–LIP6–UPMC–SorbonneUniversités
Weka
WritteninJava
Jean-GabrielGANASCIA
EquipeACASA–LIP6–UPMC–SorbonneUniversités
Weka
http://www.cs.waikato.ac.nz/ml/weka/
Jean-GabrielGANASCIA
EquipeACASA–LIP6–UPMC–SorbonneUniversités
Orange
UniversityofLjubljana–Slovenia
ProgrammedwithPython
http://www.ailab.si/orange/
Machine ARI: orange-canvas
Jean-GabrielGANASCIA
EquipeACASA–LIP6–UPMC–SorbonneUniversités