Data-mining

advertisement
Macromolecular Structure Database
Structural Database Infrastructure Services for Europe
www.ebi.ac.uk/msd
EMBL-EBI
The MSD databases
The MSD actually consists of two separate
databases:
 the archive database is highly normalized, with
thousands of relationships linking some 400
tables; the deposition database is the
definitive archive for all structural data at MSD
 the search database is a much simpler,
denormalized database, with data items
duplicated and aggregated into 40 much wider
tables, making it more amenable to searching
and retrieval of data : the MSDSD
EMBL-EBI
What is the MSDSD database
 A relational database primarily developed in Oracle
that stores the data derived from the PDB together
with reference and other derived information
 Simple to understand for the novice biologist and
fast in performance for the database non-expert
 Originates from the internal MSD archive database
that ensures accuracy and data integrity
 In MSDSD naming and other summary information
is repeated from every level of the hierarchy to the
next one in order to be closer to the familiar PDB
data
EMBL-EBI
Main MSDSD features
 The symmetry has been expanded and the
information of the quaternary biological
assemblies is directly available
 External Information like binding sites and secondary
structure has been derived on the assembly level
 The original PDB asymmetric unit is also available
 Includes and provides clear database relations
with the ligands “data mart” and other reference
information
 Includes information and cross-references to
external databases (NCBI taxonomy, UniProt,
SCOP etc)
EMBL-EBI
DATA Analysis
Data mining is a term that is applied very loosely
within bioinformatics to describe any type of data
analysis. Almost without exception the analysis of
molecular biology is hypothesis based where the
search for information has a target that is defined by
the knowledge of the biological context of the data.
EMBL-EBI
Data Mining
“Analysis of data in a database using tools which
look for trends or anomalies without knowledge of
the meaning of the data.”
“True data mining software does not just change
the presentation, but discovers previously unknown
relationships among the data.
(Webopedia and other technical dictionaries)”
was first “invented” by IBM
EMBL-EBI
Traditional analysis is via “verification-driven
analysis”
Requires hypothesis of the desired
information (target)
Requires correct interpretation of proposed
query
Discovery-driven data mining
Finds data with common characteristics
Results are ideal solutions to discovery
Finds results without previous hypothesis
EMBL-EBI
So what is Hypothesis driven
data analysis ?
 Define a target = hypothesis
 Search for target
 There are/are-not “hits”
 Verify/negate hypothesis
 Distribution is centred on target
“catalytic triad” :
Atomic coordinates :
Mathematical graph :
HIS,ASP,SER :
text string matching
coordinate superposition
graph matching
data hierarchy knowledge
EMBL-EBI
For example, it is possible to find the presence of
catalytic triads within the PDB by selecting an example
structure and then using a matching technique such as
coordinate superposition or graph analysis to screen this
against all the coordinate data within the PDB. This will
identify the presence of similar residue configurations to
the search target and result in a distribution of hits
centered on the original search model.
HOWEVER we can only find similar objects distributed
about this target.
EMBL-EBI
Discovery-driven data mining
 Finds data with common characteristics
 Results are ideal solutions to discovery
 Finds results without previous hypothesis
 Target is mathematical – so has no scientific
dependency
EMBL-EBI
Mining techniques
 Creation of predictive models : future data
expectation
 Link analysis : connections between data
objects
 Database segmentation : classification
 Deviation detection : finding outliers.
EMBL-EBI
So what is this data mining ?
 Given multiple sets of primary data)
 Characters, numbers, Function(numbers),….
 Find anomalies
 To many : numerical occurrence
 Data variation : Derivatives
 Singularities
 Correlations and clusters
Finds new things !
But not what it means !
 Within primary data
 with other data (dependent variables)
EMBL-EBI
Discovery driven data mining of the PDB
 Analysis of 3-dimensional coordinates
 Defined common patterns of atomic interactions
locally
 DB segmentation - active sites & common packing features
 Link analysis - Similarity between different functional
group
 Defined globally
 DB segmentation - common patterns of super-secondary
str’
 Link analysis - common folds in diverse protein families
 Outlier detection - unique folds
 Nucleic Acid sequences
 Define information content using information
technology
EMBL-EBI
Issues
 Systematic “error” propagates as solution
 300 lysozyme structures return as a strong solution
 Results cannot be found below the noise level
 Need to characterise the noise level
 Need to improve signal/noise ratio (S/N) to see information
 Target is not biologically defined
 It does not give you the biological answer
 Results should reproduce known biology
 Can give you new results not previously observed
EMBL-EBI
Data selection
 Cannot leave in 300 lysozyme structures !
 Select by sequence similarity at 70% exact
alignment
 Different “phase space” to select data
 Remove structures with resolution < 2.5A
 Remove NMR (different statistics)
 Remove pre-1982 etc.
 Geometrical analysis criteria to check for
outliers
EMBL-EBI
Off the shelf products
 Main problem – they “all” do column
correlation – but this requires row analysis
 Ie you can find whether x coordinates are more
correlated to y coordinates than z coordinates
 Slow
 I tried the above on 1e3 of data and it took hours;
not much chance on 1.6e9 data then.
 Money often
EMBL-EBI
Local atomic interactions
 Data
 3D coordinates
 Atom types
 Residue types
 Convert coordinates to
distances - easier to
compare, no need to
superpose coordinates.
 Create 3D Hash table of
triplets of distances
between “points”
EMBL-EBI
Local atomic interactions
 Merge triplets
 Any pair of N-fold
interactions are a (N+1)
interaction if they have
(N-1) equivalence.
 Just keep going until
no more (N+1)
interaction are found.
 Time = 8 seconds
 (Digital alpha ES40)
EMBL-EBI
Local atom interactions
 Define key atoms/groupsof-atoms as run time
parameters.
 Solves problem of residue
symmetry
 Approximation for speed
 This is a hypothesis
 External definition of
residue equivalence (PHE 
TYR) for released data.
 Improves Signal/Noise ratio.
 This is a hypothesis
EMBL-EBI
Is this data mining ?
 Basic 3D correlation of distances is
 Program can be run without any prior definitions.
 Addition of key atoms and residue equivalence
introduces biology and chemistry
 introduces hypothesis regarding what is important.
 Without adding this information you get very little out.
 Improvement to the method should spot this
without being told !
EMBL-EBI
Re-implemented
 This idea has been re-implemented
 Core analysis on distance only
 Statistical analysis of residue equivalence is
carried out – will find residue equivalence
 Bit slower now – 2 minutes
 To use MSD assembly data
 Must be able to normalise by chain similarity
to remove common features due to structure.
 Can use MSD similarity tables for this.
EMBL-EBI
Refining the answers
 This analysis produces approximate
geometrical results
 For each “solution”, a second full All vs.
All LSQ overlay is performed
 handles symmetry in D,E,R,P,T
 handles different residue overlays
 Clusters results using average linkage
 Writes average + superposed coordinates
+ ligands.
EMBL-EBI
Catalytic quartet
EMBL-EBI
Electrostatic interaction
Ligands are
found close by
rather than
associated with
the residues
EMBL-EBI
N-linked glycosolation binding site +?
 Spot the non-sugar
 This glycosolation
site is the same as
active site found in
“1a53” – indol-3glycerolphosphate
synthase
EMBL-EBI
Summary
 Creates 1000’s of results
 Returns many metal and catalytic sites
 50% have at least 2 of 3 residues as
sequence neighbours
 30% have associated ligands
http://www.ebi.ac.uk/msd-srv/MSDtemplate/
See
T.J.Oldfield (2003) PROTEINS: Structure, Function, and Genetics 49, 510-528.
T.J.Oldfield (2002) Acta Cryst. D57, 1421-1427
EMBL-EBI
Data mining – not idiot proof
 Date of birth and age will give 100 %
correlation
 Authors for structure submission will be
correlated to authors on primary citation.
 “Lysozyme” is the most common fold
pattern
 36 spelling’s of E.Coli will mask results.
 Requires representative sets
 Statistically valid ones too !
 Signal/Noise ratio is a problem : hit the
noise and the calculation grows rapidly
EMBL-EBI
Other methods
 Representative sets and clustering
 Another talk
 Data mining fold
 Information technological analysis of genomes
Download