p Relational Algebra

advertisement
Relational Algebra
CS 186 Spring 2006, Lecture 8
R & G, Chapter 4
By relieving the brain of all unnecessary
work, a good notation sets it free to
concentrate on more advanced problems,
and, in effect, increases the mental power of
the race.
-- Alfred North Whitehead (1861 - 1947)
p
Administrivia
• Midterm 1 – Tues 2/21, in class
– Covers all material up to and including Th 2/16
– Closed book – can bring 1 8.5x11” sheet of notes
– No calculators – no cell phones
• Midterm 2 – Th 3/21, in class
– Focuses on material after MT 1
– Same rules as above.
• Homework 1 – 2/14
• Homework 2 – Out after MT 1, Due 3/14
Relational Query Languages
• Query languages: Allow manipulation and retrieval of
data from a database.
• Relational model supports simple, powerful QLs:
– Strong formal foundation based on logic.
– Allows for much optimization.
• Query Languages != programming languages!
– QLs not expected to be “Turing complete”.
– QLs not intended to be used for complex calculations.
– QLs support easy, efficient access to large data sets.
Formal Relational Query Languages
Two mathematical Query Languages form the
basis for “real” languages (e.g. SQL), and for
implementation:
Relational Algebra: More operational, very
useful for representing execution plans.
Relational Calculus: Lets users describe what
they want, rather than how to compute it.
(Non-procedural, declarative.)
 Understanding Algebra & Calculus is key to
understanding SQL, query processing!
Preliminaries
• A query is applied to relation instances, and the
result of a query is also a relation instance.
– Schemas of input relations for a query are fixed (but
query will run over any legal instance)
– The schema for the result of a given query is also
fixed. It is determined by the definitions of the query
language constructs.
• Positional vs. named-field notation:
– Positional notation easier for formal definitions,
named-field notation more readable.
– Both used in SQL
Relational Algebra: 5 Basic Operations
• Selection (  ) Selects a subset of rows from
relation (horizontal).
• Projection ( p ) Retains only wanted columns
from relation (vertical).
• Cross-product (x) Allows us to combine two
relations.
• Set-difference (–) Tuples in r1, but not in r2.
• Union ( ) Tuples in r1 and/or in r2.
Since each operation returns a relation, operations can
be composed! (Algebra is “closed”.)
Example Instances
R1 sid
22
58
S1 sid
bid
101
102
103
104
bname
Interlake
Interlake
Clipper
Marine
Boats
color
blue
red
green
red
bid
day
101 10/10/96
103 11/12/96
22
31
58
sname rating age
dustin
7
45.0
lubber
8
55.5
rusty
10 35.0
sid
28
31
44
58
sname rating age
yuppy
9
35.0
lubber
8
55.5
guppy
5
35.0
rusty
10 35.0
S2
Projection
• Examples: p age(S2) ; p sname, rating(S2)
• Retains only attributes that are in the “projection
list”.
• Schema of result:
– exactly the fields in the projection list, with the
same names that they had in the input relation.
• Projection operator has to eliminate duplicates
(How do they arise? Why remove them?)
– Note: real systems typically don’t do duplicate
elimination unless the user explicitly asks for it.
(Why not?)
Projection
sid
28
31
44
58
sname rating age
yuppy
9
35.0
lubber
8
55.5
guppy
5
35.0
rusty
10 35.0
S2
sname
rating
yuppy
lubber
guppy
rusty
9
8
5
10
p sname,rating (S 2)
age
35.0
55.5
p age(S2)
Selection ()
• Selects rows that satisfy selection condition.
• Result is a relation.
Schema of result is same as that of the input relation.
• Do we need to do duplicate elimination?
sid
28
31
44
58
sname rating age
yuppy
9
35.0
lubber
8
55.5
guppy
5
35.0
rusty
10 35.0
 rating 8(S2)
sname
yuppy
rusty
rating
9
10
p sname,rating( rating 8(S2))
Union and Set-Difference
• All of these operations take two input relations,
which must be union-compatible:
– Same number of fields.
– `Corresponding’ fields have the same type.
• For which, if any, is duplicate elimination
required?
Union
sid
22
31
58
sname rating age
dustin
7
45.0
lubber
8
55.5
rusty
10 35.0
S1
sid
28
31
44
58
sname rating age
yuppy
9
35.0
lubber
8
55.5
guppy
5
35.0
rusty
10 35.0
S2
sid sname
rating age
22
31
58
44
28
7
8
10
5
9
dustin
lubber
rusty
guppy
yuppy
S1 S2
45.0
55.5
35.0
35.0
35.0
Set Difference
sid
22
31
58
sname rating age
dustin
7
45.0
lubber
8
55.5
rusty
10 35.0
sid sname
22 dustin
rating age
7
45.0
S1 S2
S1
sid
28
31
44
58
sname rating age
yuppy
9
35.0
lubber
8
55.5
guppy
5
35.0
rusty
10 35.0
S2
sid sname rating age
28 yuppy
9
35.0
44 guppy
5
35.0
S2 – S1
Cross-Product
• S1 x R1: Each row of S1 paired with each row of R1.
• Q: How many rows in the result?
• Result schema has one field per field of S1 and R1,
with field names `inherited’ if possible.
– May have a naming conflict: Both S1 and R1 have
a field with the same name.
– In this case, can use the renaming operator:
 (C(1 sid1, 5 sid2), S1 R1)
Cross Product Example
sid bid
day
22 101 10/10/96
58 103 11/12/96
R1
sname rating age
dustin
7
45.0
lubber
8
55.5
rusty
10 35.0
S1
(sid) sname
R1 X S1 =
sid
22
31
58
rating age
(sid)
bid
day
22
dustin
7
45.0
22
101
10/10/96
22
dustin
7
45.0
58
103
11/12/96
31
lubber
8
55.5
22
101
10/10/96
31
lubber
8
55.5
58
103
11/12/96
58
rusty
10
35.0
22
101
10/10/96
58
rusty
10
35.0
58
103
11/12/96
Compound Operator: Intersection
• In addition to the 5 basic operators, there are
several additional “Compound Operators”
– These add no computational power to the
language, but are useful shorthands.
– Can be expressed solely with the basic ops.
• Intersection takes two input relations, which
must be union-compatible.
• Q: How to express it using basic operators?
R  S = R  (R  S)
Intersection
sid
22
31
58
sname rating age
dustin
7
45.0
lubber
8
55.5
rusty
10 35.0
S1
sid
28
31
44
58
sname rating age
yuppy
9
35.0
lubber
8
55.5
guppy
5
35.0
rusty
10 35.0
S2
sid sname
31 lubber
58 rusty
rating age
8
55.5
10
35.0
S1 S2
Compound Operator: Join
• Joins are compound operators involving cross product,
selection, and (sometimes) projection.
• Most common type of join is a “natural join” (often just called
“join”). R
S conceptually is:
– Compute R X S
– Select rows where attributes that appear in both relations have equal
values
– Project all unique atttributes and one copy of each of the common
ones.
• Note: Usually done much more efficiently than this.
• Useful for putting “normalized” relations back together.
Natural Join Example
sid bid
day
22 101 10/10/96
58 103 11/12/96
sid
22
31
58
sname rating age
dustin
7
45.0
lubber
8
55.5
rusty
10 35.0
R1
R1
S1
S1 =
sid
22
58
sname rating age
dustin 7
45.0
rusty
10
35.0
bid
101
103
day
10/10/96
11/12/96
Other Types of Joins
• Condition Join (or “theta-join”):
R  c S   c ( R  S)
• Result schema same as that of cross-product.
• May have fewer tuples than cross-product.
• Equi-Join: Special case: condition c contains
only conjunction of equalities.

“Theta” Join Example
sid bid
day
22 101 10/10/96
58 103 11/12/96
R1
S1
R1 =
S1.sid  R1.sid
(sid)
22
31
sname rating age
dustin 7
45.0
lubber 8
55.5
sid
22
31
58
sname rating age
dustin
7
45.0
lubber
8
55.5
rusty
10 35.0
S1
(sid)
58
58
bid
103
103
day
11/12/96
11/12/96
Compound Operator: Division
• Useful for expressing “for all” queries like:
Find sids of sailors who have reserved all boats.
• For A/B attributes of B are subset of attrs of A.
– May need to “project” to make this happen.
• E.g., let A have 2 fields, x and y; B have only
field y:
A B   x  y  B( x, y  A)
A/B contains all x tuples such that for every y
tuple in B, there is an xy tuple in A.
Examples of Division A/B
sno
pno
s1
p1
s1
p2
s1
p3
s1
p4
s2
p1
s2
p2
s3
p2
s4
p2
s4
p4
A
pno
p2
pno
p2
p4
B2
pno
p1
p2
p4
sno
s1
s2
s3
s4
sno
s1
s4
A/B1
A/B2
sno
s1
B1
B3
A/B3
Expressing A/B Using Basic Operators
• Division is not essential op; just a useful shorthand.
– (Also true of joins, but joins are so common that systems
implement joins specially.)
• Idea: For A/B, compute all x values that are not
`disqualified’ by some y value in B.
– x value is disqualified if by attaching y value from B, we
obtain an xy tuple that is not in A.
Disqualified x values:
A/B:
p x ( A) 
p x ((p x ( A)  B)  A)
Disqualified x values
sid bid
day
Reserves
22 101 10/10/96
58 103 11/12/96
Examples
sid
Sailors 22
31
58
•
Boats
bid
101
102
103
104
bname
Interlake
Interlake
Clipper
Marine
sname rating age
dustin
7
45.0
lubber
8
55.5
rusty
10 35.0
color
Blue
Red
Green
Red
Find names of sailors who’ve reserved boat #103
• Solution 1:
• Solution 2:
p sname ((
p sname (
bid 103
Re serves)  Sailors)
bid 103
(Re serves  Sailors))
Find names of sailors who’ve reserved a red boat
• Information about boat color only available in
Boats; so need an extra join:
p sname ((

color ' red '
Boats)  Re serves  Sailors)
A more efficient (???) solution:
p sname(p
sid
((p
bid
(
color'red'
Boats))
Res)
Sailors)

 A query optimizer can find this given the first solution!
Find sailors who’ve reserved a red or a green boat
• Can identify all red or green boats, then find
sailors who’ve reserved one of these boats:
 (Tempboats, (
color ' red '  color ' green '
Boats))
p sname(Tempboats  Re serves  Sailors)
Find sailors who’ve reserved a red and a green boat
• Previous approach won’t work! Must identify
sailors who’ve reserved red boats, sailors who’ve
reserved green boats, then find the intersection
(note that sid is a key for Sailors):
 (Tempred, p
sid
 (Tempgreen, p
((
sid
color ' red '
((
Boats)  Re serves))
color ' green'
Boats)  Re serves))
p sname((Tempred  Tempgreen)  Sailors)
Find the names of sailors who’ve reserved all boats
• Uses division; schemas of the input relations to
/ must be carefully chosen:
 (Tempsids, (p
sid, bid
Re serves) / (p
bid
Boats))
p sname (Tempsids  Sailors)

To find sailors who’ve reserved all ‘Interlake’ boats:
.....
/p
bid
(
bname ' Interlake'
Boats)
Download