2170
Comment:
|
12368
|
Deletions are marked like this. | Additions are marked like this. |
Line 2: | Line 2: |
This class is about Database Management Systems. As such we talk about creating, managing and programming SQL databases. When time permits, we also cover spatial/spatial temporal data and database systems. This site contains content developed by Dr. Anderson for his classes. |
<<TableOfContents>> == Course Description == Introduction to database management systems, including data modeling, query languages and processing, database design, data integrity and security. Issues related to distributed database systems, object-oriented database systems, and legacy database systems are also discussed. == Purpose, Goals & Objectives == Introduction to database management systems, including data modeling, query languages and processing, database design, data integrity and security. Issues related to distributed database systems, object-oriented database systems, and legacy database systems are also discussed. At the conclusion of this course a student will: 1. Understand the difference between the file-oriented method of building applications and the database method. 1. Learn and practice data modeling using the E-R model. 1. Learn and practice designing normalized databases using the E-R. 1. Learn the fundamentals of the relational data model and understand its role in database implementation. 1. Learn and practice SQL and Relational Algebra. 1. Design and implement a relational database and application in C# using SQL server. 1. Understand the implications and problems of enterprise database systems and study solutions to some of the problems. 1. Understand the role of the "people" involved in a database system. 1. Understand the need for data warehousing and mining applications. 1. Understand the uses of spatial temporal and constraint databases. = Resources = <<ChildPages(on=not:edit|AttachFile|LocalSiteMap, more_link=More..., max_pages=25, title=<h3>%s Child Pages</h3>)>> This class is about Database Management Systems. As such we talk about creating, managing and programming SQL databases. When time permits, we also cover spatial/spatial temporal data and database systems. This site contains content developed by Dr. Anderson for his classes. == Accessing Database Examples using SQLite Browser == 1. Download the SQLite Browser for your platform 1. Download a SQLite DB file provided on eclass. 1. Open it in your SQLite Browser ... and enjoy the simplicity and cross platform-ness! == Accessing the Database using Visual Studio Code == First off, we will be using SQLite Browser, so you won't need Visual Studio Code accessing SQL Server very soon (I'll let you know when)! If you haven't done so, install VSCode with the mssql extension. 1. Click the extensions icon on the left tool bar. 1. Search for and install mssql extension. To use Visual Studio code mssql plugin 1. Press CTRL+N. Visual Studio Code opens a new 'Plain Text' file by default. 1. Press CTRL+K,M and change the language mode to SQL. 1. Alternatively, open an existing file with .sql file extension. The language mode is automatically SQL for files that have the .sql extension. 1. press CTRL+SHIFT+P (or F1) to open the Command Palette. 1. Type sqlcon and press ENTER. (Select the MS SQL: Connect command.) 1. Select Create Connection Profile. This creates a connection profile for your SQL Server instance. 1. Follow the prompts to specify the connection properties for the new connection profile. After specifying each value, press ENTER to continue. {{{#!highlight sql --Press: Ctrl+Shift+E to execute a query --To execute a specific query, hightlight the query before you execute it. -- To see a list of databases try: select * from sys.databases; -- To select a database to use try: Use UniversitySmall; -- To Show the tables in a database try: SELECT * FROM information_schema.tables; }}} For additional information see https://docs.microsoft.com/en-us/sql/linux/sql-server-linux-develop-use-vscode?view=sql-server-2017 [[/ExploreDbms|How to Explore the DBMS]] |
Line 6: | Line 77: |
* Lecture 1: It really easy that easy to do small things * Commandline [[DatabaseManagementSystems/DbConnectedExample|Connected Example]] * Forms [[DatabaseManagementSystems/DbDisconnectedExample|Disconnected Example]] |
* Lecture 1: It really is that easy to do small things * Commandline [[DatabaseManagementSystems/DbConnectedExample|Connected Example]] * Forms [[DatabaseManagementSystems/DbDisconnectedExample|Disconnected Example]] |
Line 11: | Line 81: |
* [[http://msdn.microsoft.com/en-us/library/system.data.dataset.aspx?PHPSESSID=tn8k5p1s508cop8gr43e1f34d2|DataSet Class]] * Filled by [[http://msdn.microsoft.com/en-us/library/bz9tthwx%28VS.80%29.aspx|TableAdapter]] contained in the [[http://msdn.microsoft.com/en-us/library/bb384426.aspx|TableAdapterManager]] * [[http://msdn.microsoft.com/en-us/library/system.windows.forms.bindingsource.aspx|BindingSource as a service provider]] * How are GUI elements bound then? * How do the GUI elements change? * [[http://msdn.microsoft.com/en-us/library/system.windows.forms.bindingnavigator.aspx|BindingNavigator]] * Lecture 3: Detail Tables and other GUI Objects * Extended Reading: [[http://msdn.microsoft.com/en-us/library/aa697427%28VS.80%29.aspx|Entity Framework and LINQ]] == Programming Resources == |
* [[http://msdn.microsoft.com/en-us/library/system.data.dataset.aspx?PHPSESSID=tn8k5p1s508cop8gr43e1f34d2|DataSet Class]] * Filled by [[http://msdn.microsoft.com/en-us/library/bz9tthwx(VS.80).aspx|TableAdapter]] contained in the [[http://msdn.microsoft.com/en-us/library/bb384426.aspx|TableAdapterManager]] * [[http://msdn.microsoft.com/en-us/library/system.windows.forms.bindingsource.aspx|BindingSource as a service provider]] * How are GUI elements bound then? * How do the GUI elements change? * [[http://msdn.microsoft.com/en-us/library/system.windows.forms.bindingnavigator.aspx|BindingNavigator]] * Lecture 3: Detail Tables, Validation and other GUI Objects * What you bind to makes all the difference. * Responding to the Validating Event * For anything other than small, independent projects consider the [[http://msdn.microsoft.com/en-us/library/aa697427(VS.80).aspx|Entity Framework with LINQ]]. * Lecture 4: /EntityFrameworkExample Updated with WPF: /EntityFrameworkWpfExample ([[http://db.cs.southern.edu/Videos/CPTR319/WPFEF/WPFEF.html|Video]]) * [[/AssociationTablePattern|ORM's and Entity Framework]] * [[http://weblogs.asp.net/scottgu/archive/2011/05/05/ef-code-first-and-data-scaffolding-with-the-asp-net-mvc-3-tools-update.aspx|Another Cool MVC 3 ASP.NET tool that builds most of your code for you]] * [[SqlBackupAll|Scripting a complete Backup]] == Database diagrams == * We are now using [[vertabelo.com|Vertebelo]] for database diagrams. == Programming & Design Resources == |
Line 24: | Line 106: |
* Domain Driven Design has an entire website to look at: http://domaindrivendesign.org/ * NHibernate: http://nhibernate.org * Naked Entites/Objects (http://www.nakedobjects.com) is a for pay framework * CSLA.NET * SpecExpress http://specexpress.codeplex.com |
* [[http://domaindrivendesign.org/|Domain Driven Design website]] * [[http://msdn.microsoft.com/en-us/practices/default.aspx|MSDN Patterns and Practices]] * [[http://nhibernate.org|NHibernate]] * [[http://specexpress.codeplex.com|SpecExpress]] * [[http://www.jetbrains.com/teamcity/download/|TeamCity]] |
Line 32: | Line 114: |
== Project Ideas == See: [[DatabaseManagementSystems/Cptr319ProjectIdeas|Project Ideas]] == Chapter Notes and Hints == These notes and hints serve to review you for exams and to help you with your homework. Occasionally you will find information here that is not in the book. You should READ THIS BEFORE YOU DO YOUR HOMEWORK! === Chapter 3 and 4 Hints === If you are having problems joining tables in the FROM and WHERE clauses, you are in the majority. There are two hints that I will give you to help you obtain the right perspective on joining tables: '''Rule 1:''' Just because two attributes have the same name doesn't mean that you should join them on these attributes. STOP, THINK about the semantics (the meaning) of the attribute. Do they both refer to the same thing? If the answer is yes, then you should join on them. Using NATURAL JOIN will match strings, not semantics, so be careful. Also NATURAL JOIN "works" but not on most systems and even on Oracle it is not encouraged... so DON'T USE IT ON YOUR HOMEWORK. If you do I'll run it on Oracle. If it doesn't work, you will be docked points accordingly. '''Rule 2:''' When you are looking at the attributes and relations, something is a foreign key only if it is '''the''' primary key in a '''different''' relation. Even if the foreign key is part (but not all) of the key in the relation it is in, it is a foreign key. '''Rule 3:''' The book doesn't always give you all the attributes that make up the primary key. Look carefully at the values and make sure when you create tables in Chapter 4 that the attributes you select to be the primary key are sufficient to uniquely identify a each row. === Chapter 5: Advanced SQL === * /ViewExample * /ConcatenateStringsExample === Chapter 6.1: Relational Algebra === '''Rule 1:''' You don't need to qualify the results of a natural join. The results of a natural join ALWAYS only have one copy of overlapping attributes. '''Rule 2:''' Predicates, attribute lists and functions in $$\sigma, \Pi, \mathcal{G}$$ are always subscript. '''Rule 3:''' Relations, whether expressions or names, NEVER appear as a superscript or subscript. '''Rule 4:''' Input relations, whether expressions or name, always have parenthesis around them. E.g. $$$\Large~_{sect\_id,course\_id,year,semester}\mathcal{G}_{count(ID)}(student \bowtie takes)$$$ === Chapter 7 === Answers provided by the book to 7.2 seem a bit rough to me. You will find an image that expands on the book's answer here: [[attachment:Ch7.16 Annotated Drawings.pdf]] === Chapter 8 === ==== Normal Forms ==== The following definition of a relation is adapted from Database Processing by Kronke. A relation has the following characteristics * Rows contain data about an entity * Columns contain data about attributes the entity * All entities entries in a column are the same kind * Each column has a unique name * Cells of the table hold a single (atomic) value * The order of the columns is unimportant * The order of the rows is unimportant * Now two rows may be identical The following definitions are found in "Database System Concepts" Sixth Edition by Silberschatz, Korth and Sudarshan '''First Normal Form p. 328''' A relation $$R$$ is in first normal form if the domains of all attributes of $$R$$ are atomic. '''Second Normal Form p. 372''' A relation $$R$$ is in second normal form if each attribute $$A$$ in $$R$$ meets one of the following criteria: * It appears in a candidate key * It is not partially dependent on a candidate key. '''Partial Dependency p. 372''' A functional dependency $$\alpha \rightarrow \beta$$ is called a partial dependency if there is a proper subset $$\gamma$$ of $$\alpha$$ such that $$\gamma \rightarrow \beta$$. We say that $$\beta$$ is partially dependent on $$\alpha$$. \end{definition} '''Third Normal Form p. 336''' A relation schema $$R$$ is in third normal form with respect to a set $$F$$ of functional dependencies if, for all functional dependencies in $$F^+$$ of the form $$\alpha \rightarrow \beta$$, where $$\alpha \subseteq R$$ and $$\beta \subseteq R$$, at least one of the following holds: * $$\alpha \rightarrow \beta$$ is a trivial functional dependency (that is, $$\beta \subseteq \alpha$$). * $$\alpha$$ is a superkey for schema $$R$$. * Each attribute $$A$$ in $$\beta - \alpha$$ is contained in a candidate key for $$R$$. '''Boyce Codd Normal Form (BCNF) p. 333''' A relation schema $$R$$ is in BCNF with respect to a set $$F$$ of functional dependencies if, for all functional dependencies in $$F^+$$ of the form $$\alpha \rightarrow \beta$$, where $$\alpha \subseteq R$$ and $$\beta \subseteq R$$, at least one of the following holds: * $$\alpha \rightarrow \beta$$ is a trivial functional dependency (that is, $$\beta \subseteq \alpha$$). * $$\alpha$$ is a superkey for schema $$R$$. '''Fourth Normal Form pp. 358-359''' A relation schema $$r(R)$$ is in fourth normal form with respect to a set $$D$$ of functional and multivalued dependencies if, for all multivalued dependencies in $$D^+$$ of the form $$\alpha \rightarrow \rightarrow \beta$$, where $$\alpha \subseteq R$$ and $$\beta \subseteq R$$, at least one of the following holds: * $$\alpha \rightarrow \rightarrow \beta$$ is a trivial multivalued dependency. * $$\alpha$$ is a superkey for schema $$R$$. === Chapter 20 === Using this data: [[attachment:Aircraft Data.xlsx]] Import the data into a database and try the following query. Try the following query: {{{ USE Aircraft GO SELECT [Eng.HP], [Description], AVG(Cruise) AS AvgCruise, AVG(TopSpd) AS AvgTopSpeed, AVG([Gross Wt.]) AS AvgWt, AVG(UsefulLoad) AS avgUsefulLoad, AVG(GPH) AS AvgFuelFlow FROM AirCraftData GROUP BY [Eng.HP], [Description] WITH CUBE ORDER BY AvgFuelFlow; }}} |
Database Management Systems
Contents
Course Description
Introduction to database management systems, including data modeling, query languages and processing, database design, data integrity and security. Issues related to distributed database systems, object-oriented database systems, and legacy database systems are also discussed.
Purpose, Goals & Objectives
Introduction to database management systems, including data modeling, query languages and processing, database design, data integrity and security. Issues related to distributed database systems, object-oriented database systems, and legacy database systems are also discussed. At the conclusion of this course a student will:
- Understand the difference between the file-oriented method of building applications and the database method.
- Learn and practice data modeling using the E-R model.
- Learn and practice designing normalized databases using the E-R.
- Learn the fundamentals of the relational data model and understand its role in database implementation.
- Learn and practice SQL and Relational Algebra.
- Design and implement a relational database and application in C# using SQL server.
- Understand the implications and problems of enterprise database systems and study solutions to some of the problems.
- Understand the role of the "people" involved in a database system.
- Understand the need for data warehousing and mining applications.
- Understand the uses of spatial temporal and constraint databases.
Resources
Database Management Systems Child Pages
This class is about Database Management Systems. As such we talk about creating, managing and programming SQL databases. When time permits, we also cover spatial/spatial temporal data and database systems. This site contains content developed by Dr. Anderson for his classes.
Accessing Database Examples using SQLite Browser
- Download the SQLite Browser for your platform
- Download a SQLite DB file provided on eclass.
- Open it in your SQLite Browser ... and enjoy the simplicity and cross platform-ness!
Accessing the Database using Visual Studio Code
First off, we will be using SQLite Browser, so you won't need Visual Studio Code accessing SQL Server very soon (I'll let you know when)!
If you haven't done so, install VSCode with the mssql extension.
- Click the extensions icon on the left tool bar.
- Search for and install mssql extension.
To use Visual Studio code mssql plugin
- Press CTRL+N. Visual Studio Code opens a new 'Plain Text' file by default.
- Press CTRL+K,M and change the language mode to SQL.
- Alternatively, open an existing file with .sql file extension. The language mode is automatically SQL for files that have the .sql extension.
- press CTRL+SHIFT+P (or F1) to open the Command Palette.
- Type sqlcon and press ENTER. (Select the MS SQL: Connect command.)
- Select Create Connection Profile. This creates a connection profile for your SQL Server instance.
- Follow the prompts to specify the connection properties for the new connection profile. After specifying each value, press ENTER to continue.
1 --Press: Ctrl+Shift+E to execute a query
2 --To execute a specific query, hightlight the query before you execute it.
3
4 -- To see a list of databases try:
5 select *
6 from sys.databases;
7
8 -- To select a database to use try:
9 Use UniversitySmall;
10
11 -- To Show the tables in a database try:
12 SELECT *
13 FROM information_schema.tables;
For additional information see https://docs.microsoft.com/en-us/sql/linux/sql-server-linux-develop-use-vscode?view=sql-server-2017
Programming Examples
- Lecture 1: It really is that easy to do small things
Commandline Connected Example
Forms Disconnected Example
- Lecture 2: Look at the Objects we used in the Forms from Lecture 1.
Filled by TableAdapter contained in the TableAdapterManager
BindingSource as a service provider
- How are GUI elements bound then?
- How do the GUI elements change?
- Lecture 3: Detail Tables, Validation and other GUI Objects
- What you bind to makes all the difference.
- Responding to the Validating Event
For anything other than small, independent projects consider the Entity Framework with LINQ.
Lecture 4: /EntityFrameworkExample Updated with WPF: /EntityFrameworkWpfExample (Video)
Another Cool MVC 3 ASP.NET tool that builds most of your code for you
Database diagrams
We are now using Vertebelo for database diagrams.
Programming & Design Resources
Learning to program something more complex than a one off programming assignments for students can be difficult. Where do the experts learn to program large database applications and what tools and methods do they use? This section is not an answer, but a suggestion on where to look for those answers. Someday, I hope to have a class that explores this in depth.
And many more to follow I'm sure.
Project Ideas
See: Project Ideas
Chapter Notes and Hints
These notes and hints serve to review you for exams and to help you with your homework. Occasionally you will find information here that is not in the book. You should READ THIS BEFORE YOU DO YOUR HOMEWORK!
Chapter 3 and 4 Hints
If you are having problems joining tables in the FROM and WHERE clauses, you are in the majority. There are two hints that I will give you to help you obtain the right perspective on joining tables:
Rule 1: Just because two attributes have the same name doesn't mean that you should join them on these attributes. STOP, THINK about the semantics (the meaning) of the attribute. Do they both refer to the same thing? If the answer is yes, then you should join on them. Using NATURAL JOIN will match strings, not semantics, so be careful. Also NATURAL JOIN "works" but not on most systems and even on Oracle it is not encouraged... so DON'T USE IT ON YOUR HOMEWORK. If you do I'll run it on Oracle. If it doesn't work, you will be docked points accordingly.
Rule 2: When you are looking at the attributes and relations, something is a foreign key only if it is the primary key in a different relation. Even if the foreign key is part (but not all) of the key in the relation it is in, it is a foreign key.
Rule 3: The book doesn't always give you all the attributes that make up the primary key. Look carefully at the values and make sure when you create tables in Chapter 4 that the attributes you select to be the primary key are sufficient to uniquely identify a each row.
Chapter 5: Advanced SQL
Chapter 6.1: Relational Algebra
Rule 1: You don't need to qualify the results of a natural join. The results of a natural join ALWAYS only have one copy of overlapping attributes.
Rule 2: Predicates, attribute lists and functions in $$\sigma, \Pi, \mathcal{G}$$ are always subscript.
Rule 3: Relations, whether expressions or names, NEVER appear as a superscript or subscript.
Rule 4: Input relations, whether expressions or name, always have parenthesis around them. E.g.
$$$\Large~_{sect\_id,course\_id,year,semester}\mathcal{G}_{count(ID)}(student \bowtie takes)$$$
Chapter 7
Answers provided by the book to 7.2 seem a bit rough to me. You will find an image that expands on the book's answer here: Ch7.16 Annotated Drawings.pdf
Chapter 8
Normal Forms
The following definition of a relation is adapted from Database Processing by Kronke. A relation has the following characteristics
- Rows contain data about an entity
- Columns contain data about attributes the entity
- All entities entries in a column are the same kind
- Each column has a unique name
- Cells of the table hold a single (atomic) value
- The order of the columns is unimportant
- The order of the rows is unimportant
- Now two rows may be identical
The following definitions are found in "Database System Concepts" Sixth Edition by Silberschatz, Korth and Sudarshan
First Normal Form p. 328 A relation $$R$$ is in first normal form if the domains of all attributes of $$R$$ are atomic.
Second Normal Form p. 372 A relation $$R$$ is in second normal form if each attribute $$A$$ in $$R$$ meets one of the following criteria:
- It appears in a candidate key
- It is not partially dependent on a candidate key.
Partial Dependency p. 372 A functional dependency $$\alpha \rightarrow \beta$$ is called a partial dependency if there is a proper subset $$\gamma$$ of $$\alpha$$ such that $$\gamma \rightarrow \beta$$. We say that $$\beta$$ is partially dependent on $$\alpha$$. \end{definition}
Third Normal Form p. 336 A relation schema $$R$$ is in third normal form with respect to a set $$F$$ of functional dependencies if, for all functional dependencies in $$F^+$$ of the form $$\alpha \rightarrow \beta$$, where $$\alpha \subseteq R$$ and $$\beta \subseteq R$$, at least one of the following holds:
- $$\alpha \rightarrow \beta$$ is a trivial functional dependency (that is, $$\beta \subseteq \alpha$$).
- $$\alpha$$ is a superkey for schema $$R$$.
- Each attribute $$A$$ in $$\beta - \alpha$$ is contained in a candidate key for $$R$$.
Boyce Codd Normal Form (BCNF) p. 333 A relation schema $$R$$ is in BCNF with respect to a set $$F$$ of functional dependencies if, for all functional dependencies in $$F^+$$ of the form $$\alpha \rightarrow \beta$$, where $$\alpha \subseteq R$$ and $$\beta \subseteq R$$, at least one of the following holds:
- $$\alpha \rightarrow \beta$$ is a trivial functional dependency (that is, $$\beta \subseteq \alpha$$).
- $$\alpha$$ is a superkey for schema $$R$$.
Fourth Normal Form pp. 358-359 A relation schema $$r(R)$$ is in fourth normal form with respect to a set $$D$$ of functional and multivalued dependencies if, for all multivalued dependencies in $$D^+$$ of the form $$\alpha \rightarrow \rightarrow \beta$$, where $$\alpha \subseteq R$$ and $$\beta \subseteq R$$, at least one of the following holds:
- $$\alpha \rightarrow \rightarrow \beta$$ is a trivial multivalued dependency.
- $$\alpha$$ is a superkey for schema $$R$$.
Chapter 20
Using this data: Aircraft Data.xlsx
Import the data into a database and try the following query.
Try the following query:
USE Aircraft GO SELECT [Eng.HP], [Description], AVG(Cruise) AS AvgCruise, AVG(TopSpd) AS AvgTopSpeed, AVG([Gross Wt.]) AS AvgWt, AVG(UsefulLoad) AS avgUsefulLoad, AVG(GPH) AS AvgFuelFlow FROM AirCraftData GROUP BY [Eng.HP], [Description] WITH CUBE ORDER BY AvgFuelFlow;