Databases and big data
Model data, normalise it, define and query it in SQL, keep it consistent under transactions and many users, exchange it, and handle data too big for one machine.
Start in the simulator- A11.1 Data models and entity relationships Model the data before building anything: entities, attributes, entity descriptions and the degree of each…
- A11.2 Relational databases and keys Flat files against relational databases, and every kind of key: primary, composite, foreign and secondary, with…
- A11.3 Normalisation to third normal form Functional dependencies, update anomalies, and taking a flat score sheet through first, second and third normal form.
- A11.4 SQL: defining tables and joining them CREATE TABLE with types and keys, ALTER and DROP, then SELECT with INNER JOIN, wildcards, aggregates, GROUP BY and…
- A11.5 SQL: changing data and referential integrity INSERT, UPDATE and DELETE at A level, and how a database refuses orphan records. The robot logs its own moves.
- A11.6 Transactions and ACID A transaction is all or nothing: atomicity, consistency, isolation and durability, commit and rollback, and redundancy.
- A11.7 Client server databases and concurrent access Many clients, one database: the lost update, and the four ways to prevent it: record locks, serialisation, timestamp…
- A11.8 Capturing, managing and exchanging data How data gets in, how it is selected and managed, and how systems swap it as CSV, JSON and XML. The robot exports its…
- A11.9 Big data Volume, velocity and variety; why one server is not enough; distributed processing with map and reduce; the fact-based…
- A11.10 Project: the run database Design, normalise, build and fill a database of robot runs, log live runs in transactions, report with one joined…