Computer Β· Part C - Software, Algorithms and Computation Β· Major topic 15 of 39
Databases, Data Management and Information Retrieval
Persisting, organizing, governing and retrieving information reliably across applications and organizations.
202 items insideAsked 4Γ in the RPSC/RSSB papers we analysed, most recently 2023COM-15
Also look at: Science & Technology: Computer Architecture, Operating Systems, Programming and Software SystemsChemistry: Cheminformatics, Chemical Data & AI/ML for ChemistryScience & Technology: Internet, Networks, Web Architecture and Governance
- 1
Historical evolution β key dates
- Hierarchical and network database models serve large institutional systems.1960s
- E. F. Codd publishes the relational database model.1970
- SQL and relational database management systems mature.1970s-1980s
- Data warehouses, web search and distributed storage expand.1990s-2000s
- NoSQL, cloud databases, streaming data and large-scale analytics develop.2000s-2010s
- Lakehouse architectures, vector search, real-time data platforms and AI retrieval systems broaden data management.2020s
- 2
Data modelling
- Entity, attribute, relationship, cardinality, key, constraint; conceptual/logical/physical models
2 more points
- Entity, attribute, relationship, cardinality, key, constraint
- Conceptual/logical/physical models
- ER diagrams; normalization; functional dependency; 1NF/2NF/3NF/BCNF; denormalization rationale
5 more points
- ER diagrams
- Normalization
- Functional dependency
- 1NF/2NF/3NF/BCNF
- Denormalization rationale
- Relational schema; domain; primary/foreign/candidate keys; referential integrity; null semantics
5 more points
- Relational schema
- Domain
- Primary/foreign/candidate keys
- Referential integrity
- Null semantics
- Entity, attribute, relationship, cardinality, key, constraint; conceptual/logical/physical models
- 3
Relational databases and SQL
- DDL, DML, DCL, TCL; SELECT; WHERE; JOIN; GROUP BY; HAVING; ORDER BY; subqueries; CTEs; window functions
10 more points
- DDL, DML, DCL, TCL
- SELECT
- WHERE
- JOIN
- GROUP BY
- HAVING
- ORDER BY
- Subqueries
- CTEs
- Window functions
- INSERT/UPDATE/DELETE; constraints; views; indexes; sequences; stored procedures; triggers; transaction commands
8 more points
- INSERT/UPDATE/DELETE
- Constraints
- Views
- Indexes
- Sequences
- Stored procedures
- Triggers
- Transaction commands
- Query planning; execution plan; statistics; index selection; query rewrite; parameterized query safety
6 more points
- Query planning
- Execution plan
- Statistics
- Index selection
- Query rewrite
- Parameterized query safety
- DDL, DML, DCL, TCL; SELECT; WHERE; JOIN; GROUP BY; HAVING; ORDER BY; subqueries; CTEs; window functions
- 4
Transactions and concurrency
- ACID; transaction boundaries; isolation levels; serializability; lock; deadlock; MVCC; optimistic concurrency
8 more points
- ACID
- Transaction boundaries
- Isolation levels
- Serializability
- Lock
- Deadlock
- MVCC
- Optimistic concurrency
- Write-ahead log; rollback; crash recovery; replication; consistency; durability; idempotency
7 more points
- Write-ahead log
- Rollback
- Crash recovery
- Replication
- Consistency
- Durability
- Idempotency
- ACID; transaction boundaries; isolation levels; serializability; lock; deadlock; MVCC; optimistic concurrency
- 5
Database families
- Relational; key-value; document; wide-column; graph; time-series; in-memory; object store; search engine
9 more points
- Relational
- Key-value
- Document
- Wide-column
- Graph
- Time-series
- In-memory
- Object store
- Search engine
- Embedded vs client-server; OLTP vs OLAP; analytical vs operational stores; polyglot persistence
4 more points
- Embedded vs client-server
- OLTP vs OLAP
- Analytical vs operational stores
- Polyglot persistence
- Relational; key-value; document; wide-column; graph; time-series; in-memory; object store; search engine
- 6
Distributed data and scalability
- Partitioning; sharding; replication; leader/follower; quorum; eventual consistency; conflict resolution
7 more points
- Partitioning
- Sharding
- Replication
- Leader/follower
- Quorum
- Eventual consistency
- Conflict resolution
- Distributed transactions; two-phase commit; consensus concepts; change data capture; global IDs
5 more points
- Distributed transactions
- Two-phase commit
- Consensus concepts
- Change data capture
- Global IDs
- CAP theorem as a model with assumptions; PACELC; failure modes; read/write consistency options
4 more points
- CAP theorem as a model with assumptions
- PACELC
- Failure modes
- Read/write consistency options
- Partitioning; sharding; replication; leader/follower; quorum; eventual consistency; conflict resolution
- 7
Warehousing and data architecture
- ETL/ELT; staging; data warehouse; data mart; lake; lakehouse; star/snowflake schema; fact/dimension tables
8 more points
- ETL/ELT
- Staging
- Data warehouse
- Data mart
- Lake
- Lakehouse
- Star/snowflake schema
- Fact/dimension tables
- Batch vs streaming; orchestration; lineage; catalog; data contracts; semantic layer; metric definitions
7 more points
- Batch vs streaming
- Orchestration
- Lineage
- Catalog
- Data contracts
- Semantic layer
- Metric definitions
- ETL/ELT; staging; data warehouse; data mart; lake; lakehouse; star/snowflake schema; fact/dimension tables
- 8
Information retrieval and search
- Document indexing; inverted index; tokenization; stemming/lemmatization; ranking; BM25 concepts; relevance metrics
7 more points
- Document indexing
- Inverted index
- Tokenization
- Stemming/lemmatization
- Ranking
- BM25 concepts
- Relevance metrics
- Search operators; spell correction; query expansion; faceted search; crawling; freshness; duplicate detection
7 more points
- Search operators
- Spell correction
- Query expansion
- Faceted search
- Crawling
- Freshness
- Duplicate detection
- Vector representations; nearest-neighbour search; hybrid search; metadata filtering; retrieval evaluation
5 more points
- Vector representations
- Nearest-neighbour search
- Hybrid search
- Metadata filtering
- Retrieval evaluation
- Document indexing; inverted index; tokenization; stemming/lemmatization; ranking; BM25 concepts; relevance metrics
- 9
Data quality and governance
- Accuracy; completeness; consistency; timeliness; validity; uniqueness; profiling; validation rules
8 more points
- Accuracy
- Completeness
- Consistency
- Timeliness
- Validity
- Uniqueness
- Profiling
- Validation rules
- Metadata; provenance; lineage; ownership; stewardship; access policy; retention; deletion; audit trail
9 more points
- Metadata
- Provenance
- Lineage
- Ownership
- Stewardship
- Access policy
- Retention
- Deletion
- Audit trail
- PII classification; anonymization/pseudonymization; consent; data residency; legal basis; minimization
6 more points
- PII classification
- Anonymization/pseudonymization
- Consent
- Data residency
- Legal basis
- Minimization
- Accuracy; completeness; consistency; timeliness; validity; uniqueness; profiling; validation rules
- 10
Data pipelines and resilience
- Schema evolution; migration; backfill; late-arriving data; retries; deduplication; checkpoint; replay
8 more points
- Schema evolution
- Migration
- Backfill
- Late-arriving data
- Retries
- Deduplication
- Checkpoint
- Replay
- Backup/restore; replication lag; recovery point/time objectives; disaster recovery testing
4 more points
- Backup/restore
- Replication lag
- Recovery point/time objectives
- Disaster recovery testing
- Schema evolution; migration; backfill; late-arriving data; retries; deduplication; checkpoint; replay
- 11
Advanced data systems
- Graph query and graph analytics; stream processing; distributed SQL; columnar storage; vector databases
5 more points
- Graph query and graph analytics
- Stream processing
- Distributed SQL
- Columnar storage
- Vector databases
- Database internals; buffer pool; B-tree/LSM tree; compaction; cost-based optimization; storage engines
6 more points
- Database internals
- Buffer pool
- B-tree/LSM tree
- Compaction
- Cost-based optimization
- Storage engines
- Graph query and graph analytics; stream processing; distributed SQL; columnar storage; vector databases
