Computer Β· Part C - Software, Algorithms and Computation Β· Major topic 15 of 39

Databases, Data Management and Information Retrieval

Persisting, organizing, governing and retrieving information reliably across applications and organizations.

202 items insideAsked 4Γ— in the RPSC/RSSB papers we analysed, most recently 2023COM-15

Also look at: Science & Technology: Computer Architecture, Operating Systems, Programming and Software SystemsChemistry: Cheminformatics, Chemical Data & AI/ML for ChemistryScience & Technology: Internet, Networks, Web Architecture and Governance

  1. 1

    Historical evolution β€” key dates

    • Hierarchical and network database models serve large institutional systems.1960s
    • E. F. Codd publishes the relational database model.1970
    • SQL and relational database management systems mature.1970s-1980s
    • Data warehouses, web search and distributed storage expand.1990s-2000s
    • NoSQL, cloud databases, streaming data and large-scale analytics develop.2000s-2010s
    • Lakehouse architectures, vector search, real-time data platforms and AI retrieval systems broaden data management.2020s
  2. 2

    Data modelling

    Asked 1Γ— Β· last 2023

    • Entity, attribute, relationship, cardinality, key, constraint; conceptual/logical/physical models
      2 more points
      • Entity, attribute, relationship, cardinality, key, constraint
      • Conceptual/logical/physical models
    • ER diagrams; normalization; functional dependency; 1NF/2NF/3NF/BCNF; denormalization rationale
      5 more points
      • ER diagrams
      • Normalization
      • Functional dependency
      • 1NF/2NF/3NF/BCNF
      • Denormalization rationale
    • Relational schema; domain; primary/foreign/candidate keys; referential integrity; null semantics
      5 more points
      • Relational schema
      • Domain
      • Primary/foreign/candidate keys
      • Referential integrity
      • Null semantics
  3. 3

    Relational databases and SQL

    • DDL, DML, DCL, TCL; SELECT; WHERE; JOIN; GROUP BY; HAVING; ORDER BY; subqueries; CTEs; window functions
      10 more points
      • DDL, DML, DCL, TCL
      • SELECT
      • WHERE
      • JOIN
      • GROUP BY
      • HAVING
      • ORDER BY
      • Subqueries
      • CTEs
      • Window functions
    • INSERT/UPDATE/DELETE; constraints; views; indexes; sequences; stored procedures; triggers; transaction commands
      8 more points
      • INSERT/UPDATE/DELETE
      • Constraints
      • Views
      • Indexes
      • Sequences
      • Stored procedures
      • Triggers
      • Transaction commands
    • Query planning; execution plan; statistics; index selection; query rewrite; parameterized query safety
      6 more points
      • Query planning
      • Execution plan
      • Statistics
      • Index selection
      • Query rewrite
      • Parameterized query safety
  4. 4

    Transactions and concurrency

    Asked 3Γ— Β· last 2013

    • ACID; transaction boundaries; isolation levels; serializability; lock; deadlock; MVCC; optimistic concurrency
      8 more points
      • ACID
      • Transaction boundaries
      • Isolation levels
      • Serializability
      • Lock
      • Deadlock
      • MVCC
      • Optimistic concurrency
    • Write-ahead log; rollback; crash recovery; replication; consistency; durability; idempotency
      7 more points
      • Write-ahead log
      • Rollback
      • Crash recovery
      • Replication
      • Consistency
      • Durability
      • Idempotency
  5. 5

    Database families

    • Relational; key-value; document; wide-column; graph; time-series; in-memory; object store; search engine
      9 more points
      • Relational
      • Key-value
      • Document
      • Wide-column
      • Graph
      • Time-series
      • In-memory
      • Object store
      • Search engine
    • Embedded vs client-server; OLTP vs OLAP; analytical vs operational stores; polyglot persistence
      4 more points
      • Embedded vs client-server
      • OLTP vs OLAP
      • Analytical vs operational stores
      • Polyglot persistence
  6. 6

    Distributed data and scalability

    • Partitioning; sharding; replication; leader/follower; quorum; eventual consistency; conflict resolution
      7 more points
      • Partitioning
      • Sharding
      • Replication
      • Leader/follower
      • Quorum
      • Eventual consistency
      • Conflict resolution
    • Distributed transactions; two-phase commit; consensus concepts; change data capture; global IDs
      5 more points
      • Distributed transactions
      • Two-phase commit
      • Consensus concepts
      • Change data capture
      • Global IDs
    • CAP theorem as a model with assumptions; PACELC; failure modes; read/write consistency options
      4 more points
      • CAP theorem as a model with assumptions
      • PACELC
      • Failure modes
      • Read/write consistency options
  7. 7

    Warehousing and data architecture

    • ETL/ELT; staging; data warehouse; data mart; lake; lakehouse; star/snowflake schema; fact/dimension tables
      8 more points
      • ETL/ELT
      • Staging
      • Data warehouse
      • Data mart
      • Lake
      • Lakehouse
      • Star/snowflake schema
      • Fact/dimension tables
    • Batch vs streaming; orchestration; lineage; catalog; data contracts; semantic layer; metric definitions
      7 more points
      • Batch vs streaming
      • Orchestration
      • Lineage
      • Catalog
      • Data contracts
      • Semantic layer
      • Metric definitions
  8. 8

    Information retrieval and search

    • Document indexing; inverted index; tokenization; stemming/lemmatization; ranking; BM25 concepts; relevance metrics
      7 more points
      • Document indexing
      • Inverted index
      • Tokenization
      • Stemming/lemmatization
      • Ranking
      • BM25 concepts
      • Relevance metrics
    • Search operators; spell correction; query expansion; faceted search; crawling; freshness; duplicate detection
      7 more points
      • Search operators
      • Spell correction
      • Query expansion
      • Faceted search
      • Crawling
      • Freshness
      • Duplicate detection
    • Vector representations; nearest-neighbour search; hybrid search; metadata filtering; retrieval evaluation
      5 more points
      • Vector representations
      • Nearest-neighbour search
      • Hybrid search
      • Metadata filtering
      • Retrieval evaluation
  9. 9

    Data quality and governance

    • Accuracy; completeness; consistency; timeliness; validity; uniqueness; profiling; validation rules
      8 more points
      • Accuracy
      • Completeness
      • Consistency
      • Timeliness
      • Validity
      • Uniqueness
      • Profiling
      • Validation rules
    • Metadata; provenance; lineage; ownership; stewardship; access policy; retention; deletion; audit trail
      9 more points
      • Metadata
      • Provenance
      • Lineage
      • Ownership
      • Stewardship
      • Access policy
      • Retention
      • Deletion
      • Audit trail
    • PII classification; anonymization/pseudonymization; consent; data residency; legal basis; minimization
      6 more points
      • PII classification
      • Anonymization/pseudonymization
      • Consent
      • Data residency
      • Legal basis
      • Minimization
  10. 10

    Data pipelines and resilience

    • Schema evolution; migration; backfill; late-arriving data; retries; deduplication; checkpoint; replay
      8 more points
      • Schema evolution
      • Migration
      • Backfill
      • Late-arriving data
      • Retries
      • Deduplication
      • Checkpoint
      • Replay
    • Backup/restore; replication lag; recovery point/time objectives; disaster recovery testing
      4 more points
      • Backup/restore
      • Replication lag
      • Recovery point/time objectives
      • Disaster recovery testing
  11. 11

    Advanced data systems

    • Graph query and graph analytics; stream processing; distributed SQL; columnar storage; vector databases
      5 more points
      • Graph query and graph analytics
      • Stream processing
      • Distributed SQL
      • Columnar storage
      • Vector databases
    • Database internals; buffer pool; B-tree/LSM tree; compaction; cost-based optimization; storage engines
      6 more points
      • Database internals
      • Buffer pool
      • B-tree/LSM tree
      • Compaction
      • Cost-based optimization
      • Storage engines