Skip to content

Latest commit

 

History

History

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 
 
 
 
 
 
 
 
 

README.md

ice-rest-catalog

A dead-simple Iceberg REST Catalog backed by etcd.

Usage

Generally speaking, all you need to start your own instance of ice-rest-catalog is to create .ice-rest-catalog.yaml (schema defined here) and then execute ice-rest-catalog. That's it.

Examples of .ice-rest-catalog.yaml (as well as Kubernetes deployment manifests) can be found here.

Documentation

  • Architecture -- components, design principles, HA, backup/recovery
  • Kubernetes Setup -- k8s deployment with etcd StatefulSet and replicas
  • etcd Cluster Setup -- docker-compose setup with 3-node etcd, data insertion, replication verification, ClickHouse queries
  • GCS Setup -- configuring ice-rest-catalog with Google Cloud Storage
  • etcd Backend Schema -- etcd key/value schema (n/, t/ prefixes) and mapping to SQLite
  • SQLite Backend Schema -- SQLite tables (iceberg_tables, iceberg_namespace_properties)