archiving-databases

•

1.9k2593 months ago

Process use when you need to archive historical database records to reduce primary database size. This skill automates moving old data to archive tables or cold storage (S3, Azure Blob, GCS). Trigger with phrases like "archive old database records", "implement data retention policy", "move historical data to cold storage", or "reduce database size with archival".

Quick Install

npxskills add jeremylongshore/claude-code-plugins-plus-skills--skill archiving-databases

Instructions

Database Archival System

Overview

Implement automated data archival pipelines that move historical records from primary database tables to archive storage (archive tables, S3, Azure Blob, or GCS) based on age, status, or access frequency criteria.

Prerequisites

Database credentials with SELECT, INSERT, and DELETE permissions on source and archive tables
Cloud storage credentials (AWS S3, Azure Blob, or GCS) if archiving to cold storage
psql or mysql CLI for executing archival queries
aws s3, az storage, or gsutil CLI for cloud storage uploads
Understanding of data retention requirements and compliance policies (GDPR, HIPAA, SOX)
Current table sizes: SELECT pg_size_pretty(pg_total_relation_size('table_name')) to identify archival candidates

Instructions

Identify archival candidates by finding large tables with time-based data:

Loading…

Related Skills

skill-creator

Create or update AgentSkills. Use when designing, structuring, or packaging skills with scripts, references, and assets.

367,360

skill-creator

Create or update AgentSkills. Use when designing, structuring, or packaging skills with scripts, references, and assets.

367,309

1password

Set up and use 1Password CLI (op). Use when installing the CLI, enabling desktop app integration, signing in (single or multi-account), or reading/injecting/running secrets via op.

365,915

himalaya

CLI to manage emails via IMAP/SMTP. Use `himalaya` to list, read, write, reply, forward, search, and organize emails from the terminal. Supports multiple accounts and message composition with MML (MIME Meta Language).

365,885

Tags & Topics

aiautomationclaude-codedevopsmcpai-agents

Database Archival System

Overview

Prerequisites

Database credentials with SELECT, INSERT, and DELETE permissions on source and archive tables
Cloud storage credentials (AWS S3, Azure Blob, or GCS) if archiving to cold storage
psql or mysql CLI for executing archival queries
aws s3, az storage, or gsutil CLI for cloud storage uploads
Understanding of data retention requirements and compliance policies (GDPR, HIPAA, SOX)
Current table sizes: SELECT pg_size_pretty(pg_total_relation_size('table_name')) to identify archival candidates

Instructions

Identify archival candidates by finding large tables with time-based data:

Error	Cause	Solution
Foreign key violation during DELETE	Active child records still reference archived parent	Archive child records first; verify no active references exist before deleting parent records
Disk space not reclaimed after archival	PostgreSQL marks deleted rows as dead tuples but does not release space	Run `VACUUM FULL table_name` during maintenance window; or use `pg_repack` for online space reclamation
Archive batch interrupted mid-transaction	Network failure, timeout, or crash during archival	Transaction rollback ensures atomicity; restart from the last completed batch using batch_id tracking
Cloud storage upload fails	Network timeout, credential expiration, or bucket permissions	Implement retry with exponential backoff; verify credentials before starting; use multipart upload for files >100MB
Archived data needed for audit	Compliance request requires access to archived records	Query archive tables directly; or restore from cloud storage using the archive manifest to locate the correct files

archiving-databases

Database Archival System

Overview

Prerequisites

Instructions

Related Skills

skill-creator

skill-creator

1password

himalaya

skill-creator

skill-creator

1password

himalaya

Database Archival System

Overview

Prerequisites

Instructions

Output

Error Handling

Examples

Resources

Related Skills

skill-creator

skill-creator

1password

himalaya

Related Skills

skill-creator

skill-creator

1password

himalaya