Produce documented data cleaning scripts that log every transformation with N before/after each step, generate a CONSORT-style exclusion…
Use to build Molecular Cell's data and code deposition plan and the Data and Code Availability statement inside STAR Methods Resource…
Use to build PNAS's Data Availability Statement and deposition plan — mandatory deposition of data in an approved repository at…
Use to build PNAS Nexus's Data and Code Availability — mandatory public-repository deposition of all materials, data, code, and protocols…
Use to build Science's data, code, and materials availability — mandatory deposition in approved repositories, accession numbers, a…
Define or review a data contract between a producer and consumers.
Design and verify data contracts, schema changes, migrations, rollbacks, backfills, compatibility windows, tenant isolation, and…
Prepare a replication package for the sewage-house-prices project.
Automate update and maintenance of data dictionaries in Treasure Data - generates 80-90% of column descriptions automatically, allowing…
Build scalable data pipelines, modern data warehouses, and real-time streaming architectures.
Evaluation criteria and scoring for data engineering artifact reviews
Data Engineering and Analytics, in 27 concepts.
Common patterns for extracting analytics data from GA4 and GSC with API handling
Quick data freshness check. Use when the user asks if data is up to date, when a table was last updated, if data is stale, or needs to…
Establish data ownership, quality standards, compliance policies, and metadata management.
🐉 Fetches and parses time-series data from various sources.
Constraints, triggers, audit trails, referential integrity, and data validation.
Join two datasets with automatic strategy selection (joinp vs join vs sqlp)
Design field mapping specifications between source and destination systems for synchronizing insurance AMS and CRM data, LOS to reporting…
Create safe, reversible database migration scripts with rollback capabilities, data validation, and zero-downtime deployments.
Design data models for business domains using entity-relationship or domain-driven design.