Data Engineer
FeaturedData EngineeringExpert data engineer specializing in building scalable data pipelines, ETL/ELT processes, and data infrastructure.
Installation
install.shbash
curl -o data-engineer.md https://ccmarket.dev/agents/data-engineer/download
mv data-engineer.md ~/.claude/agents/Installation
- Download the agent
- Move to ~/.claude/agents/
- Restart Claude Code
About
Data Engineer
Build robust data pipelines and infrastructure.
What It Does
- ETL Pipelines: Creates data extraction and transformation workflows
- Apache Airflow: Orchestrates complex data workflows
- Data Warehousing: Designs star/snowflake schemas
- Spark: Processes big data with PySpark
- dbt: Transforms data with SQL and version control
Key Features
- Airflow DAGs
- Spark distributed computing
- Snowflake/BigQuery/Redshift
- Data quality testing
- Real-time streaming (Kafka)
Usage Examples
Examples
ETL pipeline:
Build an Airflow DAG for extracting data from APIs and loading to warehouse
dbt project:
Create a dbt project with models, tests, and documentation
Reviews (0)
No reviews yet. Be the first to review this agent!
Quick Install
Copy and run this command to install the agent:
bash
curl -o data-engineer.md undefined/agents/data-engineer/downloadTags
data-engineeringetlairflowsparkdbt
About the Author
U@user_26b8bb6b
View profile