ποΈ Seasoned Data Platform Solutions Architect and Principal Data Engineer with 20+ years of experience designing and delivering enterprise data platforms across automotive, banking, and manufacturing sectors in Europe.
βοΈ I architect end-to-end solutions on Azure and Snowflake β from data ingestion and data modeling to governance and self-service analytics β while staying hands-on with π Python, SQL, CI/CD (Azure DevOps & GitHub Actions), and Infrastructure as Code.
π€ I actively pioneer the use of LLMs and AI Agents (RAG, PydanticAI, Semantic Kernel, MCP) to enhance data engineering workflows and platform intelligence.
π Certified on Azure, Snowflake, Google Cloud, with an MSc in Software & Systems Engineering and executive courses from Stanford and Harvard Business School.
Some of my projects are also available through agent plugin marketplaces and Microsoft's Awesome AZD catalog:
π§© iParqInspect Parquet metadata from your terminal or your coding agent. codex plugin marketplace add MiguelElGallo/iparq codex plugin add iparq@iparqVS Code: Chat: Install Plugin From Source |
π md-to-pdfTurn Markdown (with Mermaid diagrams) into polished PDFs. codex plugin marketplace add MiguelElGallo/md-to-pdf codex plugin add md-to-pdf@md-to-pdfVS Code: Chat: Install Plugin From Source |
β‘ FastAPI + Snowflake on Azure Functions
azd init --template MiguelElGallo/simple-fastapi-snow-azd
|
π Simple Streamlit on Azure App Service
azd init --template MiguelElGallo/simple-streamlit-azd
|
π€ FastMCP on Azure App Service
azd init --template MiguelElGallo/myfirstmcp-openai
|
Press βΆ on a cover to watch the video. Each demo links to the repository behind it.
|
π HelloJev: smarter pipeline failure decisions β± 42 sec Β· βΆ Watch video Β· π¦ Repository |
|
|
tgrep for VS Code β± 24 sec Β· βΆ Watch video Β· π¦ Repository |
tgrep for Codex β± 24 sec Β· βΆ Watch video Β· π¦ Repository |
|
docdr β± 28 sec Β· βΆ Watch video Β· π¦ Repository |
Databricks Metric View β± 28 sec Β· βΆ Watch video Β· π¦ Repository |
|
Agent Plugin Forge β± 38 sec Β· βΆ Watch video Β· π¦ Repository |
Team skills: one shared home β± 60 sec Β· βΆ Watch video Β· π¦ Repository |
π€ This level is regenerated every Sunday by a GitHub Copilot SDK agent.
Here are the repositories I maintain or contribute to: πΉοΈ High-score table Β· sorted by stars, then latest push Β· π data Β· π€ AI
| # | Repository | β | What it does | π Python libraries | βοΈ Azure services | Tags |
|---|---|---|---|---|---|---|
| π₯ | mpzsql | 28 | Arrow Flight SQL DuckDB lakehouse | azure-identity duckdb grpcio pyarrow pyjwt |
Blob Storage, Container Apps, PostgreSQL | π |
| π₯ | iparq | 25 | Parquet metadata inspection CLI | pyarrow pydantic rich typer |
- | π |
| π₯ | modelando | 11 | Bilingual data modeling materials | - | - | π |
| 04 | api-elt | 9 | ELT pipeline for APIs | dlt python-dotenv |
- | π |
| 05 | azquack | 6 | DuckDB Quack protocol Azure | duckdb |
Blob Storage, Container Apps | π |
| 06 | snowflake-semantic-view-skill | 6 | Snowflake semantic view skill | - | - | π π€ |
| 07 | FastAPI-in-Snowflake | 4 | FastAPI in Snowflake containers | fastapi passlib python-jose snowflake-connector-python uvicorn |
- | π |
| 08 | SynapseApacheIceBergExperiment | 4 | Apache Iceberg on Synapse Spark | - | Synapse Analytics | π |
| 09 | evsnow | 3 | Event Hubs to Snowflake streaming | azure-eventhub azure-identity pydantic-ai snowflake-connector-python |
Event Hubs | π π€ |
| 10 | simple-streamlit-azd | 3 | Streamlit on Azure App Service | numpy pandas streamlit |
App Service | π |
| 11 | sensormatrix | 1 | ESP32 sensor testing framework | pydantic pyserial pyyaml typer |
- | π |
| 12 | snapshottest | 1 | Inline snapshot testing demo | httpx inline-snapshot rich typer |
- | - |
| 13 | ragsql | 1 | RAG-powered SQL queries | langchain openai snowflake-connector-python |
- | π π€ |
| 14 | md-to-pdf | - | Markdown to PDF converter | - | - | - |
| 15 | agent-plugin-forge | - | Agent Skills to Plugins | jsonschema license-expression pydantic pyyaml semantic-version |
- | π€ |
| 16 | HelloJev | - | Pipeline failure decisions AI | - | - | π π€ |
| 17 | RioArriba | - | River shooter arcade game | - | - | - |
| 18 | st | - | Token saver for repositories | - | - | - |
| 19 | docdr | - | Documentation doctor skill | - | - | π€ |
| 20 | bricksgdpr | - | Databricks dbt GDPR demo | dbt-core dbt-databricks |
- | π |
| 21 | homebrew-iparq | - | Homebrew iparq tap | - | - | - |
| 22 | dbtobsb | - | dbt Core Databricks observability | - | - | π |
| 23 | skill-metric-view-dbr | - | Databricks metric view skill | - | - | π π€ |
| 24 | Modelando2025 | - | Data modeling 2025 materials | mkdocs-material mkdocs-git-committers-plugin mkdocs-i18n |
- | π |
| 25 | api-test-pilot | - | Contract-driven API testing | httpx jsonschema pydantic pyyaml typer |
- | π€ |
| 26 | azure-ducklake-quack | - | Azure DuckLake Entra routing | - | Container Apps, PostgreSQL | π |
| 27 | evbricks | - | Event Hubs Databricks streaming | aiohttp azure-eventhub azure-identity databricks-zerobus-ingest-sdk |
Event Hubs | π |
| 28 | bricks-cli | - | dbt on Databricks CLI | - | - | π |
| 29 | codemode | - | Code Mode vs MCP comparison | mcp pydantic |
- | π€ |
| 30 | neoquack | - | DuckDB Quack free tiers | duckdb fastapi httpx psycopg |
- | π |
| 31 | SnowflakeCortexCLI | - | Snowflake Cortex CLI security | - | - | π π€ |
| 32 | snowdag | - | Airflow dbt Snowflake containers | - | - | π |
| 33 | fastapi-free | - | FastAPI free-threading benchmark | fastapi prometheus-client uvicorn |
- | - |
| 34 | ir-support-site | - | iOS app support pages | - | - | - |
| 35 | snow_iceberg_snowstorage | - | Snowflake Iceberg DuckDB | - | - | π |
| 36 | snowmcpaz | - | Snowflake MCP Azure auth | - | - | π π€ |
| 37 | jwtaztoken | - | Azure JWT token inspector | cryptography httpx pyjwt rich typer |
- | - |
| 38 | dlthubarrow | - | dlt Arrow on Azure | azure-monitor-opentelemetry dlt psutil pyarrow snowflake-connector-python |
Container Apps, Key Vault | π |
| 39 | snowdcm | - | Snowflake DCM objects | - | - | π |
| 40 | dlthubsnow | - | dlt in Snowflake | dlt requests |
- | π |
| 41 | Arrow_as_source | - | Arrow universal dataset | arrow duckdb polars pyarrow |
- | π |
| 42 | ghs | - | Sync env with GitHub | pydantic python-dotenv typer |
- | - |
| 43 | myfirstmcp-openai | - | FastMCP Azure App Service | gunicorn mcp uvicorn |
App Service | π€ |
| 44 | CallAPIfromLLM | - | LLM API calling demo | - | - | π€ |
| 45 | snowtofu | - | Snowflake OpenTofu IaC | - | Storage Account | π |
| 46 | simple-fastapi-snow-azd | - | FastAPI Snowflake Functions | fastapi snowflake-sqlalchemy |
Functions | π |
| 47 | embeddindataengineering | - | OpenAI embeddings Fabric | - | - | π π€ |
| 48 | mycv | - | Personal CV repository | - | - | - |
| 49 | dltHub-teesting | - | dltHub pytest testing | dlt duckdb mypy pytest |
- | π |
| 50 | ChartToMD | - | Chart to markdown RAG | aiohttp azure-identity pydantic typer |
- | π€ |
| 51 | SnowCLI | - | Snowflake CLI GitHub Actions | - | - | π |
| 52 | rag-graph | - | Graph RAG approaches | - | - | π€ |
| 53 | opeanai-rag-test | - | OpenAI RAG Spanish | openai python-dotenv |
- | π€ |
| 54 | ragvectordb | - | Multiple vector databases | - | AI Search | π π€ |
| 55 | azdcodespaces | - | AZD in Codespaces | - | - | - |
| 56 | azureaisearch | - | Azure AI Search embeddings | - | AI Search | π€ |
| 57 | azopenai_adx | - | Data Explorer embeddings | - | Data Explorer | π π€ |
| 58 | semker | - | Semantic Kernel examples | semantic-kernel |
- | π€ |
| 59 | dvsat | - | Data Vault satellite demo | - | - | π |
| 60 | JoinOrAssociation | - | BI tool fan trap handling | - | - | π |
πΎ Last saved: 2026-09-27





