Learning Resources

Several channels are available to get started with Apache Hamilton, learn advanced usage, and participate in the latest feature development.

📒 User Guide Documentation

The user guide gives a complete overview of Apache Hamilton’s features.

📚 Reference Documentation

The reference documentation details Apache Hamilton’s public API.

🌐 Ecosystem & Integrations

The ecosystem page lists all built-in integrations (pandas, Polars, Spark, etc.) and external community resources. Find reusable dataflows, blog posts, and video tutorials there.

✍ tryhamilton.dev

The tryhamilton.dev website provides interactive tutorials in-browser to learn specific Apache Hamilton concepts.

👋 Slack

The Slack channel is the ideal place to ask questions, request features, and give feedback.

📣 Talks & Videos

See the ecosystem page for links to video content and conference talks.

• 2024-02    Apache Hamilton Meet-up for February

  • Recording
  • [Slides](https://github.com/skrawcz/talks/files/14351139/Apache Hamilton.February.2024.Meetup.pdf)

• 2023-12    Why you should build your GenAI/LLM apps using Apache Hamilton. AICamp End of Year in SF

  • Recording
  • [Slides](https://github.com/skrawcz/talks/files/13666470/Why.you.should.build.your.GenAI\_LLM.apps.using.Apache Hamilton.pdf)

• 2023-12    Bridging Classic ML Pipelines with the World of LLMs. PyData Global

  • Slides

• 2023-11    Apache Hamilton: Natively bringing software engineering best practices to python data transformations. Scale by the Bay.

  • Recording
  • Slides

• 2023-09    Apache Hamilton: Natively bringing software engineering best practices to python data transformations. Bay Area Python Interest Group (BAYPIGgies)

  • [Slides](https://github.com/skrawcz/talks/files/12785978/BayPIGgies\_.Apache Hamilton.Talk.pdf)

• 2023-08    dbt + Apache Hamilton: Enabling you to maintain complex Python within dbt models. MDSFest’23

  • Recording
  • Slides

• 2023-06    Apache Hamilton: an OS tool to add to your LLM App toolbelt. LLM Avalanche.

  • Slides

• 2023-06    Feature Engineering with Apache Hamilton: Portability & Lineage. Budapest ML Forum June 2023

  • Slides

• 2023-06    British Cycling Data Platform in Python. Manchester PyData Meetup

  • Slides
  • Co-presented with Peter Robinson, and Murray Tait.

• 2023-04    Lightweight Lineage with Apache Hamilton. PyData Seattle

  • [Slides](https://github.com/skrawcz/talks/files/11399972/PyData-Seattl-Lightning-Talk-2023-Lighweight-Lineage-with-Apache Hamilton.pdf)

• 2023-01    Apache Hamilton: Natively bringing software engineering best practices to python data transformations. AI Camp Meetup San Jose

  • Slides

• 2022-10    Apache Hamilton: an open source, declarative, micro-framework for clean & robust feature transform code in Python. Feature Store Summit

  • Event
  • [Slides](https://github.com/skrawcz/talks/files/9759661/FS.Summit.2022.-.Apache Hamilton.pdf)

• 2022-09    Apache Hamilton: enabling software engineering best practices for data transformations via generalized dataflow graphs. DEco - First International Workshop on Data Ecosystems

  • Event
  • Slides

• 2022-09    Apache Hamilton: a modular open source declarative paradigm for high level modeling of dataflows. CDMS - First International Workshop on Composable Data Management Systems

  • Event
  • Slides
  • Paper

• 2022-08    Apache Hamilton: A Python Micro-Framework for tidy scalable Pandas. Scalable Pandas Meetup

  • Recording
  • [Slides](https://github.com/skrawcz/talks/files/9428705/Apache Hamilton.%40.Ponder.Pandas.meetup.pdf)

• 2022-08    Scalable feature engineering with Apache Hamilton on Ray. Ray Summit

  • [Slides](https://github.com/skrawcz/talks/files/9411082/Submitted.Slides.-.Ray.Summit\_.Scalable.feature.engineering.with.Apache Hamilton.on.Ray.pdf)

• 2022-07    Apache Hamilton: A Python Micro-Framework for Data / Feature Engineering. MLOPsWorld Bay Area

  • Slides

• 2022-05    Apache Hamilton: a python micro-framework for data / feature engineering at Stitch Fix. AICamp

  • Recording
  • [Slides](https://github.com/skrawcz/talks/files/8691633/AICamp.Apache Hamilton.Presentation.pdf)

• 2022-02    [Open Source] Apache Hamilton, a micro framework for creating dataframes, and its application at Stitch Fix. Apply(Meetup)

  • Event.
  • Recording
  • Slides

• 2021-12    Apache Hamilton an open source micro framework for creating dataframes. SF Python Meetup

  • Recording
  • Slides

📰 External Blogs

For external resources including blogs, see the ecosystem page. Here are some notable blog posts about Apache Hamilton:

• 2024-03    RAG: ingestion and chunking using Apache Hamilton and scaling to Ray, Dask, or PySpark
• 2024-02    A command line tool to improve your development workflow
• 2024-02    Monthly Meetup Recap and office hours
• 2024-02    Using IPython Jupyter Magic commands to improve the notebook experience
• 2024-02    Building a lightweight experiment manager
• 2024-01    Customizing Apache Hamilton’s Execution with the new Lifecycle API
• 2024-01    How well-structured should your data code be?
• 2024-01    From Dev to Prod: a ML Pipeline Reference Post
• 2023-12    Winning over hearts and minds at work: ADKAR my favorite change management approach
• 2023-11    🚀 We’re launching the Apache Hamilton Dataflow Hub!
• 2023-10    Separate data I/O from transformation – your future self will thank you.
• 2023-09    Retrieval augmented generation (RAG) with Streamlit, FastAPI, Weaviate, and Apache Hamilton!
• 2023-09    LLMOps: Production prompt engineering patterns with Apache Hamilton
• 2023-09    Feature Engineering with Apache Hamilton
• 2023-08    Expressing PySpark Transformations Declaratively with Apache Hamilton
• 2023-08    Containerized PDF Summarizer with FastAPI and Apache Hamilton
• 2023-08    Dynamic DAGs: Counting Stars with Apache Hamilton
• 2023-08    Featurization: Integrating Apache Hamilton with Feast
• 2023-07    Simplify Prefect Workflow Creation and Maintenance with Apache Hamilton
• 2023-07    Building a maintainable and modular LLM application stack with Apache Hamilton
• 2023-06    Simplify Airflow DAG Creation and Maintenance with Apache Hamilton
• 2023-05    Lineage + Apache Hamilton in 10 minutes
• 2022-11    Apache Hamilton + DBT in 5 minutes
• 2022-07    Tidy production pandas with Apache Hamilton
• 2022-06    Developing Scalable Feature Engineering DAGs with Metaflow & Apache Hamilton
• 2022-05    Apache Hamilton backstory and intro post on TDS
• 2022-05    Apache Hamilton + Pandas in five minutes
• 2022-05    Iterating with Apache Hamilton in a Notebook

🎙 Podcasts

• 2024-03    Apache Hamilton mention in Real Python, about ipython magic command post
• 2023-06    Exploring the Intersection of DAGs, ML Code, and Complex Code Bases: An Elegant Solution Unveiled with Stefan Krawczyk of DAGWorks
• 2022-08    S01 E08 - MLOps Week 8: The MLOps Mindset with Stefan Krawczyk
• 2022-04    MLOps dla 100 data scientistów (in Polish)
• 2021-09    Aggressively Helpful Platform teams