pathwaycom/pathway
A Python framework for building data pipelines whose results update themselves when new or changed rows arrive. The engine underneath is written in Rust, and the same code runs on a static file or a live feed. It also includes helpers for LLM calls, embeddings, text splitting, and an in-memory vector index for retrieval.
Idea adaptedKey files read, not run
I learnt this repo's idea and adapted it into my own workspace setup.
How we know
We read the README and key files, not every source file, and did not run it, so the most we can say is Idea adapted or Risky.
Good for
Teams that need a pipeline to follow live data from Kafka, a database, or a shared drive and keep fresh context ready for an LLM.
Not for
One-off batch scripts or small datasets, where pandas or plain SQL is simpler. The license is BSL, which is source-available rather than open source, so check it before commercial use.
Repo
- Stars
- 61,997
- License
- NOASSERTIONGitHub could not match this to a standard license. Read the repo's LICENSE file before you use it.
- Maturity
- active
- Last push
- 2026-11-14
- Last checked
- 2026-11-14