Deployment support/Kedro deployer
Author: merelchtCreated Nov 23, 2022Updated Sep 17, 2026
Description
We want to offer users better support with deploying Kedro.
- Production deployment is important to drive value; we're at least a couple years past when people were happy just running things locally
- A large percentage of "hard" questions we get are related to deployment
- TODO: Consider quantifying this percentage and providing some examples
- The development team is also suffering
- The existing deployment guides have a lot of challenges and are hard to maintain
- Tribal knowledge about the different platforms and integrations (a few people wrote the deployment guides and plugins years ago)
- Have to know too much (nobody can be an expert at deploying to so many platforms)
Implementation ideas
- Short-term
- Support at least 1 "production" deployment archetype/stack out of the box
- Create a single set of best practices for deployment
- There should be a clear mapping from "best-practice Kedro pipeline" to "best-practice Kedro deployment"
- Medium-term
- Integrate with a universal deployment backend that opens the gateway to standardized deployment to more platforms (e.g. https://github.com/couler-proj/couler)
Questions
Source: kedro-org/kedro