Baike.dev
All toolsOnline toolsAI codingTrendingOpen sourceNewsSubmit
Log in
< Back to tools
S

spdl

> 编程语言
Open source

Scalable and Performant Data Loading

397 stars0 likes2 views
WebsiteGitHub

About

Scalable and Performant Data Loading

SPDL

SPDL (Scalable and Performant Data Loading) is a library and project to explore the design of performant data loading.

It provides flexible pipeline abstraction and a set of operations used for processing array data.

Documentation

Please checkout the documentation.

License

SPDL is BSD 2-Clause licensed, as found in the LICENSE file.

Citation

Please use the following BibTex for citing our project if you find it useful.

@misc{hira2025scalableperformantdataloading,
   title={Scalable and Performant Data Loading},
   author={Moto Hira and Christian Puhrsch and Valentin Andrei and Roman Malinovskyy and Gael Le Lan and Abhinandan Krishnan and Joseph Cummings and Miguel Martin and Gokul Gunasekaran and Yuta Inoue and Alex J Turner and Raghuraman Krishnamoorthi},
   year={2025},
   eprint={2504.20067},
   archivePrefix={arXiv},
   primaryClass={cs.DC},
   url={https://arxiv.org/abs/2504.20067},
}

Issues· 21 open

View all issuesOpen on GitHub

No open issues yet, or sync has not completed.

> Tags

Pythondlml

No comments yet. Be the first to share.

> Details

PublishedAug 1, 2026
UpdatedSep 17, 2026
Category编程语言
PricingOpen source

> Related tools

T
TypeScript
JavaScript 的超集,为前端与全栈提供静态类型
P
Python
通用编程语言,广泛用于 Web、数据与 AI
G
Go
Google 推出的简洁高效系统语言