Projects & Resources to help you become a better AI Developer.
Projects & Resources to help you become a better AI Developer.
Welcome to the AI Engineer Toolkit!
Designed to help software engineers and non-engineers build production-grade AI applications from scratch.
You will find every popular framework, tool, and resource to ship one AI project at a time!
If you want to learn Agent Engineering Fundamentals, check out Full stack Agent Engineer Fundementals
If you are new to AI engineering check out AI Engineering Fundementals
If you are new to software engineering check out SWE Fundamentals
If you need inspiration, check out example projects inside the sandbox.
If you are ready to build, check out the table below.
If you want more guidance, check out the upcoming Agent Engineering Bootcamp that starts on June 12th, 2025.
Explore the table below to find the right tools for your AI projects.
Each category includes cost details, use cases, and links to official documentation.
| Category | Tool Name | Cost Model | Use Case | Link |
|---|---|---|---|---|
| Model Providers | ||||
| OpenAI API | Paid API | GPT models | OpenAI | |
| Grok (xAI) | Paid API | Human-like reasoning for complex queries | Grok | |
| Google Gemini | Paid API | Multimodal AI for text and images | Gemini | |
| Hugging Face | Freemium | Open-source models and hosted inference | Hugging Face | |
| Anthropic Claude | Paid API | Safe, interpretable language models | Claude | |
| Prompt Engineering | ||||
| DSPy | Open-Source | Automate prompt optimization with code | DSPy | |
| LangChain | Open-Source | Build prompt-driven AI workflows | LangChain | |
| Haystack | Open-Source | Optimize prompts for RAG pipelines | Haystack | |
| Agenta | Open-Source | Experiment and deploy prompt variants | Agenta | |
| ⚙️ Backend | ||||
| FastAPI | Open-Source | Fast, modern Python APIs | FastAPI | |
| Flask | Open-Source | Lightweight web apps and APIs | Flask | |
| Django | Open-Source | Robust web framework with ORM | Django | |
| Node.js (Express) | Open-Source | Scalable backend with JavaScript | Express | |
| Frontend | ||||
| AI SDK (Vercel) | Open-Source | AI-ready UI components for React | AI SDK | |
| Streamlit | Open-Source | Rapid prototyping for data apps | Streamlit | |
| Gradio | Open-Source | Interactive ML model interfaces | Gradio | |
| Dash | Open-Source | Data-driven dashboards with Python | Dash | |
| Fullstack | ||||
| Next.js | Open-Source | React with SSR and built-in API routes | Next.js | |
| SvelteKit | Open-Source | Lightweight full-stack with Svelte | SvelteKit | |
| Nuxt.js | Open-Source | Vue.js with server-side rendering | Nuxt.js | |
| Meteor | Open-Source | Full-stack JavaScript framework | Meteor | |
| Databases | ||||
| Supabase | Freemium | Open-source Firebase alternative | Supabase | |
| PostgreSQL | Open-Source | Reliable relational database | PostgreSQL | |
| MongoDB | Open-Source | Flexible NoSQL for unstructured data | MongoDB | |
| SQLite | Open-Source | Lightweight, serverless database | SQLite | |
| Vector Databases | ||||
| ChromaDB | Open-Source | Simple vector store for embeddings | ChromaDB | |
| Pinecone | Paid API | Scalable, hosted vector search | Pinecone | |
| Weaviate | Open-Source | GraphQL-based vector database | Weaviate | |
| Qdrant | Open-Source | High-performance vector search | Qdrant | |
| Fine-tuning | ||||
| OpenAI Fine-Tuning | Paid API | Customize GPT models for your needs | OpenAI Fine-Tuning | |
| Hugging Face Trainer | Open-Source | Fine-tune transformers easily | Hugging Face Trainer | |
| Ludwig | Open-Source | Declarative fine-tuning for ML models | Ludwig | |
| PyTorch Lightning | Open-Source | Structured fine-tuning with PyTorch | PyTorch Lightning | |
| Agent Development | ||||
| LangGraph | Open-Source | Stateful agents with LangChain | LangGraph | |
| AG2 (AgentGraph) | Open-Source | Multi-agent orchestrators | AG2 | |
| CrewAI | Open-Source | Multi-agent workflows for automation | CrewAI | |
| AutoGen | Open-Source | Conversational agents with flexibility | AutoGen | |
| Wetrocloud | Paid API | RAG development with any resource type (YouTube, web, doc, json, etc.) | Wetrocloud | |
| Contextual AI | Paid API | End-to-end RAG including document understanding, retrieval, grounded generation, and evaluation | Contextual AI | |
| ️ Web Data Access | ||||
| Firecrawl | Freemium | Web scraping with caching | Firecrawl | |
| Jina AI Reader API | Freemium | Extract structured data from web pages | Jina AI | |
| Puppeteer | Open-Source | Dynamic content scraping via browser | Puppeteer | |
| Crawlee-Python | Open-Source | A web scraping and browser automation library to build reliable crawlers in Python | Crawlee-Python | |
| Evaluation Frameworks | ||||
| RAGAS | Open-Source | Evaluate RAG pipelines | RAGAS | |
| DeepEval | Open-Source | Custom metrics for LLM evaluation | DeepEval | |
| LangSmith | Freemium | Debug and evaluate LLM apps | LangSmith | |
| TruLens | Open-Source | Ground truth evaluation for LLMs | TruLens | |
| AgentEvals | Open-source | A collection of evaluators for agent steps | AgentEvals | |
| LMUnit | Open-source | Language model optimized for evaluating natural language unit tests | LMUnit | |
| Monitoring & Logging | ||||
| LangSmith | Freemium | Monitor and trace LLM applications | LangSmith | |
| Sentry | Freemium | Real-time error tracking | Sentry | |
| Prometheus | Open-Source | Metrics and alerting for syst |
No open issues yet, or sync has not completed.