- βοΈ MLOps Projects
- βοΈ Prompt Engineering
- π‘οΈ Responsible LLM
- π Vector Databases
- π€ Coding Agents
- π Blogs
- πΌοΈ UI
- π Security
- π Courses
- π§βπ« Tutorials
- ποΈ Training and Fine-Tuning
- π₯ Learn by Videos
- π Platforms
- ποΈ GitHub Organizations
- π§ Agent Frameworks
- π¬ Deep Research
- π·οΈ LLM-Based Scrapers
- π οΈ Autonomous Software Engineering
- π Evaluation, Observability, and Monitoring
- π Awesomeness
- π LangGraph Examples and Tutorials
- π§ MCP
- π Aggregation Sites
- π° LLM API Pricing
- π Datasets
- π§© Manus Related
-
π aibrix
Cost-efficient and pluggable infrastructure components for GenAI inference. -
π R2R
The most advanced AI retrieval system. Agentic Retrieval-Augmented Generation (RAG) with a RESTful API. -
π LitServe
Lightning-fast serving engine for any AI model of any size. Flexible, easy, and enterprise-scale. -
π docling
A document processing framework for AI-driven extraction and analysis. -
π Metaflow
Build, deploy, and manage AI/ML systems - from Netflix. -
π APIPark
An open-source platform for creating, managing, and deploying APIs for AI applications. -
π Beta9
Run serverless GPU workloads with fast cold starts on bare-metal servers, anywhere in the world. -
π dstack
A lightweight, open-source alternative to Kubernetes & Slurm, simplifying AI container orchestration with multi-cloud and on-prem support. Natively supports NVIDIA, AMD, TPU, and Intel accelerators. -
π n8n
Fair-code workflow automation platform with native AI capabilities. Combines visual building with custom code, self-host or cloud, 400+ integrations. -
π k0rdent
A platform for building and deploying AI-driven solutions (details limited). -
π Haystack
An open-source framework for building search systems with NLP and LLMs.- π Haystack Cookbook
-
π Jina Serve
Build multimodal AI applications with a cloud-native stack. -
π exo
Run your own AI cluster at home with everyday devices. -
π Oumi
Everything you need to build state-of-the-art foundation models, end-to-end. -
π Seldon Core
An open-source platform for deploying machine learning models at scale.- π₯ Video Demo
-
π vLLM
A high-performance LLM serving framework; hard to configure and deploy.- π vLLM Blog
-
π BentoML
A framework for building, shipping, and scaling AI applications with ease.- π Yatai Model Deployment at Scale on Kubernetes π¦οΈ
-
π OpenLLM
Run any open-source LLMs (e.g., Llama, Mistral) as OpenAI-compatible API endpoints in the cloud. -
π LMDeploy
A toolkit for deploying large language models efficiently. -
π KubeAI
Private Open AI on Kubernetes β very easy to test locally. -
π Ray
A distributed computing framework for scaling AI and Python workloads.- π LLM Applications Guide: A comprehensive guide to building RAG-based LLM applications for production.
-
π Flyte
A workflow automation platform for data and ML; similar to Ray. -
π SkyPilot
A framework for running AI workloads across clouds with cost optimization. -
π KubeFlow
An open-source platform for deploying and managing ML workflows on Kubernetes. -
π MLFlow
An open-source platform for managing the end-to-end machine learning lifecycle. -
π ZenML
An extensible, open-source MLOps framework for reproducible ML pipelines. -
π KAN
Kolmogorov-Arnold Networks for AI modeling on Azure. -
π LangChain
A framework for developing applications powered by language models. -
π LangGraph
A library for building stateful, multi-agent LLM applications. -
π LangGraph GUI
A graphical interface for LangGraph workflows. -
π LangServe
A tool for deploying LangChain apps as APIs; deprecated by:- π LangGraph Platform
-
π Mage AI
An open-source tool for building, running, and managing data pipelines. -
π Argilla
A collaboration platform for building high-quality datasets for NLP. -
π Great LangChain Projects
A curated list of notable LangChain-dependent projects. -
π ClearML
An open-source MLOps platform for experiment tracking and automation. -
π MindsDB
An open-source platform for applying ML to databases. -
π H2O AI
A suite of tools for building and deploying ML models. -
π KServe
A Kubernetes-based serverless ML inference platform from Red Hat. -
π TrustyAI Explainability
Tools for explainable AI, from Red Hat. -
π LLaMA Index
Turn your data into production-ready LLM applications. -
π OPEA Project
Open Platform for Enterprise AI, from Intel β runs on Xeon and Gaudi (as of 2024-10-20). -
π AWS MLOps Samples
A collection of MLOps examples for AWS SageMaker. -
π Data on EKS
Deploy data and ML workloads on Amazon EKS.- π Trainium/Inferentia Install
- π₯ Video Tutorial
- Uses vLLM project.
-
π Kubernetes LWS Project
Lightweight Workload Specification for Kubernetes. -
π Danswer
An AI-powered question-answering system for enterprise knowledge bases. -
π Plandex
An AI-driven terminal for planning and executing coding tasks. -
π Alluxio
Data orchestration for analytics and machine learning in the cloud. -
π FastChat
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena. -
π LiteLLM
A lightweight library for calling LLM APIs with a unified interface. -
π Vespa
Search, make inferences in, and organize vectors, tensors, text, and structured data, at serving time and any scale. -
π Pezzo
An open-source platform for managing and optimizing LLM operations. -
π Bolt.new
A platform for building AI-powered apps with any LLM. -
π TensorZero
A framework for scalable tensor operations in AI workflows. -
π LiteLLM Proxy Server
A proxy server for routing requests to multiple LLM providers.
-
π Prompt Engineering Guide
A comprehensive resource for crafting effective LLM prompts. -
π Awesome Prompt Engineering
A curated list of prompt engineering tools and resources. -
π Promptsite
A platform for sharing and testing LLM prompts. -
π Promptimizer
A tool for optimizing prompts for better LLM performance.
-
π Awesome Production ML
A collection of resources for ethical and production-ready ML. -
π Guardrails AI
A framework for adding safety and compliance to LLM applications. -
π E2B
A sandbox environment for running AI agents securely.
-
π Chroma
An open-source vector database for AI applications. -
π FAISS
A library for efficient similarity search and clustering of dense vectors. -
π Pinecone
A managed vector database for building AI-powered search. -
π Qdrant
A high-performance vector database for similarity search.- π Demo Code Search
Projects that can finish apps autonomously or assist with troubleshooting:
-
π Fragments
A tool for generating code snippets using AI agents. -
π Bolt.new
A web-based platform for rapid AI-driven app development. -
π V0
A generative UI tool powered by AI. -
π Lovable
An AI-assisted platform for building software. -
π Claude Artifacts
Interactive code and content generation from Anthropicβs Claude. -
π Vercel AI Chatbot
A full-featured, hackable Next.js AI chatbot built by Vercel. -
π CodeAct
An agent framework for autonomous code execution.- π OpenHands Issue
-
π OpenHands
An open-source AI coding assistant for software development. -
π SWE-Agent
An agent for solving software engineering tasks, from Princeton NLP.- From π Awesome AI Agents.
-
π Goose
An AI agent for code execution and testing. -
π MetaGPT
A multi-agent framework for simulating a software company with LLMs. -
π Multi-Agent Orchestrator
A framework for coordinating multiple AI agents, from AWS Labs.
-
π LangChain Blog
Official blog for LangChain updates and tutorials. -
π Phil Schmid's Blog
Technical insights on AI deployment and infrastructure. -
π Kaggle Announcements
Updates and announcements from the Kaggle community.
-
π Streamlit
A framework for building interactive data apps in Python. -
π Gradio
A tool for creating web-based interfaces for ML models. -
π Chainlit
A library for building conversational AI interfaces.
-
π Garak
A tool for testing LLM vulnerabilities, from NVIDIA. -
π LLM Backdoor
Research on backdoor attacks in large language models.
-
π LLM Course
A comprehensive course on building LLM applications. -
π LLM Apps: Evaluation
A course on evaluating LLM applications with Weights & Biases.
-
π Zep AI Agents with LangGraph
A tutorial on building AI agents with Zep and LangGraph. -
π Azumo: Exploring LangGraph
An in-depth guide to LangGraph for state management. -
π GenAI Agents
Examples and resources for generative AI agents.
-
π Axolotl
A tool for fine-tuning LLMs with ease. -
π TRL
Transformer Reinforcement Learning for fine-tuning LLMs. -
π AutoTrain LLM Fine-Tuning
Automated fine-tuning of LLMs with Hugging Face. -
π LLaMA Factory
A framework for training and fine-tuning LLaMA models. -
π₯ Video: Training Overview
A guide to LLM training basics. -
π₯ Video: ORPO/DPO/SFT Explained
Explains ORPO, DPO, and SFT techniques. -
π₯ Video Series: Advanced Training
Advanced training techniques; could n8n replicate this?
-
π₯ Local AI by NetworkChuck
Running AI locally with NetworkChuck. -
π₯ Additional Video 1
Miscellaneous AI-related content. -
π₯ Additional Video 2
Another AI tutorial or demo. -
π₯ Additional Video 3
Further AI exploration video.
- π Dify
An open-source platform for building AI-native applications.
-
π Meta LLaMA
Official GitHub for Metaβs LLaMA projects. -
π AWS Samples
Sample projects and code from AWS. -
π Google Cloud Generative AI
Generative AI resources from Google Cloud. -
π Oumi AI
Oumiβs open-source AI projects.
-
π Surf
A computer-use AI agent powered by OpenAI, interacting with E2B's virtual desktop environment via natural language. -
π Letta
Formerly MemGPT β a stateful agents framework with memory, reasoning, and context management. -
π OctoTools
An agentic framework with extensible tools for complex reasoning.- π Docs
- π Blog: Stanford's LLM Tool-Use Framework
-
π AI Companion
Meet Ava, the WhatsApp Agent. -
π MAGMA
A Foundation Model for Multimodal AI Agents from Microsoft. -
π Autogen
A multi-agent conversation framework from Microsoft. -
π CrewAI
A framework for orchestrating role-playing AI agents. -
π LangFlow
A visual framework for building LLM-powered applications. -
π FlowWise
A drag-and-drop tool for creating LLM workflows. -
π Julep
Not fully open-sourced β a new DSL and server for AI agents and multi-step tasks. -
π Vision Agent
An AI agent for vision-based tasks. -
π Parlant
A customer-facing LLM-agent framework to increase accuracy and reliability. -
π Tribe
Low-code tool to rapidly build and coordinate multi-agent teams. -
π Goose
An extensible AI agent that installs, executes, edits, and tests with any LLM.- π Blog
-
π SlackAgent An AI agent integrated with Slack for workflow automation.
-
π LightAgent
A highly lightweight, active Agentic Framework designed for multi-agent collaboration, resembling a swarm -
π Refact
AI Agent that handles engineering tasks end-to-end
-
π Open Deep Research
Tools and resources for deep AI research. -
π R1-V
Distillation training research for AI agents. -
π Deep Research
A repository for advanced AI research projects. -
π OpenDeepResearcher
An open-source deep research assistant. -
π DeepClaude
Research into Claude-like deep learning models. -
π DeepClaude by ErlichLiu
Another take on DeepClaude research.
-
π ScrapeGraphAI
Python scraper based on AI for web data extraction. -
π FireCrawl
A web crawler optimized for LLM data collection. -
π Crawl4AI
An AI-powered web crawling framework. -
π Tourist
A lightweight scraper for LLM training data. -
π GPT-Crawler
A crawler designed for GPT-based data gathering.
-
π OpenHands
An open-source AI coding assistant for autonomous software development. -
π AutoCodeRover
An autonomous code generation and debugging tool. -
π SWE-bench
Multimodal: Can Language Models Resolve Real-World GitHub Issues? -
π Web UI
A web-based UI for autonomous software engineering. -
π OpenManus
An open platform for autonomous AI development.
-
π Helicone
An observability platform for LLM applications. -
π DeepEval
The LLM Evaluation Framework. -
π LangFuse
Open-source LLM engineering platform: observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, LangChain, OpenAI SDK, LiteLLM, and more. YC W23. -
π Opik
Debug, evaluate, and monitor LLM applications, RAG systems, and agentic workflows with tracing, automated evaluations, and production-ready dashboards. -
π OptiLLM
Optimizing inference proxy for LLMs. -
π Phoenix
AI Observability & Evaluation platform.
- π Awesome LLM
A curated list of awesome LLM resources.
-
π Multi-Agent System
A multi-agent system built with LangGraph. -
π BigQuery Agentic Workflow
Tutorial on agentic workflows with BigQuery and LangGraph. -
π LangChain Open Tutorial
Open-source tutorials for LangChain and LangGraph.
-
π Awesome MCP Servers
A list of MCP (Model Context Protocol) servers. -
π Agent Toolkit
Tools for implementing MCP in AI agents. -
π MCP Server Axiom
An Axiom-based MCP server implementation. -
π TFMCP
A TensorFlow-based MCP project. -
π FastAPI MCP A zero-configuration tool for automatically exposing FastAPI endpoints as Model Context Protocol (MCP) tools.
-
π Smithery AI
An aggregation site for AI tools and resources. -
π MCP.so
A hub for Model Context Protocol resources.
- π AI Pricing Hub
A comparison tool for LLM API pricing.
- π LLM Datasets
A collection of datasets for LLM training and evaluation.
-
π CortexON
An agentic AI framework for cognitive tasks. -
π UI-TARS Desktop
A GUI Agent application based on UI-TARS (Vision-Language Model) to control your computer using natural language. -
π OpenManus
No fortress, purely open ground. OpenManus is coming. -
π LangManus
A language-driven Manus framework.