IntelliServer
simplifies the evaluation of LLMs by providing a unified microservice to access and test multiple AI models.
simplifies the evaluation of LLMs by providing a unified microservice to access and test multiple AI models.
Formerly langchain-ChatGLM, local knowledge based LLM (like ChatGLM) QA app with langchain.
Build your own conversational search engine using less than 500 lines of code by LeptonAI.
Create, deploy and operate Actions using Python anywhere to enhance your AI agents and assistants. Batteries included with an extensive set of libraries, helpers and logging.
Locally running websearch using LLM chains
Gateway streamlines requests to 100+ open & closed source models with a unified API. It is also production-ready with support for caching, fallbacks, retries, timeouts, loadbalancing, and can be edge-deployed for minimum latency.
Simple API for deploying any RAG or LLM that you want adding plugins.
WebAssembly binding for llama.cpp - Enabling in-browser LLM inference
An open-source GPU cluster manager for running LLMs
A Device-Inference framework, including LLM Inference on device(Mobile Phone/PC/IOT)
An interactive chat project that leverages Ollama/OpenAI/MistralAI LLMs for rapid understanding and navigation of GitHub code repository or compressed file resources.
Interact with LLM using Ollama models(or openAI, mistralAI)via pure shell scripts on your Linux(or MacOS) system, enhancing intelligent system management without any dependencies.
A python package for Txt-to-SQL with self hosting functionalities and RESTful APIs compatible with proprietary as well as open source LLM.
AdalFlow: The library to build&auto-optimize LLM applications.
A handy looking Python library from Microsoft that uses Handlebars templating to interleave generation, prompting, and logical control.
Open-source Python tools for testing and evaluating models, vector DBs, and prompts.
A Python library that provides a domain-specific language to simplify prompting and constrain generation.
A small Python library for using language models to perform NLP tasks.
A TypeScript library for building apps with LLMs and other ML models (speech-to-text, text-to-speech, image generation).
A React library for building LLM UIs.
An open-source LLM app for building multi-agent LLMs applications in an easy and lazy way, supports model deployment and fine-tuning.
Open Source Hybrid AI Search Engine, Instantly Get Accurate Answers from the Internet, Bookmarks, Notes, and Docs. Support One-Click Deployment
Open source AutoML tool for RAG. Optimize the RAG answer quality automatically. From generation evaluation datset to deploying optimized RAG pipeline.
Make your LLM agent and chat with it simple and fast!
Open-source LLM observability, prompt evaulation, and prompt optimzation platform.
Pure Rust implementation of a minimal Generative Pretrained Transformer.
ChatGPT Wrapper is an open-source unofficial Python API and CLI that lets you interact with ChatGPT.
an experimental open-source application showcasing the capabilities of the GPT-4 language model.
An easy-to-use framework to edit large language models.
A Chrome extension for OpenAI's ChatGPT, enhancing user privacy by enabling easy hiding and unhiding of chat history. Ideal for privacy during screen shares.
Author: Stephen Bonifacio
Tweet
</details>
Author: Lev Chizhov
Author: @ajhous44 (Github)
</details>