llm.md

LLM

good content

• https://jax-ml.github.io/scaling-book/
• ocr
  • https://www.sergey.fyi/articles/gemini-flash-2 and https://www.runpulse.com/blog/why-llms-suck-at-ocr and https://blog.roboflow.com/florence-2-ocr/
• https://applied-llms.org/
• https://github.com/ray-project/llm-numbers
• https://github.com/KalyanKS-NLP/llm-engineer-toolkit
• https://koomen.dev/essays/horseless-carriages/ horseless carriages of AI
• https://github.com/mlabonne/llm-course

prompts

• https://github.com/preset-io/promptimize
• simple prompt engineering training from anthropic https://docs.google.com/spreadsheets/d/19jzLgRruG9kjUQNKtCg1ZjdD6l6weA6qRXG5zLIAhC8/edit?gid=150872633#gid=150872633 (Anthropic's Prompt Engineering Interactive Tutorial [PUBLIC ACCESS])
• https://colab.research.google.com/drive/1OnIipRwuHOZbKHN0haHGD0OnckBGfzqx auto optimierung
• prompting frameworks
  • https://github.com/masci/banks
  • https://github.com/boundaryml/baml
• prompt techniques
  • CoRT chain of recursive thoughts https://github.com/PhialsBasement/Chain-of-Recursive-Thoughts

hooks

safety

• https://www.youtube.com/watch?v=VqDs46A8pqE

tokenization

• https://github.com/openai/tiktoken

vector databases

• https://github.com/facebookresearch/faiss
• https://www.pinecone.io/
• https://www.trychroma.com/

hallucination

• https://docs.vectara.com/docs/learn/hallucination-evaluation

private

• https://bdtechtalks.com/2023/06/01/create-privategpt-local-llm/amp/

stacks

serving LLMs

• https://github.com/ajndkr/lanarky
• https://github.com/deepset-ai/haystack (with Elasticsearch)

full e2e example

• https://github.com/praj2408/Langchain-PDF-App-GUI
• https://github.com/pipeshub-ai/pipeshub-ai

ready made connectors

• https://www.danswer.ai/
• https://n8n.io/

no code GUI tools

• https://github.com/FlowiseAI/Flowise
• https://github.com/gmpetrov/databerry
• https://www.docetl.org/

models

• https://x.com/clementdelangue/status/1934672721066991908
• https://simonwillison.net/2024/Dec/24/qvq/
• https://simonwillison.net/2024/Dec/26/deepseek-v3/

document preprocessors

• unstract.com LLM whisperer https://pg.llmwhisperer.unstract.com/
  • https://github.com/Zipstack/unstract
• https://cloud.llamaindex.ai llamaparse
• https://github.com/DS4SD/docling
• https://github.com/VikParuchuri/marker
• https://github.com/QuivrHQ/MegaParse
• https://github.com/microsoft/markitdown
• https://github.com/opendatalab/PDF-Extract-Kit

HTML cleanup

• https://emschwartz.me/comparing-13-rust-crates-for-extracting-text-from-html/

pdf preprocessors

• https://github.com/opendatalab/MinerU
• https://github.com/DS4SD/docling

entity extraction

• https://python.useinstructor.com/
• https://github.com/vlm-run/vlmrun-cookbook and good comments https://news.ycombinator.com/item?id=43187209
• https://github.com/boundaryml/baml

naming entities

• https://github.com/urchade/GLiNER

security

• https://github.com/NVIDIA/garak
• https://github.com/Azure/PyRIT
• https://www.promptfoo.dev/docs/red-team/quickstart/
• https://github.com/mbrg/power-pwn
• cryptography
  • https://eprint.iacr.org/2025/288
• prompt injection scanning
  • https://arstechnica.com/information-technology/2025/04/researchers-claim-breakthrough-in-fight-against-ais-frustrating-security-hole/ https://arxiv.org/abs/2503.18813

scraper & automation

• https://github.com/browser-use/browser-use
• https://github.com/nanobrowser/nanobrowser

jailbreaks

• https://github.com/CHATS-lab/persuasive_jailbreaker

demonstrations

• https://github.com/greshake/llm-security
• https://bishopfox.com/resources/rvasec2024-patch-perfect-harmonizing-llms

ethical challenges

• https://www.youtube.com/watch?v=giT0ytynSqg

security considerations

• https://www.microsoft.com/en-us/security/blog/2025/04/24/new-whitepaper-outlines-the-taxonomy-of-failure-modes-in-ai-agents/
• https://www.bsi.bund.de/SharedDocs/Downloads/EN/BSI/Publications/ANSSI-BSI-joint-releases/LLM-based_Systems_Zero_Trust.pdf?__blob=publicationFile&v=3
• https://genai.owasp.org/resource/agentic-ai-threats-and-mitigations/

security problems

• https://theyseeyourphotos.com/

• https://www.404media.co/email/f459caa7-1a58-4f31-a9ba-3cb53a5046a4/

• https://www.npr.org/2024/12/10/nx-s1-5222574/kids-character-ai-lawsuit

• https://bsky.app/profile/pedram.lol/post/3lbxzc34th22y

• https://www.heise.de/news/Copilot-macht-aus-einem-Gerichtsreporter-einen-Kinderschaender-9840437.html

• https://github.com/leondz/garak

• https://www.youtube.com/watch?v=qyTSOSDEC5M

• https://gandalf.lakera.ai/baseline genAI security training

• https://www.heise.de/news/ChatGPT-Code-mit-betruegerischer-API-kostet-Programmierer-2500-US-Dollar-10169146.html

• https://microsoft.github.io/presidio/analyzer/

• https://www.promptfoo.dev/docs/red-team/quickstart/

• https://github.com/mbrg/power-pwn

• https://www.youtube.com/watch?v=-YJgcTCSzU0

• https://www.youtube.com/watch?v=LcLrG_4i19E

• https://www.youtube.com/watch?v=LcLrG_4i19E

• backdoor

  • https://blog.sshh.io/p/how-to-backdoor-large-language-models

• email summarization copiarate https://www.youtube.com/watch?v=84NVG1c5LRI

• uncensor with abliteration https://colab.research.google.com/drive/1VYm3hOcvCpbGiqKZb141gJwjdmmCcVpR?usp=sharing

identifying security issues

• graph aware scanning
  • https://hiddenlayer.com/innovation-hub/shadowgenes-uncovering-model-genealogy/
  • https://arxiv.org/abs/2501.11830
• MCP
• https://github.com/cisco-ai-defense/mcp-scanner

red teaming

• https://airedteamwhitepapers.blob.core.windows.net/lessonswhitepaper/MS_AIRT_Lessons_eBook.pdf
• https://www.microsoft.com/en-us/security/blog/2025/01/13/3-takeaways-from-red-teaming-100-generative-ai-products/
• https://github.com/Azure/PyRIT

data poisoning

• https://arxiv.org/pdf/2302.04222 glaze
• https://arxiv.org/pdf/2310.13828 night shade
  • https://nightshade.cs.uchicago.edu/whatis.html

fine-tuning

• https://huggingface.co/docs/peft/index
• https://github.com/unslothai/unsloth
• https://github.com/axolotl-ai-cloud/axolotl
• https://github.com/Lightning-AI/litgpt
• https://github.com/hiyouga/LLaMA-Factory
• tool lists
  • https://huyenchip.com/llama-police
• https://github.com/meta-llama/synthetic-data-kit
• https://pypi.org/project/tokenlearn/
• auto eval https://colab.research.google.com/drive/1Igs3WZuXAIv9X0vwqiE90QlEPys8e8Oa?usp=sharing
• axolotl https://colab.research.google.com/drive/1TsDKNo2riwVmU55gjuBgB1AXVtRRfRHW?usp=sharing
• unsloth https://colab.research.google.com/drive/164cg_O7SV7G8kZr_JXqLd6VC7pd86-1Z?usp=sharing

newer efficient way of fine-tuning and distillation

SVD and Marchenko-Pastur seem to be really useful

• https://github.com/arcee-ai/DistillKit https://www.youtube.com/watch?v=JE7SuP049mQ
• https://github.com/cognitivecomputations/spectrum https://www.youtube.com/watch?v=CTncBjRgktk
• https://github.com/arcee-ai/mergekit
  • https://www.youtube.com/watch?v=cvOpX75Kz4M
  • https://www.youtube.com/watch?v=qbAvOgGmFuE
  • https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing
• https://github.com/arcee-ai/EvolKit
• https://www.arcee.ai/blog/how-arcee-ai-helped-madeline-co-build-a-world-class-reasoning-model-from-first-principles- https://www.arcee.ai/product/arcee-conductor

distributed training

• https://github.com/microsoft/DeepSpeed
• https://pytorch.org/tutorials/distributed/home.html
• https://lightning.ai/docs/pytorch/stable/
• https://github.com/hpcaitech/ColossalAI

prototyping

UIs

• https://github.com/open-webui/open-webui
• https://lmstudio.ai/
• https://opencat.app/en/
• https://docs.chainlit.io/get-started/overview
• https://www.gradio.app/
• https://streamlit.io/

router/proxy

• https://github.com/katanemo/archgw
• litellm

rag frameworks

• https://github.com/llmware-ai/llmware
• https://github.com/infiniflow/ragflow?tab=readme-ov-file
• https://github.com/Filimoa/open-parse
• rag tools
  • https://www.onyx.app/
• https://github.com/google-gemini/gemini-fullstack-langgraph-quickstart
• https://github.com/eyelevelai/groundx-on-prem
• https://github.com/morphik-org/morphik-core
• https://github.com/timescale/pgai

chunking

• https://github.com/HaroldConley/chunk-norris

graph rag

• https://github.com/Muvon/octocode

rag applications

• https://arxiv.org/abs/2409.13740

workflows

• https://workflowai.com/

agents

• https://github.com/humanlayer/12-factor-agents
• https://github.com/The-Pocket/PocketFlow
• https://claudiacode.com/
• https://github.com/Hona/opencode-ralph
• firmware max https://buy.stripe.com/14A5kC4W79ee0Pm42ea3u01?prefilled_promo_code=EARLYBIRDZ

@code-simplifier:code-simplifier

• https://www.atcyrus.com/stories/claude-code-code-simplifier-agent-guide

agent.md/claude.md tips

• https://blog.sshh.io/p/how-i-use-every-claude-code-feature

parallel agentic development

• https://conductor.build/

harnesses / stacks

• https://github.com/bytedance/UI-TARS-desktop
• https://github.com/first-fluke/oh-my-agent

memory

• https://github.com/danja/semem
• https://github.com/topoteretes/cognee

interesting skills/templates

• https://github.com/obra/superpowers
• https://github.com/garrytan/gstack

verification & Testing

• 10.17323/jle.2020.11046

education

audio

• https://livekit.io/
• https://huggingface.co/Zyphra/Zonos-v0.1-hybrid
• https://github.com/nari-labs/dia
• https://github.com/KoljaB/RealtimeVoiceChat
• https://github.com/resemble-ai/chatterbox
• https://handy.computer/

video

• explanation videos

hosting models

• https://github.com/containers/ramalama
• https://ollama.com/
• https://github.com/vllm-project/vllm
• https://huggingface.co/moonshotai/Kimi-Audio-7B-Instruct
• https://github.com/sgl-project/sglang

hardware

on demand AI clusters

• all the public cloud providers (though they often do not focus on offering a simple/streamlined GPU experience for researchers)
• https://hpc-ai.com
• https://lambdalabs.com/service/gpu-cloud/1-click-clusters
• https://vast.ai/
• https://nebius.com/
• https://verda.com/instant-clusters
• runpod
• hyperstack
• coreweave
• crusoe
• https://www.paperspace.com
• https://huggingface.co/spaces
• https://colab.research.google.com/
• https://www.anyscale.com
• https://www.fluidstack.io
• https://www.clustermax.ai/
• eu
  • https://www.firebird.ai/

selecting the right model for the hardware

• https://github.com/AlexsJones/llmfit

validation of hardware

• check cooling issues
  • https://github.com/huggingface/gpu-fryer
• https://www.runpod.io/
  • https://github.com/3b1b/manim
• https://github.com/exo-explore/exo

video generation

• https://github.com/Wan-Video/Wan2.2

realtime

audio

serving

• https://fastrtc.org/

models

• https://github.com/canopyai/Orpheus-TTS
• https://github.com/fixie-ai/ultravox
• https://www.openai.fm/
• qwen 2.5 omni
  • https://huggingface.co/spaces/Qwen/Qwen2.5-Omni-7B-Demo
  • https://huggingface.co/Qwen/Qwen2.5-Omni-7B
• https://zeyuet.github.io/AudioX/

solutions

• https://livekit.io/
• https://elevenlabs.io/

data analysis with AI

• https://github.com/microsoft/data-formulator

paper finders

• https://allenai.org/blog/paper-finder

applications

schooling and tutoring

• https://www.synthesis.com/tutor

ai and politics

• religion
  • vatican AI rules https://www.vatican.va/roman_curia/congregations/cfaith/documents/rc_ddf_doc_20250128_antiqua-et-nova_en.html

mcp

registry

• https://github.com/IBM/mcp-context-forge

applications

local inferencing

• https://github.com/ggml-org/LlamaBarn
• https://lmstudio.ai/
• https://anythingllm.com/
• https://localai.io/

observability

• https://github.com/Arize-ai/phoenix

useful learnings

guardrails

typing

• https://github.com/germanicdev/germanic

constriants

• https://news.ycombinator.com/item?id=46916586
  • strong typing
  • linting and formatting
  • cyclomatic complexity rules
  • max line length
  • max lines per file
  • unused code analysis
  • duplication analysis
  • modularisation enforcement
  • security check
  • scripts to ensure shared/util directories are not over stuffed

prompts

market research

• https://x.com/socialwithaayan/status/2021233357514997824

stuff to explore more

workflow

• https://cesarferreira.com/stax/workflows/agent-worktrees/
• https://github.com/repowise-dev/repowise

IT/coding

• https://github.com/DietrichGebert/ponytail

security

• https://agent-safehouse.dev/

some stacks

• https://github.com/garrytan/gstack
• https://github.com/coreyhaines31/marketingskills

data agent

• https://github.com/getnao/nao

legal

• https://github.com/zubair-trabzada/ai-legal-claude

HR & career

• https://github.com/santifer/career-ops

Agents

• https://github.com/nousresearch/hermes-agent

Design

• https://styles.refero.design/

finance

• https://github.com/TauricResearch/TradingAgents

unclassified

• https://github.com/yvgude/lean-ctx
• https://github.com/router-for-me/CLIProxyAPI
• https://github.com/Soju06/codex-lb and https://github.com/snipeship/ccflare
• https://github.com/prakersh/codexmultiauth
• https://github.com/juyterman1000/entroly
• https://github.com/ruvnet/ruflo
• https://github.com/sergebulaev/linkedin-skills

loops

• https://cobusgreyling.github.io/loop-engineering/

routing

• https://github.com/workweave/router