X Bookmarks — 2024 KW19: RAG with Llama 3B and making AI actually reliable

May 9, 2024

|bookmarks

by Florian Narr

X Bookmarks — 2024 KW19: RAG with Llama 3B and making AI actually reliable

@LangChain — RAG system with Llama 3B for PDFs using FAISS and HuggingFace

Build a RAG system with Llama 3B-Instruct for your PDFs

Uses API for partitioning & chunking, FAISS for vector store, huggingface for the model

It's a collab notebook so it's easy to get started!

Thanks @mariaKhalusova for a great resource!

https://colab.research.google.com/drive/1BJYYyrPVe0_9EGyXqeNyzmVZDrCRZwsg

Smart stack — FAISS for the vector store keeps everything local and fast, and pairing it with a 3B model means you can run this without a beefy GPU. The Colab notebook lowers the barrier to actually trying it rather than just reading about it.


@brotzky — figuring out how to make AI outputs reliable

We figured out how to make AI reliable.

Here's how and the journey we went on: https://t.co/dDGNsXYoMy

That's the claim every AI wrapper startup makes right before the benchmarks disappoint — but the framing is interesting enough that I saved it. Reliability in AI usually means deterministic retries, confidence thresholds, or structured output with validation. Curious which angle this takes.


@dimitrov2k — switching to Berkeley Mono

Finally switched to Berkeley Mono, what an awesome font: https://t.co/VwQhc7Cavm

Berkeley Mono is one of those fonts that changes nothing functionally and somehow makes you write better code anyway. The ligatures are tasteful, the weight at small sizes holds up, and it doesn't look like you're trying too hard — which is harder to pull off than it sounds.


@pietrobaudin — four free fonts worth downloading

These 4 fonts are free.

Download Below ↓

Honestly just saved this so I don't forget it exists — free fonts that are actually usable are rarer than the "free fonts" lists suggest. Worth checking what made the cut here.


@remonleijtens — free fonts deluxe, edition 57

Free fonts deluxe (✦no:57)

This is a running series and the curation is solid — not the usual roundup of fonts you've already seen everywhere. Good to have a source that keeps updating the list.


@hobdaydesign — painterly illustrations as a web design trend

Painterly illustrations might be a website visual design trend?

Makes sense — flat design has been dominant for so long that anything with visible texture or brushwork reads as distinctive now. The question is whether it ages well or just becomes the next "Memphis pattern" in five years.