Show HN: Self-hosted web to Markdown scraper, CLI, lib. Own Trafilatura TS port

Category: devtools

Tags: web-scraping, markdown, trafilatura, llm-data, crawler, typescript

Score: 6.5/10 (Innovation: 5, Technical: 7, Documentation: 8, Utility: 6)

Markdownee is a self-hosted web scraper that converts web pages to Markdown, HTML, or plain text for LLM and RAG pipelines. It ports the Python Trafilatura extraction engine to TypeScript (via go-trafilatura as a DOM bridge), wraps it with Crawlee/Playwright for crawling, and ships as a CLI, npm library, Python library, and Apify Actor. The cross-language port plus multi-surface distribution is notable, though the core value is a reimplementation rather than a novel approach.

Target audience: backend devs, AI/ML engineers building RAG pipelines, data engineers

Repository: https://www.markdownee.com/ · TypeScript · Apache-2.0 · 2 stars

View on Hacker News