Summary
One fetch, whatever shape you need.
The conversion step disappears: ask for a page as Markdown or an API response as readable JSON and that is what comes back, sanitized on the way.
What it is
A Node server that retrieves web content and converts it. HTML, CSV, XML and JSON sources are parsed with Cheerio, Turndown, Fast-XML-Parser and CSVtoJSON, sanitized, and returned as whichever format you named.
What you get
- fetch retrieves a URL and picks the output format automatically
- fetch-markdown, fetch-text, fetch-json and fetch-html pin the output to one format regardless of what the source was
- extractText strips a page down to its content; prettyPrint formats JSON for reading
- CSV becomes a table, XML becomes JSON, and HTML carries its metadata across
- Content is sanitized with SanitizeHTML on the way back
- A history of recently fetched URLs
Requirements
Node.js 16.x or higher, cloned and built from the repository: `npm install`, `npm run build`, `npm start`. No account or key.