trendscope
search 19y of HN中文 subscribe github

about & methodology

What this dataset is, where it comes from, and how to trust it.

What trendscope is

trendscope is an open dataset of developer attention: every day it snapshots what developers are reading (Hacker News, Lobste.rs, Dev.to), building (GitHub trending), and downloading (npm, PyPI, crates.io), and publishes the result as JSON/CSV under CC0. The dashboard is a shop window; the dataset — versioned, timestamped, cumulative — is the product.

Sources

SourceEndpointWhat the score means
hackernewsHN Algolia API (front page + search)points
show_hnHN Algolia API (tag: show_hn)points
ask_hnHN Algolia API (tag: ask_hn)points
lobsterslobste.rs/hottest.jsonscore
devtodev.to API (top, 1-day window)reactions
producthuntproducthunt.com/feed (Atom, daily launches)feed rank
techmemetechmeme.com/feed.xml (RSS, editorial news)feed rank
slashdotrss.slashdot.org/Slashdot/slashdotMain (RSS 1.0)feed rank
arstechnicafeeds.arstechnica.com/arstechnica/index (RSS)feed rank
thevergetheverge.com/rss/index.xml (Atom)feed rank
arxivexport.arxiv.org/api/query (cs.AI/CL/LG/SE)arxiv recent
github_trendinggithub.com/trending (HTML)stars gained today
npmapi.npmjs.org/downloadsweekly downloads
pypipypistats.org APImonthly downloads
cratescrates.io API (recent-downloads)recent downloads
lemmyprogramming.dev/api/v3 (Lemmy hot)score
krebskrebsonsecurity.com/feed (RSS, security journalism)feed rank
changelogchangelog.com/news/feed (RSS, dev news)feed rank
freecodecampfreecodecamp.org/news/rss/ (RSS, tutorials)feed rank
echojsechojs.com/rss (RSS, JavaScript community)feed rank
infoqfeed.infoq.com (RSS, enterprise dev news)feed rank
theregistertheregister.com/software/headlines.atom (RSS, IT news)feed rank
lwnlwn.net/headlines/rss (Linux/kernel news)feed rank
hackadayhackaday.com/feed/ (hardware/maker)feed rank
thenewstackthenewstack.io/feed/ (cloud-native/devops)feed rank
opensourcecomopensource.com/feed (Red Hat OSS community)feed rank
soblogstackoverflow.blog/feed/ (dev culture)feed rank
codinghorrorblog.codinghorror.com/rss/ (classic dev blog)feed rank
martinfowlermartinfowler.com/feed.atom (SWE essays)feed rank
pragmaticblog.pragmaticengineer.com/rss/ (SWE newsletter)feed rank
benderskyeli.thegreenplace.net/feeds/all.atom.xml (deep-dive blog)feed rank
cheneydave.cheney.net/feed (Go/engineering blog)feed rank
lucumrlucumr.pocoo.org/feed.atom (Armin Ronacher)feed rank
hynekhynek.me/articles/index.xml (Python ecosystem)feed rank
susamsusam.net/feed.xml (long-form hacker blog)feed rank

Full source directory

Loading directory…

KeyNameLaneMetric

All endpoints are public and login-free. Scores are source-native: compare within a source, never across them (a point on HN and a download on npm are different units). The cross-source "All" board normalizes by each source's top score — heat, not raw numbers.

Schedule & provenance

Topics

Items are classified by a keyword map (TOPIC_RULES in collect.py) over title + tags + description — deliberately transparent and deterministic, no ML black box. An item can belong to several topics or none.

License & use

Compilation released under CC0; upstream titles/links remain with their owners. Cite as:trendscope — daily open dataset of developer attention, zalize-com, {date}.

Built by

Designed, coded and maintained autonomously by two collaborating Devinsessions — one building, one researching and reviewing — as a 7-day experiment in agent-built products. Daily collection, this page, and the weekly digest all run unattended.
docs/methodology.mddescribes how the two sessions split, review and ship — written by them.