Skip to content

Harden score api and fern rerun#29

Open
kgowru wants to merge 8 commits into
mainfrom
harden-score-api-and-fern-rerun
Open

Harden score api and fern rerun#29
kgowru wants to merge 8 commits into
mainfrom
harden-score-api-and-fern-rerun

Conversation

@kgowru

@kgowru kgowru commented Jun 5, 2026

Copy link
Copy Markdown
Collaborator

No description provided.

kgowru and others added 8 commits May 26, 2026 23:20
Replace gpt-4o-mini with claude-haiku-4-5 in the LLM fallback for
category classification. Uses ANTHROPIC_API_KEY instead of OPENAI_API_KEY.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
feat: switch category inference from OpenAI to Claude Haiku
Add a slug-alias map so typing a domain like monday.com (which resolves
to the weaker "monday" slug) lands on the curated leaderboard entry
"developer-monday-com-apps". Applied in the score API and the company
page so both search and direct navigation redirect to the canonical slug.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Redirect duplicate company slugs to canonical leaderboard entry
)

Fern preview/staging hosts (*.ferndocs.com) now always slug by URL
instead of the derived company name, so e.g. docusign.ferndocs.com no
longer collapses onto the "docusign" slug and return the cached live
entry. These sites are now graded as distinct entries.

Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
* fix: route monday.com to canonical api-reference leaderboard entry

The "monday" alias pointed at developer-monday-com-apps, which has since
been hidden (score 68/D). Repoint to developer-monday-com-api-reference,
the visible canonical entry (score 91/A).

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

* fix: make slug alias a lookup redirect, never a scoring target

Previously a forced rerun (or dev run) of monday.com would score
https://monday.com and upsert it under the aliased slug
developer-monday-com-api-reference, clobbering the curated A-grade entry.
Now the alias only redirects cache lookups to the existing canonical
entry; scoring always stores under the raw slug.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

---------

Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
…om) (#27)

An llms.txt returning 200 short-circuited docs detection, so marketing
homepages that now ship one (monday.com) were graded as docs sites. At a
bare apex/root, llms.txt is no longer sufficient on its own; we defer to
the homepage content check (only a visible marketing page is rejected, and
deeper paths / docs subdomains still pass). Also drop the now-unneeded
monday slug alias.

Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
The detection layer already rejects monday.com, but the cache lookup runs
before detection — a stale cached row would still be served. Add an apex-only
block (exact host + www, subdomains excluded) that runs before the cache and
scoring, guaranteeing the marketing apex is rejected while developers.monday.com
and other docs subdomains stay gradeable.

Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@vercel

vercel Bot commented Jun 5, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
fern-agent-score Ready Ready Preview Jun 5, 2026 1:19am

Request Review

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant