PrisAImSearch
REAL IMPLEMENTATIONS / RESEARCH

Recommending research papers with arxiv-sanity-lite

Andrej Karpathy built arxiv-sanity-lite to recommend papers from a reader's tags using classical machine learning.

THE ACTUAL IMPLEMENTATION

What they built.

Andrej Karpathy's arxiv-sanity-lite turns a reader's own paper tags into recommendations. The input is bibliographic text collected from arXiv rather than a conversation with a chatbot. The repository supplies the ingestion scripts, feature computation, web interface and a screenshot of the implemented application.

The code makes the recommendation process inspectable. It builds weighted word and word-pair features from titles, abstracts and author names, then learns which features distinguish the tagged examples. This is classical machine learning rather than an LLM generating an answer, so the output remains a ranked set of existing records.

Public repository and builder account

The original code, requirements and screenshot are available. The author's hosted URL timed out during this check, so the repository is the reliable inspection destination.

Inspect the original implementation

How the tools work together

The server marks tagged papers as positive examples and fits scikit-learn's linear support-vector classifier against the stored text features. It sorts papers by classifier score and returns their metadata. Those scores represent the model's ranking for the chosen examples; they are not judgments of a paper's scientific validity.

Workflow at a glance

  1. Collect paper metadata

    The arxiv_daemon.py script fetches records, and compute.py turns titles, abstracts and author names into weighted text features.

  2. Mark relevant papers

    A reader assigns tags. The server uses those positive examples to fit a linear classifier.

  3. Inspect ranked candidates

    The application ranks the stored papers and displays their metadata. The reader opens the source papers to assess them.

How you could adapt the idea

Use this as a design pattern for a reading list: choose several relevant papers, inspect the recommendations and revise the tags when the topic drifts. Running the original code needs dependency review and setup. The hosted URL did not load during research, so no current service availability or successful installation is claimed.

Effort, cost and limitations

Effort
Running a copy requires Python dependencies, data refresh jobs and a Flask service. This is a code study with setup work, not a verified current one-click service.
Cost
The README reports a historical $5/month server indexing about 30,000 papers. Present hosting and maintenance costs were not established.

Recommendations use metadata and text features, not full-paper analysis or generated summaries. Ranking does not establish scientific quality.

Current maintenance and runtime compatibility were not established; requirements pin older versions and public issues include access and execution reports.

Go to the original work.

Builder README, screenshot and setupActual text-feature constructionActual classifier and ranking implementationPinned dependency versionsPublic issue history and current access reports

Source-backed editorial account; PrisAIm did not run or independently benchmark this implementation.

Start here: AI basicsNewsCompareWorkshopsDiscovery methodsSearch everything
Browser-local saved list

Clear your saved entries?

This removes your list from this browser only. You can save entries again at any time.