Skip to content

MODSetter/SurfSense

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7,707 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

SurfSense, the open-source NotebookLM alternative for open web research

MODSetter%2FSurfSense | Trendshift

SurfSense: The Open-Source NotebookLM Alternative for Open Web Research

SurfSense is the open-source NotebookLM alternative for AI agents, an open web research platform with live data connectors. Your agents research the live web with structured data from Reddit, YouTube, Instagram, TikTok, Amazon, Google Maps, Google Search, and any page on the open web, through one REST API or MCP server. Scheduled and event-triggered agents turn what they find into briefs and alerts, and a built-in knowledge base keeps every finding searchable with citations.

Note

📢 A note for our NotebookLM-alternative users

For the past couple of months we built SurfSense as the best general research agent for your own knowledge, and that chapter earned us a community we are genuinely proud of. Agentic tools like Claude, OpenCode, Hermes, and OpenClaw have now proven that agents are the future, and reasoning over a static index is becoming something every capable agent does out of the box. What agents still lack is live data from the places where answers actually live, and the workflows around it. That is where we are pointing all of our energy: giving agents the primitives to research the open web.

Nothing you rely on is going away. Your knowledge base, chat with citations, reports, podcasts, presentations, automations, and collaborative chats all keep working, and self-hosting stays free and open source. Read the full announcement on our changelog.

Table of contents

Why agents need SurfSense

Ask any capable agent "what is Reddit saying about this product since launch?" or "what do the reviews of these ten places actually complain about?" and it has nowhere trustworthy to look. Official platform APIs are rate-limited, priced for enterprises, or missing entirely; scraping plumbing is brittle; and driving a browser with an LLM burns minutes and tokens per page. SurfSense gives agents the primitives instead:

  • One typed surface for wherever the data lives. Every connector is a REST endpoint returning structured JSON — posts, comments, transcripts, reviews, SERPs, pages. No rate-limit roulette, no HTML parsing, no browser loop.
  • An MCP server that exposes every connector as a native tool (surfsense_reddit_scrape, surfsense_google_search, and more) to Claude, Cursor, or any agent framework.
  • An agent harness, not just raw data: retries, structured output, and credit metering are built in, so agents go from a question to a cited brief without you building the plumbing.
  • Open source and self-hostable, so your research stays on your own infrastructure.

Live data connectors

Connector What your agents get Learn more
Reddit Posts, comments, and subreddit streams without the official API's rate limits Reddit Scraper API
YouTube Videos, transcripts, and comment threads at scale YouTube Scraper API
Instagram Public profiles, posts, and reels without the Graph API Instagram Scraper API
TikTok Videos, comments, hashtags, and profiles without Research API approval TikTok Scraper API
Google Maps Places, ratings, and reviews for local business research Google Maps Scraper API
Google Search Live SERPs for search research and monitoring Google Search API
Amazon Public product data: prices, ratings, offers, sellers, and best-seller ranks Amazon Product API
Web Crawl Any page on the open web as clean, structured content Web Crawling API
External MCP Connectors Bring any MCP server to your agents, with one-click OAuth for Notion, Slack, Jira, and more External MCP Connectors

The connector catalog is growing beyond social platforms and search; every new source lands as a typed endpoint on the same API and MCP server.

Billing is pay as you go: connectors bill per item actually returned, crawls per page successfully fetched, and failed calls are never billed. Self-hosted installs run with billing off. See pricing.

Quick start

Call a connector from code

Every connector is a REST endpoint you can call from any language with your SurfSense API key:

curl -X POST "$SURFSENSE_API_URL/workspaces/$WORKSPACE_ID/scrapers/reddit/scrape" \
  -H "Authorization: Bearer $SURFSENSE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "search_queries": ["your brand"],
    "community": "SaaS",
    "sort": "top",
    "time_filter": "week"
  }'

Each connector page has copy-paste examples in Python, JavaScript, Go, PHP, Ruby, Java, and C#.

Give the tools to your agents over MCP

Add the SurfSense MCP server to Claude, Cursor, or your own agent framework:

{
  "mcpServers": {
    "surfsense": {
      "url": "https://mcp.surfsense.com/mcp",
      "headers": { "Authorization": "Bearer ${SURFSENSE_API_KEY}" }
    }
  }
}

Your agent can now call every connector as a native tool. See the SurfSense MCP server page for the full tool list, or run the server locally from surfsense_mcp.

Use the cloud

Go to surfsense.com, log in, and ask the agent for live web data in plain English. New accounts start with $5 of free credit and no subscription.

Self-host for free

Run the entire platform, connectors, agents, automations, and the MCP server on your own infrastructure. Self-hosted installs ship with billing off, so scraping, crawling, and agent runs are limited only by your hardware and the model keys you bring.

Prerequisites: Docker Desktop must be installed and running.

For Linux/macOS:

curl -fsSL https://raw.githubusercontent.com/MODSetter/SurfSense/main/docker/scripts/install.sh | bash

For Windows:

irm https://raw.githubusercontent.com/MODSetter/SurfSense/main/docker/scripts/install.ps1 | iex

The install script sets up Watchtower automatically for daily auto-updates. To skip it, add the --no-watchtower flag. For Docker Compose, manual installation, and other deployment options, see the docs.

Everything else in the box

The research workspace that made SurfSense the leading open-source NotebookLM alternative is still here, and everything your agents gather lands in it.

Knowledge base

  • Upload PDFs, Office docs, images, and audio, or sync Google Drive, OneDrive, and Dropbox. 50+ file formats supported.
  • Hybrid semantic and full-text search with cited, Perplexity-style answers.
  • AI file sorting auto-organizes documents by source, date, and topic.

Chat With Your PDFs and Docs

Deliverable studio

  • AI report generator with export to PDF, DOCX, HTML, LaTeX, EPUB, ODT, or plain text.
  • Two-host AI podcasts from any document or folder in under 20 seconds.
  • Editable slide decks, narrated video overviews, and AI image generation.

AI Report Generator

Automations

  • Run full agent turns on a schedule or in response to events, described in plain English, with results written back to Notion, Slack, Linear, and Jira.

Team collaboration

  • Real-time collaborative AI chats with comments and mentions.
  • RBAC with Owner, Admin, Editor, and Viewer roles.

Collaborative AI Chat

Desktop app

Native AI assistance in every application on your computer. Download from the latest release.

  • General Assist: launch SurfSense from any app with a global shortcut.
  • Quick Assist: select text anywhere, then ask AI to explain, rewrite, or act on it.
  • Screenshot Assist: capture any region of your screen and ask AI about it.
  • Watch Local Folder: auto-sync a local folder to your knowledge base. Point it at your Obsidian vault to keep your notes searchable.

Quick Assist

No vendor lock-in

  • 100+ LLMs via the OpenAI spec and LiteLLM, including GPT-5.5, Claude Sonnet 5, and Gemini 3.1 Pro.
  • 6,000+ embedding models and all major rerankers.
  • Full local and private LLM support (vLLM, Ollama), so your data stays yours.

Video Agent Sample

video.1.1.mp4

Podcast Agent Sample

elon_vs_trump_podcast.mp4

How to collaborate in real time (Beta)

  1. Go to the Manage Members page and create an invite.

    Invite Members

  2. A teammate joins and that workspace becomes shared.

    Invite Join Flow

  3. Make a chat shared and work in it together in real time, with comments to tag teammates.

    Realtime Comments

How SurfSense compares

SurfSense is the only open-source product that combines a NotebookLM-style research workspace for people with live-data primitives for agents. Here is how that stacks up against each class of tool.

vs browser agents (Browserbase, Browser Use). Browser agents drive a real browser with an LLM in the loop — the right tool when a task needs clicking, logging in, or filling forms. But most research is read-only retrieval, and for retrieval the LLM-in-a-browser loop costs you minutes and thousands of tokens per page. A SurfSense connector call is one HTTP request: seconds, deterministic, and zero tokens spent deciding where to click.

vs scraping APIs (Firecrawl). Scraping APIs are great at turning a generic page into markdown, but a markdown blob still leaves your agent parsing structure out of prose, and they degrade on bot-protected platforms like Reddit, TikTok, and Instagram. SurfSense connectors return platform-native structured items — posts, comments, transcripts, reviews — and bill only for items actually returned; failed calls are never billed.

vs search APIs (Exa, Tavily, Parallel). Search APIs answer from a web index, which is the right tool for "find me pages about X." They cannot pull a Reddit thread's comments, TikTok reactions, YouTube transcripts, or Google Maps reviews — the places where the answer often actually lives.

vs scraper marketplaces (Apify). Marketplaces give you thousands of community actors, each with its own schema, quality, and pricing. SurfSense is one typed API and one MCP server with an agent harness and a research workspace behind it, and it is open source.

SurfSense vs Google NotebookLM

Still comparing us as a NotebookLM alternative? Here is the honest breakdown.

Feature Google NotebookLM SurfSense
Live web data for agents No Reddit, YouTube, Instagram, TikTok, Amazon, Google Maps, Google Search, and web crawl connectors via REST API and MCP
MCP server No Every connector exposed as a native agent tool, plus bring-your-own MCP servers with one-click OAuth apps
Sources per Notebook 50 (Free) to 600 (Ultra, $249.99/mo) Unlimited
Number of Notebooks 100 (Free) to 500 (paid tiers) Unlimited
Source Size Limit 500,000 words / 200MB per source No limit
Pricing Free tier; Pro $19.99/mo, Ultra $249.99/mo Free and open source to self-host; cloud is pay as you go with $5 free credit
LLM Support Google Gemini only 100+ LLMs via OpenAI spec & LiteLLM
Embedding Models Google only 6,000+ embedding models, all major rerankers
Local / Private LLMs Not available Full support (vLLM, Ollama), your data stays yours
Self Hostable No Yes, Docker one-liner or full Docker Compose
Open Source No Yes
Knowledge Base Sources Google Drive, YouTube, websites File uploads, Google Drive, OneDrive, Dropbox, local folder sync, and crawled pages
File Format Support PDFs, Docs, Slides, Sheets, CSV, Word, EPUB, images, web URLs, YouTube 50+ formats: documents, images, videos via LlamaCloud, Unstructured, or Docling (local)
Search Semantic search Hybrid semantic + full-text with hierarchical indices & reciprocal rank fusion
Cited Answers Yes Yes, Perplexity-style cited responses
Agentic Architecture No Yes, powered by LangChain Deep Agents with planning, subagents, and file system access
AI Automations & Agents No Scheduled workflows, event triggers, and chat-built no-code automations with write-back to Notion, Slack, Linear & Jira
Real-Time Multiplayer Shared notebooks with Viewer/Editor roles (no real-time chat) RBAC with Owner / Admin / Editor / Viewer roles, real-time chat & comment threads
Video Generation Cinematic Video Overviews via Veo 3 (Ultra only) Available (NotebookLM is better here, actively improving)
Presentation Generation Better looking slides but not editable Editable, slide-based presentations
Podcast Generation Audio Overviews with customizable hosts and languages Available with multiple TTS providers (NotebookLM is better here, actively improving)
Desktop App No Native app with General Assist, Quick Assist, Screenshot Assist, and local folder sync

Feature requests and future

SurfSense is actively being developed. While it's not yet production-ready, you can help us speed up the process.

Join the SurfSense Discord and help shape the future of SurfSense!

Roadmap

Stay up to date with our development progress and upcoming features. Check out our public roadmap and contribute your ideas or feedback:

Roadmap Discussion: SurfSense 2026 Roadmap

Kanban Board: SurfSense Project Board

Contribute

All contributions welcome, from stars and bug reports to backend improvements. See CONTRIBUTING.md to get started.

Thanks to all our Surfers:

Star History

Star History Chart

Catalyst Project



About

Open-source NotebookLM alternative for AI agents. Research the open web with live data connectors for Reddit, YouTube, Amazon, Google Maps, and Google Search, through one API or MCP server. Join our Discord: https://discord.gg/ejRNvftDp9

Topics

Resources

License

Code of conduct

Contributing

Stars

15.3k stars

Watchers

84 watching

Forks

Sponsor this project

 

Packages

 
 
 

Contributors

Generated from cording12/next-fast-turbo