Skip to content

Latest commit

 

History

History
86 lines (65 loc) · 4.09 KB

File metadata and controls

86 lines (65 loc) · 4.09 KB

NotebookMLX

English | 简体中文

Contributor Guide: Repository Guidelines

Documentation

User Documentation

Developer Documentation

Technical Documentation

Standards and Guidelines

Quick Start (Dev)

  • App dev (first time):
    • cd notebook-mlx-app && pnpm install
    • cd backend && pip install -r requirements.txt && cd ..
  • Frontend only: cd notebook-mlx-app/frontend && pnpm start
  • Backend only: cd notebook-mlx-app/backend && uvicorn main:app --reload
  • Electron (all-in-one): cd notebook-mlx-app && pnpm start
  • Docker (backend): docker compose up --build (serves on :8000)

meta-llama/NotebookLlama

I ported NotebookLlama and implemented it with MLX 🔥

It uses mlx-community/Qwen2.5-1.5B-Instruct-4bit for pre-processing the PDF, mlx-community/Qwen2.5-14B-Instruct-4bit for creating transcripts, mlx-community/Qwen2.5-7B-Instruct-4bit for rewrites, and lucasnewman/f5-tts-mlx for Text-to-Speech ⚡

Citing the NotebookLlama outline. Outline.jpg

Step 1: Pre-process PDF: Use mlx-community/Qwen2.5-1.5B-Instruct-4bit to pre-process the PDF and save it in a .txt file.

Step 2: Transcript Writer: Use mlx-community/Qwen2.5-14B-Instruct-4bit to write a podcast transcript from the text.

Step 3: Dramatic Re-Writer: Use the mlx-community/Qwen2.5-7B-Instruct-4bit model to make the transcript more dramatic.

Step 4: Text-To-Speech Workflow: Use lucasnewman/f5-tts-mlx to generate a conversational podcast.

The podcast audio

_podcast.mp4

Star History

Star History Chart