← Back to Projects

leptons1618@anishgiri.dev:~/projects/echoscript cat project.toml

AI / ML 2024 Active development

EchoScript

Paste a YouTube link, get a transcript you can search and click to hear — Whisper already returns timestamps, so every line becomes a seek target back into the video.

category
AI / ML
year
2024
status
Active development
stack
7 tools
highlights
4
write-up
3 min read

01Highlights

  1. Transcribes YouTube content using Whisper/Faster-Whisper with configurable model settings.
  2. Synchronizes transcript segments with video playback for interactive review.
  3. Generates AI notes/summaries and supports export to PDF, TXT, and Notion.
  4. Provides searchable job history with transcript filtering and keyboard-driven navigation.

02Built with

  • 01Python
  • 02Flask
  • 03React
  • 04OpenAI Whisper
  • 05Faster-Whisper
  • 06yt-dlp
  • 07ffmpeg

03Case study

May 20, 2024 3 min read 579 words

EchoScript

A YouTube URL in, a searchable transcript and a set of notes out — with the text and the video kept in sync.

The problem

A two-hour talk contains maybe eight minutes you need, and video is the worst possible medium for finding them: you cannot search it, skim it, or quote it. Transcription alone does not fix that. A raw wall of transcript is only marginally easier to work with than the video, because once you find the sentence you wanted you have lost the one thing the video had — the ability to go and hear it said.

The solution

A Flask backend pulls audio with yt-dlp, normalises it through ffmpeg, and transcribes with Whisper or Faster-Whisper at a model size the user picks. Because Whisper returns timestamped segments rather than flat text, the React frontend can make every line a seek target: click a sentence, the player jumps to it. The same segments feed AI-generated notes, full-text search, and export to PDF, TXT or Notion.

Outcomes

  • Click any line of the transcript to jump the video to that moment — the segment timestamps Whisper already returns are what make this free.
  • Model size is a user choice, not a build-time constant: tiny for a quick pass, large when accuracy matters, with Faster-Whisper for machines without a GPU.
  • Full-text transcript search with keyboard navigation — Enter to search, F3 and Shift+F3 through hits, Escape to clear.

+3 more in the write-up

Inside the write-up

  1. The pipeline
  2. Why the sync is the feature
  3. GPU optional, and honest about it
  4. Things it does not do
Read the full case study →