neuwirth/levineuwirth.org
neuwirth
/
levineuwirth.org
1
1
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
This repository contains the source files for levineuwirth.org in their entirety and is automatically updated whenever the website is rebuilt. https://levineuwirth.org
141 Commits 1 Branch 0 Tags 25 MiB
Haskell 39%
CSS 19.2%
JavaScript 17.8%
Python 10.1%
HTML 6.9%
Other 7%
Go to file
Levi Neuwirth 945086421a embed.py: hash-cache the paragraph pass; drop the dead mtime skip 
The 'skip if outputs newer than every HTML' check could never fire:
stamp-build-time.py rewrites every page's footer AFTER embed.py runs,
so the comparison was always false and the full MiniLM paragraph pass
(and model load) ran on every build (AUDIT §4.3). Replaced with the
same content-hash cache the page pass already had — generalized
load/save_vec_cache, keyed by sha256 of the input text, invalidated on
model/revision/dim change. A no-change rerun now does no model loads:
measured 97s cold -> 4.8s warm.

Also strips section.footnotes from extraction: the new no-JS fallback
duplicates each sidenote's text at document end, which would double
footnotes in search results and skew page similarity.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
 		2026-06-10 10:51:01 -04:00
archive Add link archive system: snapshots, backlinks, link-rot 2026-05-23 10:06:33 -04:00
build Sidenotes: emit the section.footnotes fallback the CSS expects 2026-06-10 10:37:28 -04:00
content Drafts are local-only: untrack the four committed ones 2026-06-10 10:40:05 -04:00
data Internal audit 2026-05-07 17:20:27 -04:00
nginx Fix audit tooling/infra findings 2026-06-10 09:21:47 -04:00
static Branding diet: logo sprite via <use>, lean favicon.ico, simple mask icon 2026-06-10 10:43:06 -04:00
templates Branding diet: logo sprite via <use>, lean favicon.ico, simple mask icon 2026-06-10 10:43:06 -04:00
tools embed.py: hash-cache the paragraph pass; drop the dead mtime skip 2026-06-10 10:51:01 -04:00
.env.example States/Context/Embeddings fixes 2026-04-26 11:22:57 -04:00
.gitignore embed.py: hash-cache the paragraph pass; drop the dead mtime skip 2026-06-10 10:51:01 -04:00
.python-version GPG signing, embedding pipeline, visualization filter, search timing, sig popups 2026-03-20 20:14:49 -04:00
ARCHIVE.md Add link archive system: snapshots, backlinks, link-rot 2026-05-23 10:06:33 -04:00
AUDIT-2026-06-09.md Add 2026-06-09 repository audit findings 2026-06-09 18:57:43 -04:00
AUDIT.md Add AUDIT.md 2026-05-07 15:07:48 -04:00
HOMEPAGE.md affiliation, cabal helper script 2026-03-26 08:14:50 -04:00
LICENSE Add MIT License to the project 2026-03-15 19:02:33 +00:00
MARKS.md Marks I 2026-05-07 23:51:14 -04:00
Makefile Fix audit tooling/infra findings 2026-06-10 09:21:47 -04:00
PHOTOGRAPHY.md Spec dilemma 2026-05-01 21:22:01 -04:00
README.md Docs: align WRITING.md and README with the implementation 2026-06-10 09:43:25 -04:00
WRITING.md Docs: align WRITING.md and README with the implementation 2026-06-10 09:43:25 -04:00
cabal.project initial deploy! whoop 2026-03-17 21:56:14 -04:00
cabal.project.freeze Refreeze after system update: distributive 0.6.3 et al. 2026-06-09 18:57:25 -04:00
levineuwirth.cabal Add link archive system: snapshots, backlinks, link-rot 2026-05-23 10:06:33 -04:00
pyproject.toml embed.py: split page vs paragraph embedding models 2026-06-09 18:57:43 -04:00
uv.lock embed.py: split page vs paragraph embedding models 2026-06-09 18:57:43 -04:00

README.md

levineuwirth.org

Personal site of Levi Neuwirth — essays, blog posts, poetry, fiction, and music. Built with Hakyll and Pandoc, with a custom build system in build/ and a Haskell + JS + Python toolchain.

Quickstart

make build              # one-shot production build into _site/
make dev                # dev build (drafts visible) + local server on :8000
make watch              # Hakyll live-reload dev server (drafts visible)
make clean              # cabal run site -- clean
make deploy             # clean → build → sign → push → rsync to VPS

make build always runs make clean implicitly when invoked from make deploy. For day-to-day work, prefer make dev (which serves the site on http://localhost:8000) or make watch (Hakyll's live-reload preview server, which rebuilds on save and serves the site locally).

Run make build any time you add or replace binary assets (JPEG/PNG figures, PDFs, music assets). make dev and make watch skip the convert-images.sh / pdf-thumbs preprocessing steps, so a fresh JPEG will have no .webp companion and a fresh PDF will have no thumbnail until a full make build regenerates them. Once the companions exist they survive subsequent make dev runs.

Optional features

  • Similar-links and embeddings. tools/embed.py precomputes page-level embeddings for the "Related" block. To enable:

    uv sync                 # creates .venv with sentence-transformers, faiss-cpu

    The build silently skips embedding when .venv is absent.

  • Client-side semantic search. Downloads a quantized ONNX model used by static/js/semantic-search.js (run once; files are gitignored):

    make download-model

  • Image conversion. make build calls tools/convert-images.sh to produce .webp companions next to every JPEG/PNG. Requires cwebp (libwebp on Arch, webp on Debian/Ubuntu).

  • PDF thumbnails. make pdf-thumbs generates first-page thumbnails for PDFs in static/papers/ using pdftoppm (poppler on Arch, poppler-utils on Debian/Ubuntu). Skipped silently when missing.

Configuration

.env (gitignored, copy from .env.example) holds the GitHub PAT and the VPS rsync target consumed by make deploy. Never commit it.

Repository layout

  • build/ — Haskell build system (Hakyll rules, Pandoc filters, contexts). See build/Filters/ for the Pandoc AST transforms (sidenotes, wikilinks, transclusion, score embedding, viz, …).
  • content/ — authored Markdown (essays, blog, poetry, fiction, music).
  • templates/ — Hakyll/Pandoc HTML templates.
  • static/ — CSS, JS, fonts, images, vendored PDF.js.
  • tools/ — Python tooling (embeddings, importers) and shell scripts.
  • data/ — generated and source data (commonplace.yaml, annotations.json, bibliographies, similar-links.json).
  • nginx/ — vhost snippets shipped to the VPS (security-headers.conf, static-assets.conf, popup-proxy.conf). The live vhost on the VPS is the source of truth; see nginx/vhost.conf.example for the canonical structure and the include order these snippets expect.

Architecture pointers

  • build/Site.hs is the Hakyll rules entry point.
  • build/Patterns.hs defines canonical content patterns shared by Backlinks, Authors, Tags, and Site.
  • build/Compilers.hs wires the Pandoc filter chain into Hakyll.
  • build/Filters/Images.hs does WebP <picture> wrapping; requires the .webp companions produced by tools/convert-images.sh.

License

See LICENSE.