AI Agents for Magazine Article Processing
Agent Pipelines and MLOps for Magazine Summarization, Translation, Classification and Conversion
This is a company project, so this page covers only what can be shared: the goals, the system design, my contributions and the results.
I built and run an LLM + VLM system that processes magazine articles end to end. It summarizes, translates, classifies and compresses article text, cleans up OCR output, and rebuilds scanned magazine pages into web-view articles ready to publish. The same agents answer on-demand requests through FastAPI endpoints and process whole batches as Dagster jobs.
The three case studies show where I measured a bottleneck in this system and what changed once it was fixed.
System overview
Every feature is an agent in one library that knows nothing about the web. FastAPI wraps that library for on-demand calls from the text viewer and bulk jobs. Dagster wraps the same code for batch work, where every article is its own run. All models are served locally: an LLM on vLLM for text, and OCR plus a layout VLM for scanned pages.
Two L40S GPUs can't hold every model at once, so the server swaps the vLLM stack for default, summarization or classification mode. Jenkins deploys the service, waits until it is ready and runs smoke tests.
LangChain · LangGraph · Langfuse · vLLM · FastAPI · Dagster · DSPy · deepeval · Prometheus · Grafana · PostgreSQL · Docker