D2R AI Item Tracker – OCR tooltips with a Vision LLM (no Tesseract!)I built a small open-source tool that extracts
Diablo II: Resurrected item tooltips from screenshots using a Vision LLM (OpenAI-compatible). No Tesseract or EasyOCR required - it just sends your screenshots to a vision model and returns clean text with line breaks preserved.
- Works with Groq, OpenRouter, OpenAI, LM Studio, Ollama (OpenAI bridge)
- Removes footer lines like “Shift + Left Click to Unequip”
- Skips other set pieces for set items
- Handles whole folders of screenshots into one `output.txt` (items separated by `---`)
- Built-in rate limiter to avoid 429s
https://github.com/vdamov/D2R-AI-Item-TrackerExample output looks like:
Code
ENIGMA
Scarab Husk
'Jah Ith Ber'
Defense: 1302
Durability: 30 of 30
Required Strength: 95
Required Level: 65
+2 to all Skills
+45% Faster Run/Walk
+1 to Teleport
+15% Enhanced Defense
+756 Defense
+65 to Strength [based on character level]
Increase Maximum Life 5%
Physical Damage Received Reduced by 8%
+14 Life After Each Kill
+15% Damage Taken Goes to Mana
87% Better Chance of Getting Magic Items [based on character level]
Increase Maximum Durability 10%
Socketed (3)
Super simple setup with Python + `.env` config, and you’re ready to track your items.