WhatsApp Receipt Manager-mini
Send a receipt photo via WhatsApp to automatically extract details, log them to Google Sheets, and receive a formatted summary back.
anyone managing their own dayfreelancers and consultants
What it does
Send a receipt photo via WhatsApp to instantly extract details like store name and total cost, which are automatically logged to your Google Sheets and returned as a clear summary. You get organized expense tracking without manual data entry or switching apps.
Step by step
- Configure the WhatsApp Business Cloud webhook to listen for incoming messages and media types.
- Set up a Google Service Account with domain-wide delegation or OAuth2 credentials to access Drive and Sheets APIs.
- Define the HTTP request payload structure for uploading files to Google Drive using the multipart/form-data format.
- Map the extracted JSON fields from the LLM response directly to specific columns in the target Google Sheet.
Where the LLM does the work
- Craft the system prompt to ensure consistent extraction of store names, items, payment methods, and totals from varied receipt layouts.
- Design the output schema instructions so the model returns clean JSON that can be reliably parsed by the downstream automation script.
- Generate natural language summaries for the WhatsApp reply that contextualize the extracted data for the user.
Watch out for
Receipt images often have low resolution or glare which causes extraction errors, so add a preprocessing step to enhance contrast before sending to the model.
WhatsApp media URLs expire quickly after download, so ensure the image is saved to a persistent location like Google Drive before processing begins.
Tools that fit
WhatsApp Business Cloud Service Receive receipt images and send summaries
OpenAI Chat Model LLM Extract structured data from receipts via OCR
The agent brief
Everything your agent needs, including the gotchas. Copy it and go.
You are helping me build the following AI agent workflow. ## Goal WhatsApp Receipt Manager-mini: Send a receipt photo via WhatsApp to automatically extract details, log them to Google Sheets, and receive a formatted summary back. ## Specification - What it does: Send a receipt photo via WhatsApp to instantly extract details like store name and total cost, which are automatically logged to your Google Sheets and returned as a clear summary. You get organized expense tracking without manual data entry or switching apps. - Trigger: Triggered by an event (Event · on new WhatsApp message) - Autonomy: Fully hands-off - Expected setup effort: a few focused days - Tools/services involved: - WhatsApp Business Cloud: Receive receipt images and send summaries - Google Drive: Store uploaded receipt images - OpenAI Chat Model: Extract structured data from receipts via OCR - Google Sheets: Log extracted receipt details for record keeping ## Known pitfalls, handle each one explicitly in your implementation 1. Receipt images often have low resolution or glare which causes extraction errors, so add a preprocessing step to enhance contrast before sending to the model. 2. WhatsApp media URLs expire quickly after download, so ensure the image is saved to a persistent location like Google Drive before processing begins. ## Reference implementation https://n8n.io/workflows/9285 (workflow template) Fetch and inspect this before building. If it matches my stack, adapt it; if not, rebuild the pattern with my tools. ## Process requirements 1. Before building: ask me which of the listed tools I actually use and what my platform is (n8n / Make / code / other). Do not assume. 2. Adapt the pattern to my answers; do not force the reference stack. 3. Address every pitfall above; tell me how you handled each. 4. Provide a test plan I can run before letting this touch real data. 5. Ask before any step that sends messages, modifies data, or spends money. Source: https://usecasesforagents.com/use-case/whatsapp-receipt-manager-with-gpt-4o-mini/ via usecasesforagents.com
Frequently asked questions
Can I use a different Messaging than WhatsApp?
Yes. WhatsApp is only the example messaging in this recipe. The same flow works with ClickSend API, Discord, Google Chat and LINE Messaging API. Swap the messaging connection and keep the rest of the setup as written.
Want this running in your business?
This is what I do. I design and build AI agents like this one, and keep them running. If you want it set up for your team instead of doing it yourself, get in touch.
Who it's for
Built for anyone who wants this off their own plate, no team or company required.
Freelancers and consultants can run this per-client with no changes beyond the source data.