The Question Every Business Owner Asks First
Before anything else, you want to know: what does this actually cost?
Fair question. The AI industry is full of vague claims — "affordable," "cost-effective," "fraction of the price." Let's skip the marketing and look at real numbers.
The Three Cost Categories
Custom AI has three types of costs:
- One-time setup costs — Hardware and initial training
- Monthly operating costs — Compute and hosting
- Ongoing improvement costs — Adding products, refining responses
Let's break each one down.
One-Time Setup Costs
Hardware: The GPU
The AI runs on a graphics card (GPU) installed in a server. This is the biggest upfront cost:
| GPU | VRAM | Performance | Price |
|---|---|---|---|
| RTX 4090 | 24 GB | 150 tok/s | ~€1,600 |
| RTX 5090 | 32 GB | 165 tok/s | ~€2,000 |
| Used RTX 3090 | 24 GB | 90 tok/s | ~€800 |
For most businesses, an RTX 4090 or 5090 is the sweet spot. It handles real-time customer conversations with room to spare.
You also need a basic server to put it in — a desktop PC with a good power supply works fine. Budget €500-€800 for the rest of the components.
Total hardware: €2,100-€2,800
Training the Model
Training your custom AI model costs almost nothing in compute:
| Component | Cost |
|---|---|
| Compute for training (5 hours) | €0.50-€1.00 |
| Training iterations (5 runs to refine) | €2.50-€5.00 |
| Total training compute | Under €5 |
The real cost of training is human time — preparing your product data, writing training samples, and refining the model's responses. This typically takes:
- If you do it yourself: 2-4 weeks of part-time work
- If you hire a specialist: €2,000-€5,000 for initial setup
Total One-Time Costs
| Approach | Cost |
|---|---|
| DIY (you have a developer) | €2,100-€2,800 (hardware only) |
| With a specialist | €4,100-€7,800 (hardware + setup) |
Monthly Operating Costs
Once your AI is running, the ongoing costs are minimal:
| Component | Monthly Cost |
|---|---|
| Compute (GPU running 24/7) | €15-€30 |
| Internet / hosting | €0 (runs on your existing connection) |
| Software licenses | €0 (all open-source) |
| Total monthly | €15-€30 |
That's it. No per-conversation fees. No API bills that grow with usage. Whether your AI handles 100 conversations or 10,000 conversations in a month, your cost stays the same.
The Comparison That Matters
Let's compare the total cost over 12 months for different approaches:
| Approach | Year 1 Cost | Year 2 Cost | 2-Year Total |
|---|---|---|---|
| Human support team (2 people) | €72,000-€120,000 | €72,000-€120,000 | €144,000-€240,000 |
| ChatGPT API (5K conversations/month) | €3,000-€12,000 | €3,000-€12,000 | €6,000-€24,000 |
| Basic chatbot service | €2,400-€6,000 | €2,400-€6,000 | €4,800-€12,000 |
| Custom AI (with specialist) | €5,000-€8,200 | €180-€360 | €5,180-€8,560 |
| Custom AI (DIY) | €2,300-€3,200 | €180-€360 | €2,480-€3,560 |
Custom AI has the highest upfront cost but the lowest total cost over 2 years. And unlike API-based solutions, your costs don't scale with usage.
The Break-Even Point
When does custom AI pay for itself? That depends on what it replaces:
Replacing ChatGPT API (€500/month):
- Break-even: 5-8 months (DIY) or 10-16 months (with specialist)
Reducing support staff by 1 person (€3,000/month):
- Break-even: 1-2 months (DIY) or 2-3 months (with specialist)
Increasing sales by 15% (€2,000/month additional revenue):
- Break-even: 1-2 months (DIY) or 3-4 months (with specialist)
In most scenarios, custom AI pays for itself within the first 6 months.
Hidden Costs to Watch For
Let's be honest about costs that aren't always mentioned:
1. Data Preparation Time
Your AI is only as good as the data you train it on. Preparing quality training data takes time:
- Product catalog cleanup: 1-2 days
- Writing Q&A training samples: 1-2 weeks
- Safety and edge case samples: 2-3 days
If your product data is already well-organized (good descriptions, categories, prices), this goes much faster.
2. Iteration and Refinement
The first version of your AI won't be perfect. Budget for 3-5 training iterations over the first month as you:
- Review customer conversations
- Identify gaps in knowledge
- Add training samples for common questions
- Refine the brand voice
Each iteration costs under €1 in compute but takes a few hours of human review.
3. Hardware Maintenance
GPUs are reliable, but they do eventually need replacement:
- Expected lifespan: 3-5 years
- Power supply replacement: every 3-5 years (~€150)
- Budgeting for hardware refresh: ~€50/month set aside
What You Get for Your Money
Let's put this in perspective. For €2,500-€8,000 upfront and €30/month, you get:
- An AI assistant that works 24/7/365
- Handles 100+ simultaneous customers
- Offers multilingual support natively
- Knows every product in your catalog
- Updates pricing and inventory instantly
- Never calls in sick, needs training leave, or quits
- Gets better over time as you refine it
The equivalent human team would cost €6,000-€10,000/month.
How to Start Small
You don't have to commit to the full investment upfront:
- Month 1: Start with ChatGPT API to test the concept (€50-€200)
- Month 2-3: If it works, invest in hardware and custom training
- Month 4: Switch from API to your own model
- Month 5+: Enjoy fixed costs and full control
This way, you validate the concept with minimal risk before making the hardware investment.
Or Skip the Setup: Managed AI Service
Not everyone wants to manage their own hardware. A managed AI service handles everything for you:
| Component | Cost |
|---|---|
| Setup + training | €4,900–€9,900 |
| Monthly hosting & infrastructure | €490–€990/mo |
| Model retrains | €490 per update |
You get the same custom-trained AI model, the same product knowledge, the same brand voice — without buying hardware or managing servers. Your AI partner handles the infrastructure, updates, and maintenance.
For most businesses, the managed route is the faster path to value. You skip the hardware research, the setup time, and the maintenance overhead. The AI goes live in 4 weeks.
The Bottom Line
Custom AI isn't free, but it's dramatically cheaper than the alternatives over time. The upfront investment pays for itself within months, and the ongoing cost is a fraction of a single employee's salary.
The question isn't whether you can afford custom AI. It's whether you can afford to keep paying per-conversation API fees or human support costs when a better option exists.
Like what you see? Get in touch — we'll show you a demo on your own products.