Competitor Price Collection for a Major Insurer
Major French insurance company
We automated the collection of competitor insurance quotes across auto, home, motorcycle, and boat products. The client went from 1,500 manually entered profiles to 28,000 automated profiles, cutting data entry by 95% and halving the collection cycle.
The Challenge
The client’s pricing and actuarial teams were manually filling out competitor quote forms and recording the results. The process was too slow, limited in volume, and consumed team time that should have gone to analysis.
The client is a leading French insurer covering auto, motorcycle, boat, home, and health products. To stay competitive, their pricing team needed to benchmark against competitors regularly. This meant going to competitor websites and price comparison platforms, filling out quote simulation forms for different customer profiles, and recording the results. Done manually, the team could process about 1,500 profiles per cycle, which took six months. Data quality suffered, volumes were insufficient for meaningful analysis, and the teams spent their time on data entry instead of pricing strategy.
Our Approach
We built a robust automation pipeline that fills out insurance quote forms programmatically across competitor sites and comparison platforms. The system handles anti-scraping protections including multi-factor authentication via email and SMS. The project was delivered in three phases: auto insurance (15,000 profiles), home insurance (10,000 profiles), then motorcycle and boat (3,000 profiles).
What We Built
Form automation at scale
Automated completion of insurance quote simulation forms across competitor sites and comparison platforms.
Multi-product coverage
Auto, home, motorcycle, and boat insurance. Each product line with its own profile configurations and target sites.
Anti-bot handling
Built to handle aggressive protections including email and SMS-based multi-factor authentication.
Phased delivery
Auto first (15,000 profiles, 8 weeks), then home (10,000 profiles, 4 weeks), then motorcycle and boat (3,000 profiles, 2 weeks).
Results
Manual data entry dropped by 95%. Profile volume went from 1,500 to 28,000 per collection cycle. The collection cycle itself was halved from 6 months to 3 months. The operational model became scalable and reliable enough to handle higher volumes without additional headcount. First results visible within 12 weeks.
Before & After
| Metric | Before | After |
|---|---|---|
| Profiles per cycle | 1,500 | 28,000 |
| Manual data entry | Hours per week | 95% less |
| Collection cycle | 6 months | 3 months |
| Error rate | Manual entry errors | < 1% |
| Time to first results | — | 12 weeks |