Visual Search Implementation at Allegro: A Case Study on User-Centric Innovation
Project by Arek Skuza: Designing AI Architecture & Bridging Customer-Team Collaboration for Visual Search Innovation at Allegro
About Allegro
Leading e-commerce platform in Central Europe with 21 million monthly users
  • Founded in 1999
  • Dominant market position in Central Eastern Europe
  • Pioneering innovation in online shopping experiences
Project Objectives
Primary objective: "Evaluate if ML-powered visual search could enhance user experience"
Reduce product search time
Streamline the path from discovery to purchase with image recognition
Increase conversion rates
Reduce number of search results through image recognition and image search
Decrease reliance on text-based search
Offer intuitive visual alternatives
Expand average transaction values
Encourage discovery of hard to find products like "black shirt"
Key Results
Visually striking representation of the main outcomes
24%
Reduction in product search time
Users found what they needed faster than ever
17%
Increase in impulsive purchasing
Visual discovery drove spontaneous buying decisions
13%
Lower customer acquisition costs
More efficient marketing and user retention
8.5%
Expansion in average cart size
Users discovered and purchased more items per session
Methodology Approach
Introduction Path Design
Structured rollout with user feedback loops. Showing future AI features help to uncover value, pains and gains.
Experimentation Framework
From proof of concept to incremental expansion together with customers
Comprehensive Metrics
Technical, business, and user satisfaction KPIs
MLOps & Model Selection Challenges
1
1. Model Selection and Evaluation
Challenge of choosing the right AI model architecture from multiple options (CNNs, Vision Transformers, hybrid approaches) and establishing proper evaluation metrics for visual search accuracy
2
2. MLOps Pipeline Development
Building robust ML infrastructure for model training, validation, deployment, and monitoring at scale with 100M+ product images
3
3. Model Performance Optimization
Balancing model accuracy, inference speed, and resource consumption while maintaining 99.7% uptime and sub-3-second response times
AI/ML Solutions Implemented
Model Architecture Selection & Benchmarking
  • Implemented automated model comparison framework
  • Tested CNN architectures (ResNet, EfficientNet) vs Vision Transformers
  • 89% accuracy achieved with hybrid CNN-Transformer approach
  • A/B tested 5 different model architectures with real user data
MLOps Infrastructure & Automation
  • Built end-to-end ML pipeline with automated retraining
  • Implemented continuous integration for model deployment
  • Real-time model monitoring with drift detection
  • Automated scaling handling 50M+ daily inference requests
Performance Optimization & Monitoring
  • Model quantization reduced inference time by 40%
  • Implemented edge caching for 2.3s average response time
  • Real-time performance dashboards tracking accuracy and latency
  • Automated rollback system for model performance degradation
Technical Implementation
Visual representation of the technology stack:
Core Technologies
  • Neural Networks (CNNs + Transformers)
  • Training on 100M+ product images
  • Mobile integration (iOS and Android)
  • User interfaces for taking/uploading photos
Performance Metrics
  • 85% accuracy in product recognition
  • 2.3 sec response time for search results
  • 99.7% uptime ensuring reliability
User Experience Flow
Show a visual step-by-step of how users interact with the feature:
01
User sees product of interest
(in store, magazine, online, billboard, TV, friends house)
02
Opens Allegro app and uses camera feature
Simple, intuitive interface for capturing images
03
System recognizes product and shows matches
AI-powered results appear within seconds
04
User browses alternatives and adds to cart
Seamless transition from discovery to purchase
Include actual app screenshots if possible
User Segmentation Insights
Visualize how different user segments responded:
Early adopters vs. mainstream users
Distinct adoption patterns emerged across user types
18-34 age group adopted 2.3x faster
Younger demographics embraced visual search immediately
Fashion category users showed 37% higher engagement
Visual-first categories saw strongest adoption
Innovation adoption curve with percentages
Business Impact
Create compelling charts for:
  • Search time reduction (24%)
  • Conversion improvements (22% growth in "discover to cart")
  • Cost savings (18% reduction in paid search spending)
  • User satisfaction (NPS increase of 7 points)
  • Reduce of click through rate
Key Learnings
1
"User-centricity is paramount"
Every decision must prioritize the end user's needs and experience
2
"Early and continuous testing is critical"
Iterative feedback loops prevent costly mistakes and accelerate success
3
"Cross-functional collaboration accelerates success"
Breaking down silos enables faster innovation and better outcomes
4
"Balance technical and business metrics"
Success requires measuring both system performance and business impact
5
Artificial Intelligence needs KPI to follow
Defining clear KPIs for AI initiatives ensures alignment with business goals and facilitates ongoing evaluation of effectiveness and ROI. Without measurable objectives, AI projects risk losing direction and failing to deliver meaningful results.
Future Directions
Visual roadmap of planned enhancements:
1
Multi-item recognition capability
Identify multiple products in a single image
2
Video search functionality
Search using video clips instead of static images
3
Augmented reality integration
Visualize products in real-world environments
4
Cross-platform expansion
Extend visual search to web and additional devices
C-Level AI Transformation Architect
Since 2003, I have been supporting the Boards of B2B companies in AI transformation, helping them achieve extraordinary results through technology, especially Artificial Intelligence.
Key Achievements and Experience
Global AI Projects
Collaboration with European and American companies, streamlining business processes through automation and AI.
Focus on Measurable Results
Generated approximately $53.3 million in cost savings / revenue loss prevention for industrial and manufacturing companies.
Productivity Growth
110% average increase in productivity metrics and an average 35% reduction in time to revenue.
Trusted By
Ikea, Discovery Networks, Shell Energy, Neuca, Modoma, Arcade, Benefit Systems, BetFan, Krispol, Krishome, ETX, Saleslions, EY, Langas, Seka, Allegro, Maspex, and over 35 others.
Tech Titans Board Member
Actively supporting the development of AI and technology in the USA.
Thank you
www.arekskuza.com
www.voltaventure.com
Scan QR code and connect with Arek through Linkedin