What to Edit Next: Visually Aligned Image-Editing Follow-Up Suggestions in Conversational Systems
Abstract
A three-stage multimodal framework improves follow-up edit recommendations in image-creation conversations by combining supervised fine-tuning, multi-objective reinforcement learning, and visual verification.
Conversational assistants increasingly recommend follow-up edits to help users continue a task. Existing systems primarily target text-only interactions, leaving image-creation conversations underexplored. In image-creation tasks, useful follow-up edit suggestions must reflect user preferences, offer diverse directions, and remain executable on the current image. We collected 100,000 real multi-turn image-creation conversation samples from Qwen App and found that 80.1% are image-dependent, underscoring the need for multimodal recommendation. We address this setting with a three-stage framework. In Stage 1, we use real online data to build a human-reviewed table of appropriate follow-up editing intents, then create SFT targets and fine-tune a multimodal policy. In Stage 2, to align rule-guided SFT suggestions with actual user choices, we use user click feedback to optimize the policy through multi-objective reinforcement learning. In Stage 3, to reduce visual inconsistencies between suggested edits and the current image, we introduce a visual verifier as additional training supervision. Extensive experiments demonstrate that our framework significantly outperforms baselines on both automatic and human evaluations. In a live user-randomized A/B test with millions of users, our final framework reduces visual inconsistency from 3.7% to 0.9%. Furthermore, it significantly improves recommendation CTR by 32.70%, image take-away rate by 16.32%, and average conversation turns per user by 39.90% (all p<0.05).
Community
Image-generation conversations rarely end after a single turn—but suggesting what users should edit next requires more than text-only recommendation. In this work, we study follow-up edit suggestions grounded in the current image and user intent. An analysis of 100,000 real-world conversations shows that 80.1% of follow-up interactions are image-dependent. We introduce a three-stage framework combining human-reviewed intent construction, multi-objective reinforcement learning from user click feedback, and a visual verifier that penalizes suggestions inconsistent with the image. In a large-scale online A/B test involving millions of users, our approach reduces visual inconsistency from 3.7% to 0.9%, while improving recommendation CTR by 32.70%, image take-away rate by 16.32%, and average conversation turns by 39.90%. These results highlight visually aligned follow-up suggestions as a practical way to make image-creation assistants more helpful, engaging, and easier to continue using.
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- NEXT: Reasoning-Driven Video Recommendation via a Vision-Language Model (2026)
- OneBar: An End-to-End Content-Grounded Generative Query Recommendation Framework for E-Commerce Video Feeds (2026)
- CanvasAgent: Enabling Complex Image Creation and Editing via Visual Tool Orchestration (2026)
- Navigating User Behavior toward Personalized Multimodal Generation (2026)
- MMShopBench: A Real-Log Benchmark for Multimodal, Multi-Turn Shopping Agents (2026)
- Making Implicit Preservation Intent Explicit in Conversational Image Editing (2026)
- Shape Your Feed: An LLM-based Agentic System for Conversational Recommendation (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2608.07565 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper