https://www.youtube.com/watch?v=DByAR5Su1Yw
TLDR AI can rapidly improve a website, but asking it to “innovate” without a clear vision often leads to bloated, buggy features instead of a better user experience; human taste and direction matter, and the more capable model cost far more while producing much more code.
Broad prompts can help an AI make visible improvements, but they leave the meaning of “better” open to interpretation. In the experiment, repeated requests to innovate encouraged both models to keep adding features, even when those additions did not make the coffee shop easier to use. Define the site’s goals, audience, and desired look before asking for changes. Clear direction helps the AI improve the experience instead of merely expanding it.
For a coffee shop website, the central job is helping customers find what they want and place an order. An order form, menu imagery, or a useful QR-code option can support that goal, while excessive text and features can make it harder. Before accepting a proposed change, ask whether it makes the primary task clearer or faster. Keep features that solve a real customer need and reconsider those that add friction.
A long sequence of AI-generated edits can introduce regressions as well as improvements. In the experiment, features and design choices were sometimes changed or removed, and Opus’s final site included broken elements and a language switch that did not work properly. Review each meaningful change before moving on, and test the flows it affects. This makes problems easier to catch and prevents them from accumulating across many rounds.
More features and more code do not automatically produce a better website. Opus’s version grew to roughly 21,000 lines of code and became overloaded, while Sonnet’s remained under 3,000 lines but still accumulated additions. Decide in advance what a successful redesign needs to accomplish, then stop when those goals are met. Remove features that do not earn their place through clearer usability or meaningful value.
The two runs differed substantially in time, cost, and output: Opus took about 8.5 hours and cost roughly $137, while Sonnet took nearly two hours and cost about $22 to $30, depending on the reported estimate. Opus produced more code and generated media sooner, but its larger output did not guarantee a better user experience. Choose a model based on the complexity of the work and the budget available, and evaluate results by usefulness rather than volume.
AI can produce design ideas and implement broad changes, but it may not know when a visual choice feels right or when a new feature is too much. The experiment’s results suggest that human judgment is especially important for shaping the site’s direction and protecting usability. Use AI to explore and build, then apply your own design standards and test the result with realistic customer tasks. Treat the model as a collaborator, not the final decision-maker.
The creator gave Sonnet 5.5 and Opus 5.5 the same basic coffee-shop website and asked each to “make it better” for 100 rounds, requiring a bold, shippable change each time. Each run started without memory, plugins, skills, or a Claude.md file.
Sonnet added features including a hero image, mobile support, a sticky order bar, menu images, animations, and an online ordering form. By round 100, the site had many more features, though some rounds produced no major milestone and the model occasionally removed or changed existing elements.
Opus made more progress in its first round and added features such as an order form, a QR code for texting orders, drink recommendations, and seat reservations. But the site became overloaded with features and text, had broken or buggy elements, and did not switch properly into Spanish, making ordering harder for customers.
The transcript gives slightly different Sonnet cost figures: about $29.93 in the initial account and about $22 in the later comparison. Opus cost about $137 and ran for 8.5 hours, while Sonnet took almost two hours. Opus produced roughly 21,000 lines of code, compared with fewer than 3,000 for Sonnet.
The model sets the ceiling, while the prompt sets the direction. Asking for innovation without a clear vision tends to encourage adding more features—including aggressive conversion features—instead of improving what users actually need. Human guidance, taste, and a clear design direction remain important.
Scroll Craft is the creator’s free website-design skill for scroll-driven animation, layering, typography, spacing, depth, and overall design taste. The creator uses it on sites including AI Automation Society.