Can ai generate automated web tests?

I noticed a few more bugs with my self hosted drawing tool.

Ideally I want to have a few web based tests, so lets see if Claude and mcp-playwright can do that.

Check out these vids if you don’t know mcp-playwright:

• Turn Playwright into AI-Powered Test Automation with Claude MCP Server 🧠 - YouTube
• Playwright MCP Server: Auto-Generate Test code while running UI Operation 🎭🤖 - YouTube

I’ve seen it work with forms and content sites, I’m skeptical it can manipulate the excalidraw canvas tool well.

TL;DR

Tests were generated, while it managed the rename task, it wasn’t able to use the drawing tool successfully. While it was thinking and attempting reasonable solutions, so I might tinker a little further to see if it can draw.

Concerns

Some of the demo’s add credentials within the prompt, which is obviously terrible practice so don’t do that. Maybe a local MCP Server using onepassword cli with a Service Account an MCP client could use the MCP-one-password tool and the mcp-playwright tool and be able to provide the credentials between tools locally. I’d have to verify this is the case.