Privacy and advertising choices
Git-Stars uses essential storage for site operation. Optional analytics and ad-measurement scripts stay disabled unless you accept them; partners such as Google may then use cookies or similar identifiers where required. Privacy Policy
AI-powered, vision-driven UI automation for every platform.
This repository page has enough original analysis, source evidence, and comparison context to be treated as an indexable Git-Stars review.
100
review score
Problem solved
Traditional UI automation and AI tools that parse the DOM or accessibility tree fail on dynamic or non-semantic elements (icon-only buttons, canvas, native apps, cross-origin iframes) and break with UI refactors. Midscene solves this by operating purely on screenshots, so it works on any platform and any visible element, and can assert visual states (colors, layout) rather than just DOM existence.
Deployment reality
The available setup signal starts with: npm install @midscene/web. Treat this as a starting point, then ask Codex or Claude to inspect the README, environment variables, runtime version, and deployment target before production use.
Commercial use
The recorded license is MIT. This is a useful commercial-use signal, but teams should still verify license text, dependencies, model/API terms, and trademark constraints.
Capability ceiling
Developers can build end-to-end UI tests, automated workflows, and AI-agent-driven automation for web, Android, iOS, HarmonyOS, desktop apps, and custom interfaces using a unified JavaScript SDK or YAML. Use cases include form validation, mobile app interactions (e.g., ordering coffee, liking tweets), data extraction, and even robotic arm control for in-vehicle testing. The ceiling is limited only by what a human can see on screen, with integration into Playwright/Vitest and AI agents via Midscene Skills.
Git-Stars is independent and not affiliated with GitHub or this project. Analysis may be AI-assisted and based on public repository metadata plus short README-derived summaries. We do not mirror full README files, docs, issues, or social comments.
web-infra-dev/midscene is tracked as a TypeScript project in the Developer Tool, Automation, UI Framework, Infrastructure area. This evaluation combines public GitHub metadata, category signals, short source summaries, and Git-Stars editorial rules rather than copying project documentation.
Momentum check: the repository has 15k total stars, with +11 today, +0 this week, and +0 this month. These growth windows help distinguish durable adoption from short-lived visibility spikes.
Maintenance check: current activity is Active; the latest push was 11 days ago, and the open issue queue is 90, about 0.62% of total stars. Treat this as an adoption signal, not a substitute for engineering due diligence.
Adoption check: 1.1k forks and 15k watchers suggest how often the project is reused or followed. License signal: MIT. Always verify license compatibility before commercial or internal use.
Practical fit: this project is most relevant when you need AI prototypes, LLM workflows, and agent-style applications. Be cautious when you need a legal review, security audit, or production SLA.
Source check: Git-Stars currently has 2 explicit source reference(s) for this report and a recent growth signal of 11. Follow the original GitHub repository for final install, security, and release information.
Analysis
ReadyOriginal problem, capability, and verdict guidance are available.
Sources
ReadyRepository metadata and README/source references are attached.
License
ReadyMIT is recorded for review.
Maintenance
ReadyRecent activity is visible in repository metadata.
Alternatives
ReadyEnough nearby projects exist for comparison.
Momentum
15k Stars
Reuse
1.1k Forks
Attention
15k Watchers
Maintenance
active
License
MIT
Open issues
90
Midscene.js is an open-source, vision-driven UI testing and automation tool that lets you write tests in natural language and automate any platform, including web browsers, Android, iOS, HarmonyOS, and desktop apps. It works from screenshots alone, eliminating the need for fragile selectors and enabling interaction with any visible element, even those without semantic markup. It integrates with Playwright, Vitest, and AI agents via Skills.
Key Features
- Natural language test writing with vision-driven AI (no selectors needed) - Works on any platform: web, Android, iOS, HarmonyOS, desktop, and custom interfaces - Supports visual assertions (colors, layout, rendered state) and integrates with Playwright/Vitest or AI agents via Skills
Developer Tool
Tools that improve coding, testing, build, and local workflow
Automation
Workflow automation, integration glue, and orchestration
UI Framework
Frontend frameworks, design systems, and interface libraries
Infrastructure
Cloud, deployment, networking, containers, and platform tooling
npm install @midscene/web80
Health Score
Active
Commit Activity
Jul 23, 2024
Created
Aug 12, 2026
Last push
+0
Today's growth
+0
7-day growth
+0
30-day growth
Forks
Open
Watchers
web-infra-dev
GitHub profilecodecrafters-io/build-your-own-x
Master programming by recreating your favorite technologies from scratch.
sindresorhus/awesome
😎 Awesome lists about all kinds of interesting topics
freeCodeCamp/freeCodeCamp
freeCodeCamp.org's open-source codebase and curriculum. Learn math, programming, and computer science for free.
EbookFoundation/free-programming-books
:books: Freely available programming books
nilbuild/developer-roadmap
Interactive roadmaps, guides and other educational content to help developers grow in their careers.
✓
License
✓
Forked
✓ Active
Maintained
Problem Solved
Traditional UI automation and AI tools that parse the DOM or accessibility tree fail on dynamic or non-semantic elements (icon-only buttons, canvas, native apps, cross-origin iframes) and break with UI refactors. Midscene solves this by operating purely on screenshots, so it works on any platform and any visible element, and can assert visual states (colors, layout) rather than just DOM existence.
Capabilities
Developers can build end-to-end UI tests, automated workflows, and AI-agent-driven automation for web, Android, iOS, HarmonyOS, desktop apps, and custom interfaces using a unified JavaScript SDK or YAML. Use cases include form validation, mobile app interactions (e.g., ordering coffee, liking tweets), data extraction, and even robotic arm control for in-vehicle testing. The ceiling is limited only by what a human can see on screen, with integration into Playwright/Vitest and AI agents via Midscene Skills.
Bottom Line
Midscene.js is ideal for QA engineers and developers who need robust, cross-platform UI automation that survives UI changes and works on non-semantic elements. It should be avoided by those requiring deterministic, structure-based automation or who lack access to AI models. The key trade-off is trading selector reliability for AI-driven visual understanding, which offers flexibility but introduces model-dependent variability.