Privacy and advertising choices

Git-Stars uses essential storage for site operation. Optional analytics and ad-measurement scripts stay disabled unless you accept them; partners such as Google may then use cookies or similar identifiers where required. Privacy Policy

LogoGit-Stars
Top StarsTrendingAI AgentsDaily PicksViral ReposInsights
LogoGit-Stars

Discover top GitHub projects with real rankings and AI insights

GitHub
Built withLogo of Git-StarsGit-Stars
Rankings
  • Top Stars
  • Trending
  • AI Agents
  • Daily Picks
  • Explore
Resources
  • Insights
  • Editorial Policy
About
  • About
  • Contact
Legal
  • Privacy Policy
  • Terms of Service
© 2026 Git-Stars. All Rights Reserved.
AI Agent Analysis
MI

web-infra-dev/midscene

AI-powered, vision-driven UI automation for every platform.

stars
15k
Language
TypeScript
GitHub
Source and compliance noteLast synced: Aug 13, 2026

Git-Stars is independent and not affiliated with GitHub or this project. Analysis may be AI-assisted and based on public repository metadata plus short README-derived summaries. We do not mirror full README files, docs, issues, or social comments.

Original GitHub sourceMethodologyEditorial Policy

Overview

Midscene.js is an open-source, vision-driven UI automation framework that uses screenshots and natural language instructions to automate and test interfaces across web, mobile, desktop, and custom platforms. Its core value proposition is eliminating reliance on fragile DOM selectors or accessibility trees, enabling robust automation for any visually perceivable element.

Installation

npm install @midscene/web (or use the Chrome extension for no-code experimentation; see https://midscenejs.com/quick-start)

Problem solved

Traditional UI automation and AI tools that parse the DOM or accessibility tree fail on dynamic or non-semantic elements (icon-only buttons, canvas, native apps, cross-origin iframes) and break with UI refactors. Midscene solves this by operating purely on screenshots, so it works on any platform and any visible element, and can assert visual states (colors, layout) rather than just DOM existence.

What you can build

Developers can build end-to-end UI tests, automated workflows, and AI-agent-driven automation for web, Android, iOS, HarmonyOS, desktop apps, and custom interfaces using a unified JavaScript SDK or YAML. Use cases include form validation, mobile app interactions (e.g., ordering coffee, liking tweets), data extraction, and even robotic arm control for in-vehicle testing. The ceiling is limited only by what a human can see on screen, with integration into Playwright/Vitest and AI agents via Midscene Skills.

Community sentiment

Positive

No community feedback yet.

Concerns

No concerns documented yet.

Bottom line

Midscene.js is ideal for QA engineers and developers who need robust, cross-platform UI automation that survives UI changes and works on non-semantic elements. It should be avoided by those requiring deterministic, structure-based automation or who lack access to AI models. The key trade-off is trading selector reliability for AI-driven visual understanding, which offers flexibility but introduces model-dependent variability.

Analyzed by Git-Stars - 8/13/2026