Skip to content
HN On Hacker News ↗

AI Testing Platform: 117k Bugs Caught | Momentic

▲ 166 points • 132 comments • by wuweiweiwu • 3d ago • HN discussion ↗

Pangram verdict · v3.3

We believe that this text is a mix of AI and human-written content.

32 %

AI likelihood · overall

Mixed
68% human-written 32% AI-generated
SEGMENTS · HUMAN 25 of 35
SEGMENTS · AI 10 of 35
WORD COUNT 1,122
PEAK AI % 100% · §9
Analyzed
Nov 2
backend: pangram/v3.3
Segments scanned
35 windows
avg 32 words each
Distribution
68 / 32%
human / AI fraction
Verdict
Mixed
Pangram v3.3

Article text · 1,122 words · 35 segments analyzed

Human AI-generated
§1 Human · 0%

Catch bugs before they ship.

§2 Human · 0%

Mo is an AI QA engineer that tests your app end to end. Verify critical flows and find bugs from a prompt. Tests created 77,813 Test runs executed 70,607,819 Changes verified 339,166 PRs verified 80,290 Auto-heals 8,932,104 Bugs caught 117,010 Tests created 77,813 Test runs executed 70,607,819 Changes verified 339,166 PRs verified 80,290 Auto-heals 8,932,104 Bugs caught 117,010 Tests created 77,813 Test runs executed 70,607,819 Changes verified 339,166 PRs verified 80,290 Auto-heals 8,932,104 Bugs caught 117,010 Trusted in production by teams shipping every day. "Our team's experience with Momentic has been great. Setting up tests is simple and the developer experience has been fantastic." Erdem Head of Developer Experience, Notion "Having E2E QA be part of the development process, run this fast (6.3x parallel), and at this scale (for every single pull request) is a true dream. Seriously, a green CI now has a measurable impact on my sleep quality." Glavin Founding AI Engineer, Coframe "Momentic makes it 3x faster for our team to write and maintain end-to-end tests. Startups win by shipping faster and better, and Momentic enabled us to do exactly that." Alex CTO, GPTZero "I just ran our first automated eval across 110 prompts. This would have taken well over an hour manually — I kicked it off in 5 seconds and it was done in 14 minutes. HUGE for us." Mike Engineering Manager, Runway "I love working with Momentic. Especially after having years of previous experience in QA, it feels like riding a bike, except the bike is a supercharged electric one!" Anna Senior Productivity Engineer, Webflow 1 of 5 Code moves faster.

§3 AI · 81%

Verification has to keep up.

§4 AI · 100%

Coding agents have made it dramatically faster to build software. The bottleneck is now knowing it works. Verification belongs in the agent loop. Agents need evidence from the app itself to verify that their changes deliver the intended behavior.

§5 Human · 0%

Explore The agentic quality platform. Write the user flows you need to verify.

§6 Human · 0%

Momentic runs the tests against your app. Reuse successful AI actions and review proposed repairs as the app changes.

§7 Human · 0%

1 of 5 01 Knows how your product works Add terminology, expected behavior, and test guidance to the Knowledge base.

§8 AI · 100%

AI-assisted steps look up relevant entries as they run.

§9 AI · 100%

PRODUCT CONTEXT AT EACH AI STEP 02 Keep tests working as the UI changes Momentic finds controls again when the UI changes during a run. Permanent healing proposes a test-file repair for you to review. RUNTIME RECOVERY AND REVIEWED REPAIRS 03 Verify changes with your coding agent Give your coding agent the changed flow.

§10 AI · 100%

It can use MCP to author a test, check it in a live session, and save the YAML alongside your code. TESTS REVIEWED WITH THE CODE 04 See why a test failed Inspect the failing step, screenshots, and traces. Classify failures as application bugs, test flakiness, or environment issues. STEP-LEVEL FAILURE EVIDENCE 05 Verify before you merge or deploy Run the CLI in your CI job.

§11 AI · 100%

Use its exit code as a required check before merging or deploying.

§12 Human · 23%

CLI EXIT CODES FOR CI CHECKS Verification from your editor to CI.

§13 Human · 5%

Define what matters.

§14 Human · 0%

Let Momentic verify it.

§15 Human · 0%

Write steps and assertions in plain-English YAML.Review and version the tests in your repository.

§16 Human · 0%

01 / author Write tests in plain English Describe a user flow and its expected result in plain English.

§17 AI · 100%

Keep the steps and assertions in YAML files your team and coding agent can review. 02 / run Run locally and in CI Use the CLI to check the app you're changing. Run the same tests in CI before the next merge or deploy.

§18 Human · 0%

03 / triage Find the root cause See which step failed and inspect its screenshots and traces. AI triage investigates the cause and proposes a test repair for you to review.

§19 Human · 0%

04 / heal Auto-heal as your product evolves Momentic finds controls again when the UI changes.

§20 Human · 0%

Permanent healing proposes test-file edits for review. Apply the diff and rerun to check the result. Learns how your product works.

§21 Human · 0%

Describe your product’s terminology, business rules, and expected behavior in the Knowledge base. Agents use that context to choose actions and check outcomes. Knowledge base Give agents the product rules they need to check a flow.

§22 Human · 0%

App graph Maps screens and user flows seen during test runs. Review new guidance Review session suggestions before adding them to the Knowledge base.

§23 Human · 0%

Loved by engineering teams. “Momentic gave us a fast and reliable way to validate Poe.com's AI responses, even when they weren't deterministic.” Momoko F. Head of Product Operations, Quora 30 min daily test execution, down from 7 hours 500+ manual test cases replaced 100% critical tests created in one month Read the full story Examples of application failures found by Momentic, with the affected flow and its impact.

§24 Human · 0%

117,010 before production Detected ON A FEATURE BRANCH New-device 2FA prompt skipped At a consumer fintech app, a login routing change bypassed the new-device verification step.

§25 Human · 0%

Impact A security checkpoint was silently skipped.

§26 Human · 0%

Detected BEFORE RELEASE Page creation flow broken on mobile On mobile, keyboard auto-dismissed when creating a new page, breaking content flow.

§27 Human · 0%

Impact Silent friction in the core creation flow. Detected IN STAGING Driver ETA stuck on 'calculating' A dependency update on a large rideshare app caused the live ETA subscription to silently fail after a ride was booked. Impact Riders never saw an arrival estimate.

§28 Human · 0%

Detected BEFORE DEPLOY Scheduling availability displayed incorrectly Incorrect display and logic in the calendar scheduling view.

§29 Human · 0%

Impact Wrong availability shown to users.

§30 Human · 5%

Detected IN CI Timer reset when the screen locked At a leading wellness app, an iOS lifecycle change reset the active sleep timer the moment the phone locked.

§31 AI · 100%

Impact Audio sessions ended mid-playback overnight.

§32 AI · 100%

Detected 8 MIN BEFORE DEPLOY Saved cards dropped at checkout At a top food-delivery marketplace, a payment-form refactor stopped pre-filling saved cards, forcing manual re-entry to pay. Impact Returning users abandoned checkout on mobile. Detected IN A NIGHTLY RUN Filters cleared when paginating results At a popular online retail marketplace, moving to page two reset every active category and price filter. Impact Shoppers lost their refined search results. Detected BEFORE MERGE Valid promo codes rejected at the final step At a large online travel marketplace, a validation change rejected multi-segment promo codes on the last checkout step. Impact Discounts failed and carts were abandoned. Detected PRE-RELEASE Wrong subtitle language on first play At a major streaming platform, a locale-detection bug auto-selected the wrong subtitle track on initial playback.

§33 AI · 100%

Impact Wrong-language captions at session start.

§34 Human · 0%

Detected BEFORE RELEASE Legacy API issues exposed 12 bugs caught in one day. Exposed legacy API issues that would have shipped undetected.

§35 Human · 0%

Impact Risked shipping regressions into major release. Verify what you ship.