Aby George A

Welcome to the blog.

Agentic QA

Beyond the Co-Pilot: My Q2 Plan for Multi-Agent Automation First off, if you noticed complete radio silence on here over the last quarter, I have a pretty solid excuse! Work has been an absolute whirlwind. Between non-stop flights between Australia, Singapore and India, setting up new offshore engineering teams, and establishing new engineering ways of working from scratch, my calendar completely ate my side projects for breakfast. On top of that, team resource constraints meant I had to jump back into active microservice development alongside my management duties—building out core service APIs, handling edge cases, and pushing production code. ...

Vibium

The Hype: Jason Huggins Just Announced Vibium, and Browser Automation Will Never Be the Same If you’ve spent any time in the software testing space over the last two decades, you know the name Jason Huggins. He’s the guy who created Selenium back in 2004, basically founding modern web test automation, and later gave us Appium for mobile. So when Jason Huggins drops a new open-source project, the entire testing community stops what it’s doing and looks up. ...

Smart Regression Testing

Running huge regression suites every time I push a small change to a repo is super inefficient and slow, especially as projects start growing and getting complex. Lately, I’ve been diving deep into AI-Driven Risk-Based Selection to make my testing workflow fast, targeted, and lean. Smarter Builds with Risk-Based Selection Instead of blindly firing off every single test on every commit, I’ve been tinkering with a script that inspects the exact files changed in a Git diff. The script parses the modified code, maps out the underlying dependencies, and picks only the top 15% or so of tests that are actually affected by those changes. ...

Rise Of Agentic Testing Framework

Lately, it feels like we’ve crossed into a totally new era with AI tools. Over the past few months, my focus has shifted from simple code auto-completions to playing around with Autonomous Agentic Workflows. Instead of just having an assistant that finishes a line of code, an agent acts more like a goal-oriented script. You give it a high-level target, and it can plan out multi-step actions, check the results, and adjust its approach on the fly. ...

Token Optimization and prompt caching

As I’ve been leaning heavier into AI-assisted coding and scripting for my own side projects over the past year, my API token usage shot up fast—it went from a cheap experiment to an invoice that made me do a double-take. Lately, my focus has been all about Token Optimization, Context Caching, and keeping my setup lean. Things I’ve Been Tweaking 1. Prompt Caching & Smart Context Truncation When OpenAI and Anthropic rolled out prompt caching, I jumped on it immediately for my personal scripts. By caching heavy system prompts, common schemas, and reusable code patterns, I managed to slash my monthly LLM API spend by over 45% while actually speeding up execution times. ...

Multimodal Vision Testing

With multimodal models like GPT-4 Vision and Claude 3 Opus getting so much sharper, test automation is finally moving beyond fighting with the HTML DOM and into actual Visual and Spatial Verification. Things I’ve Been Experimenting With 1. Screenshot-Based Visual Assertions In the past, visual testing meant wrestling with rigid pixel-by-pixel diff tools that would blow up your build over a tiny font rendering shift. Lately, I’ve been feeding raw UI screenshots directly to vision-capable LLMs along with plain English questions: “Is the checkout button properly aligned below the order summary? Is any text overlapping?” ...

Building Run Self healing

Flaky tests caused by shifting DOM element IDs have been the bane of my existence for as long as I’ve been writing test automation. I got tired of constant pipeline failures over minor UI tweaks, so lately I’ve been tinkering with Runtime Self-Healing Mechanisms directly inside my Playwright test runners. What I’ve Been Building Recently 1. Dynamic Selector Healing I set up dynamic error interceptors inside my test suites. When a locator lookup fails (say, a TimeoutError: element '#submit-order-v2' not found), the test runner catches the exception, snags a snapshot of the surrounding DOM tree, and hands it off to an LLM to request an alternative CSS or XPath selector. ...

Structured Output, Function Calling, and Autonomous Test Authoring

Entering 2024, it feels like the whole AI tooling ecosystem has leveled up dramatically over the last year. We’re finally moving past hacky string parsing and regex workarounds—OpenAI’s native Function Calling has completely changed how I build scripts that interact with LLMs. What I’ve Been Experimenting With Lately 1. Reliable, Deterministic Scripting via Function Calling Instead of asking the model for raw code or text and hoping for the best, I’ve been defining strict JSON schemas for core test actions—things like click_element(selector), fill_input(selector, text), and assert_text(expected). ...

Playwright's Dominance And the low code AI Influx

Lately, it feels like we’ve hit a real tipping point with web automation. Selenium had a great decade-plus run, but for me, Microsoft Playwright has officially taken over as the go-to tool for modern web testing. It’s just so much faster and smoother to work with. At the same time, I’ve been keeping an eye on the flood of new commercial “low-code” AI test tools popping up everywhere, trying to see if they actually deliver on bridging the gap between manual testing and automated pipelines. ...

IDE Assistants and shift towards API Automation

The initial novelty of pasting prompts into web browser windows has pretty much worn off. Lately, I’ve been way more interested in how AI fits directly into the everyday coding workflow—mostly tinkering with GitHub Copilot and inline code completions right inside the editor. At the same time, my own approach to test automation has been shifting. I’ve been leaning much harder into API and microservice testing lately, mostly because keeping heavy UI tests reliable as apps change fast is a constant uphill battle. ...