Colombia

Bogota Headquarters

93rd Street #16-46, Office 404, Zenn Office PH Building
Medellin
Cra 43rd No. 7-50, Office 1102 - Dann Carlton Business Center
Cali
Cra 100B #11A -19 Office 516 Pance Tower

Espain

Madrid

Calle Conde de peñalver, 45, entre planta oficina 2, 28006, Madrid

USA

Miami-Florida

1000 Brickell Av, PMB 5137

Mexico

Mexico DF

Av. Rio Misisipi 49 Int. 1402, Cuauhtémoc

Panama

City of Panama

Calle 50, edificio, torre BMW, San Francisco

AI-generated code is plausible by design; correctness has to be engineered

The tool alone isn’t enough. What makes an agentic process reliable is how the model is governed and who works alongside it—and even the best model on the market falls short of that on its own. Learn how to build a reliable process.

See more articles

Ten trends for 2027, one pattern: every agent needs a human by its side

On October 20 in Orlando, Gartner presented its top ten strategic technology trends for 2027. Six of them directly touch the three core capabilities of our portfolio. This is our perspective—from the teams doing the work every day.

The Agentic AI Balance Sheet That Every Financial Committee Must Consider

The principle underlying all three is the same one that guides our value proposition: accelerating innovation and driving productivity only make sense if it yields measurable results for the business.

What holds AI back in Latin America is neither cost nor access

On October 6, the World Bank. On October 20, ECLAC and Chile’s National Center for AI. Two distinct assessments reached the exact same conclusion: the bottleneck lies not in the tool itself, but in the organizational capacity to absorb it. An academic concept originating in 1990 brings order to what today’s numbers describe.

Mexico claims to have saved 14 billion pesos by building its own software. The other half of the bill is missing

Organizations currently celebrating what they avoided spending will, in a year or two, have to account for what it costs to maintain what they built.

77% of large enterprises trust that they know all their AI agents. Only 44% have a way to prove it

The challenge is not merely implementing AI agents. It is knowing precisely which ones are running, who bears accountability for them, how their outputs are validated, and how swiftly they can be shut down when something fails.

We Warned You in Our Webinar, and Bre-B Confirmed It

There is no way to guarantee that a participant in an interoperable payment ecosystem will never fail again; that exceeds what any single institution can control.

More than 30,000 developers responded to this year’s Stack Overflow survey: 83% use AI in their daily work, yet only 6.6% trust it for critical decisions. In our webinar, "Agents in the Software Lifecycle: From Code to Quality with Method," we shared how Q-Vision builds the architecture that bridges this gap—and here, we cross-reference our approach with the latest industry research.

During the webinar, Verónica Bravo, our Head of Innovation, opened with a scenario every engineering team recognizes: everyone is coding with AI, yet almost no one feels confident about the output. Recent data confirms this reality. The Stack Overflow survey, published on October 6, found that 83% of developers use at least one AI tool at work, and 73% of those using coding assistants or agents rely on them every day. Despite this adoption, 48% say they trust the output only when they can easily verify it, and just 6.6% trust it enough to make critical decisions. Google Cloud’s 2025 DORA report, surveying nearly 5,000 professionals, measured a similar divide: 90% use AI on the job, while 30% have little or no trust in the code it generates.

What developers actually do reveals even more than what they report. 76.5% run AI-generated code locally, 63.9% cross-check it against existing codebases, 53% inspect tests and security implications, and only 9.6% deploy it as-is. They verify because the output looks convincing on the surface—and that exact plausibility is what makes it so difficult to review.

Plausible by design

Verónica shared how we experienced this firsthand internally. We build software constantly—both for clients and for our own products—so we started working with large language models as soon as access became available. At first, we did what nearly everyone else did: asking the model in plain natural language for what we wanted, a practice known as vibe coding. For rapid prototyping, it works wonders. When taking it into production applications, however, the cracks began to show. The code compiled and superficially did what we asked, yet it failed under the hood: mishandling edge cases, hallucinating a function, calling a non-existent library, or forgetting to validate an input.

The phrase that best captures this reality is that AI-generated code is plausible by design, not correct by design. The model is trained to predict the most statistically probable token sequence, producing code that looks like what typically appears in a given context. At no point does it reason against a formal specification, execute the logic, or test it. Plausibility comes out of the box; correctness has to be engineered through explicit specifications, automated testing, and validation.

There is also a second perceptual trap that misleads engineering teams. In METR's 2025 study, sixteen experienced developers actually took 19% longer to complete tasks when using AI tools, yet upon finishing, they perceived themselves as having been 20% faster. That is precisely why our methodology measures end-to-end cycle time: writing, reviewing, and fixing.

When writing code is no longer the expensive part

Specification-driven development was not born with AI. Defining what a system must do before building it is an old idea that has returned because the underlying economics have shifted. For decades, typing out code was the slow, expensive part, making upfront specification feel like overhead. When an agent can deliver a complete feature in minutes, the bottleneck shifts to deciding with precision what to build. The specification has become a contract—and with a clear contract, the agent stops improvising and delivers something that can be verified.

We also learned where the boundary lies. Specifying everything upfront drags the team back into a slow, rigid waterfall methodology—the exact problem agile was designed to solve. Dosing how much to specify is a core part of the method. DORA describes this under a different name: among the seven capabilities its research shows amplify the positive impact of AI are working in small batches, establishing a clear stance on AI usage, and giving AI access to internal organizational context.

The Harness: What Surrounds the Model

An agent is a model running tools in a loop to accomplish an objective. The harness is everything surrounding that loop: what the agent can and cannot do, what requires approval, how it responds when something fails, project instructions, skills, specifications, and the guardrails monitoring inputs and outputs. The model thinks, and the harness decides what it is allowed to do with that thought. At Q-Vision, we package this as a standardized way of working: the team arrives on a project with the methodology already in place rather than inventing one on the fly. Individual developers stop using the agent in ad-hoc ways.

The term is gaining traction for good reason. On October 20, Gartner included AI coding agent harnesses among its ten strategic technology trends for 2027, describing them as closed-loop control systems equipped with verification gates and feedback cycles. Without that layer, Gartner warns, developers end up spending their time manually verifying machine output.

Academic research is beginning to quantify this impact. In an August 2026 study, Sydney Lewis held the underlying model constant and modified a single harness behavior: truncating older tool outputs as the context window filled up. Within a constrained window of 20,480 tokens across 169 tasks, completed solutions jumped from 43 to 72. With larger windows, the difference was minimal. The author’s conclusion is that the model and the harness must be evaluated together. The effect depends on the specific task and context—which is why we measure it on every project.

Four challenges, four responses

Published in 2023, the ISO/IEC 42001 standard is the first certifiable framework for AI management systems—and in Colombia, organizations have been able to pursue certification since September 2025. Verónica sums up the sequence we follow: control first, and only then the autonomy to delegate.

The agentic factory from the inside

Our factory workflow follows four stages that any software team will recognize: a requirement enters, and tested software comes out. First, context is understood and planned, converting the specification into discrete tasks. Next, the code is developed, reviewed, and optimized. Third, quality agents generate automated test cases, execute them, measure coverage, and detect risks. Finally, the software is delivered with validated quality, prepared deployment, and human sign-off at critical checkpoints. What sets this apart is that agents—up to thirteen within a single workflow—operate throughout the entire pipeline, and testing is no longer left at the end as a separate phase; every single improvement passes through it.

On the development side, there is a technical hurdle that took real effort to solve. Even with massive context windows, a single agent still cannot encompass an entire project. We orchestrate the work using graphs: the task is broken down into discrete steps that pass curated context between one another, with validation gates in between. The Stack Overflow survey helps explain why this is necessary: only 16% of developers say AI handles complex tasks very well, while 39% rate it as good, not great.

What the survey also demonstrates is that quality assurance is not disappearing. 58% of developers already use AI to write or improve tests, and 35% expect to use it even more. Verónica was skeptical from the very beginning of the idea that testing would stop mattering. The more code is generated, the more rigorous verification becomes. What changes is how it gets done: quality agents working directly alongside the people who govern and validate the outcomes.

Three questions attendees left behind

What do you do when someone bypasses the methodology or uses unapproved tools? Verónica answered that without governance, there can be no autonomy—and simply banning a tool is far less effective than it seems. Our solution was to centralize the agents. The factory, with its thirteen orchestrated agents, is shared across the entire organization: the company provides the license for the approved platform, and anyone who picks up a requirement finds the harness—defining exactly how that product is built—already embedded in their workflow.

How do you validate that an agent’s security recommendations are accurate? Through continuous monitoring of everything entering and leaving the system. Dedicated telemetry tools capture execution traces for every agent, showing what inputs it received, what validations it performed, and what decisions it made as a result. On top of that sits an AI gateway equipped with guardrails that verifies whether data is cleared to leave the organization before any request is sent to an external provider.

If the same ecosystem of agents plans, writes code, and tests, how do you guarantee quality independence? That was the sharpest question of the session. Verónica’s answer has two parts. First, in a well-architected factory, a single model does not do everything, nor do the agents share the exact same underlying model. Second, validation gates do not have to be AI agents at all—they can be deterministic scripts and automated processes that evaluate outputs without artificial intelligence, and every agent carries its own deterministic checks. An agent validated solely by another agent risks falling into a loop of mutual self-reinforcement.

Research strongly supports this caution. A paper presented at NeurIPS 2024 by Arjun Panickssery, Samuel Bowman, and Shi Feng demonstrated that models evaluating text recognize their own generated outputs and systematically favor them. A subsequent 2025 study found that this harmful self-preference persists even when the evaluator model is objectively wrong—and that stronger models exhibit this bias even more intensely when they make mistakes.

The recipe: responsibilities, checkpoints, and measurement

Underlying the factory are three foundational principles that apply to any project and with any tool.

Define responsibilities. Draw a clear boundary between what agents decide at each stage and what a human validates. Without that line, teams fall into one of two extremes: either a person reviews every single detail and speed is lost, or the agent operates unchecked and trust collapses. The agent handles repetitive and generative work—such as writing code, assembling tests, and drafting documentation—while the human retains decision-making authority and accountability. In regulated environments, there must always be an accountable person, and this boundary needs to be explicitly codified in the harness.

Establish checkpoints. Some checkpoints are automated—such as test suites—and one agent can review another. Others are human and mandatory whenever risk is high: a production deployment, a change affecting sensitive data, or any irreversible action. Putting a human at every single step kills speed, while having none kills security. That calibration is what makes a factory auditable and prevents it from becoming a black box.

Measure outcomes. Evaluate quality (how clean the output is and what percentage passes checks on the first run), efficiency (how much time and cost are genuinely saved), and reliability (how consistently it performs and how many incidents reach production). What matters is whether the software works and holds up in production—not how many lines of code the agent generated.

Proper measurement requires its own discipline. First, you establish a baseline: how long the team took to complete that exact same exercise using traditional methods. Next, you measure the same exercise, with the identical scope, using the agentic methodology. The calculation explicitly includes review and remediation time—where perceived speed usually deceives teams—and the final outcome is evaluated in production. Using this method across our internal innovation exercises, we recorded a 60% reduction in cycle time. That is an internal benchmark, tied to a specific baseline and defined scope, rather than a blanket promise for every team.

In Colombia, the Cenisoft and Fedesoft survey released on October 7 illustrates why rigorous measurement matters: software development is the primary use case for AI agents among technology companies at 74%, yet 30.77% still have not measured their impact.

A methodology that sustains a portfolio

With the methodology in place, the company sustains a much broader portfolio. Not every product was born with agents: several have existed for years and are now evolving significantly faster. Today, we offer codeless agentic testing, support for project documentation and estimation, synthetic test data generation, regulatory compliance risk management, and a connector that centralizes payment gateways. None of these operates as an isolated tool, because the underlying methodology holds them all together.

Within our portfolio architecture, this takes shape across three core pillars: Agentic SW Development, where the factory lives; Quality Intelligence, where everything built is rigorously tested; and Autonomous Data Stack, which feeds testing pipelines with data that never exposes sensitive information. Surrounding the entire ecosystem is the principle that governs our design: Human in the loop.

Verónica closed the webinar with the core takeaway we want to leave behind: the tool alone isn't enough. What makes an agentic process reliable is how the model is governed and who works alongside it—and even the best model on the market falls short of that on its own. That is what modern engineering looks like today.

Press enter or click outside to cancel.

Puedes configurar tu navegador para aceptar o rechazar cookies en cualquier momento. Si decides bloquear las cookies de Google Analytics, la recopilación de datos de navegación se verá limitada. Más información.