<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Archive on Tech Foundations</title><link>https://valery.tech/ai-engineering/evaluation/archive/</link><description>Recent content in Archive on Tech Foundations</description><generator>Hugo</generator><language>en-US</language><copyright>Copyright (c) 2014-2023</copyright><atom:link href="https://valery.tech/ai-engineering/evaluation/archive/index.xml" rel="self" type="application/rss+xml"/><item><title>Ai System Problems Symptoms Report</title><link>https://valery.tech/ai-engineering/evaluation/archive/ai-system-problems-symptoms-report/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://valery.tech/ai-engineering/evaluation/archive/ai-system-problems-symptoms-report/</guid><description>&lt;h1 id="systemic-problems-and-observable-symptoms-in-llm-agentic-workflows-and-semantic-rag-systems"&gt;Systemic Problems and Observable Symptoms in LLM Agentic Workflows and Semantic RAG Systems&lt;/h1&gt;
&lt;p&gt;&lt;strong&gt;Date:&lt;/strong&gt; 2026-05-09&lt;/p&gt;
&lt;p&gt;&lt;strong&gt;Scope:&lt;/strong&gt; Systemic research on intrinsic problems and observable symptoms of AI systems, especially LLM-based agents, semantic RAG systems, and tool-using workflows.&lt;/p&gt;</description></item><item><title>Ai Systems Features</title><link>https://valery.tech/ai-engineering/evaluation/archive/ai-systems-features/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://valery.tech/ai-engineering/evaluation/archive/ai-systems-features/</guid><description>&lt;p&gt;Understanding LLM mechanisms and AI-system failure modes gives us a practical engineering advantage. Instead of discovering weaknesses only through production incidents, we can anticipate them during system design. The mechanism stack lets us identify which causal surfaces are relevant for a given application, derive likely failure modes, and then select appropriate controls, traces, recovery paths, and evaluations before deployment.&lt;/p&gt;</description></item><item><title>Causal Stack (Archived)</title><link>https://valery.tech/ai-engineering/evaluation/archive/stack-old-layer-1/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://valery.tech/ai-engineering/evaluation/archive/stack-old-layer-1/</guid><description>&lt;h1 id="model-mechanism-constraints"&gt;Model-Mechanism Constraints&lt;/h1&gt;
&lt;h2 id="definition"&gt;Definition&lt;/h2&gt;
&lt;p&gt;Architecture-implied operating constraints or model-mechanism constraints are predictable behavioral limits induced by the model&amp;rsquo;s generation mechanism, before considering domain data, product policy, or system integration. That are constraints that follow from transformer-style sequence modeling and autoregressive/probabilistic decoding.&lt;/p&gt;</description></item><item><title>Stack Umbrella Model</title><link>https://valery.tech/ai-engineering/evaluation/archive/stack-umbrella-model/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://valery.tech/ai-engineering/evaluation/archive/stack-umbrella-model/</guid><description>&lt;h2 id="recommended-umbrella-model"&gt;Recommended Umbrella Model&lt;/h2&gt;
&lt;p&gt;The chain:&lt;/p&gt;
&lt;p&gt;Mechanism -&amp;gt; Constraint -&amp;gt; Failure Pattern -&amp;gt; Boundary -&amp;gt; Control -&amp;gt; Test/Monitor&lt;/p&gt;
&lt;p&gt;Example:&lt;/p&gt;
&lt;p&gt;Autoregressive decoding -&amp;gt; plausibility pressure -&amp;gt; unsupported claims -&amp;gt; unacceptable in legal/medical/finance -&amp;gt; retrieval + evidence policy + verifier -&amp;gt; citation integrity monitor&lt;/p&gt;</description></item></channel></rss>