InferX · Agent-Native Inference Infrastructure
    Technical Whitepaper

    Skill Function

    Cloud-Native Skill-as-a-Service for Agent-Native Workloads. A cloud platform that hosts AI skills as independent, callable services — matching the right model to each task, breaking the single-context-window barrier, and enforcing a zero-authority security boundary by design.

    Author
    Brad Sun · brad.sun@inferx.net
    Published
    2026
    Website
    inferx.net
    Executive Summary

    The flagship-model tax is financially unsustainable

    Today's AI agents route every task — trivial or complex — through a single expensive flagship model, inside one crowded context window, with every third-party skill running at full local system privilege. The result is runaway cost, degrading accuracy, and a security surface enterprises increasingly refuse to accept.

    InferX Skill Function is a cloud-native Skill-as-a-Service platform. It hosts AI skills in the cloud and lets agents invoke them exactly like an MCP tool. Each skill runs as an independent service with its own dedicated context, its own author-bound model, and a clean input — the user request plus a minimal history summary.

    70–90%
    Lower inference cost on mixed workloads
    90–95%
    Fewer context tokens per call
    50–80%
    Lower latency on parallel workflows

    Three structural shifts

    01
    Right model for the right skill
    The skill author binds each skill to a pre-selected model. A 7B model summarizes routine email; a 70B model reviews legal contracts. You stop paying flagship prices for trivial work.
    02
    Dedicated, clean context
    Each skill runs in its own isolated context window — no foreign tool definitions, no unrelated system prompts, no accumulated conversation pollution. Attention stays where it belongs.
    03
    Zero-authority security
    Skills produce structured text, not actions. With no tool access, even a successful prompt injection is reduced from system compromise to advisory-level manipulation — behind the agent's own decision layer.
    The thesis: The future of AI systems is not larger context windows, but deeper compositional execution graphs — replacing context-centric reasoning with composition-centric execution, monolithic models with right-sized execution, and security risk with sandboxed isolation.
    Contents
    Part ICloud-Native Skill as a Service
    · Existing skill-system pain points
    · The InferX Skill Function model
    · Comparison: Claude Skills, MCP, RAG
    · Use cases: navigation RAG & parallel orchestration
    · ROI: the economic value
    Part IIRight Model for Right Skill
    · Why agents can't choose the right model
    · The solution & lifecycle
    · Worked example: email summarization
    Part IIIReasoning Beyond the Context Window
    · Why context windows limit reasoning
    · The traditional fixes
    · The InferX solution — sub-skill calls
    · Real example — large document analysis
    · Beyond bigger contexts
    Part IVZero-Authority Reasoning — Security Architecture
    · Local skills & the trust-boundary problem
    · Why existing mitigations fail
    · Secure-by-design architecture
    Part I

    Cloud-Native Skill as a Service

    Rethinking AI skills from the ground up: move each skill to the cloud as an independent, callable service with its own context, its own model, and a clean input.

    1

    Existing skill-system pain points

    Claude Skills emerged in late 2025 as a lightweight way to extend AI capabilities. Instead of hardcoding every instruction into a system prompt, developers write a SKILL.md file — plain Markdown with structured frontmatter — that the agent reads and follows when relevant. The architecture is elegantly simple: a skill sits as a folder on disk, the agent discovers it through metadata, and loads the full content only when needed.

    It gave AI a long-term memory for procedures, reduced repetitive prompting, and spawned a rich ecosystem of community-shared skills. But the same simplicity that made Skills popular also created four structural pain points.

    High cost — the monolithic model tax
    A single flagship model handles everything, from "check the weather" to complex reasoning. Worse, ~80% of context is consumed by tool definitions, system prompts, and history — not the user's task — driving severe "lost in the middle" attention degradation.
    Security risk
    Local skills run with full system privileges — shell commands, arbitrary file reads, config changes, network egress. A single malicious or injected skill can exfiltrate SSH keys, access cloud credentials, or delete data.
    Descriptive bottleneck
    A skill's file size and references are bound by the execution workspace's token capacity. Complex workflows, decision trees, edge cases, and deep domain knowledge cannot fit into one skill.
    Performance degradation
    Conversation history accumulates turn after turn. The model drowns in its own past, scrambling to find relevant information amid the noise. Attention scatters, response times climb, accuracy drops.
    2

    The InferX Skill Function model

    Instead of running skills inside the agent's crowded, polluted context window, Skill Function moves each skill to the cloud as an independent, callable service. Each skill has its own dedicated context, its own optimized model, and a clean input — just the user request plus a minimal history summary. Skills call other skills like functions. And because a Skill Function has no direct tool-calling ability, it cannot access local files, invoke shell commands, or exfiltrate data.

    Right model for the right skill
    Every Skill Function is bound to a pre-selected model chosen by its author. A simple classification skill uses a cheap 7B model; a complex code-review skill uses a powerful 70B model.
    Dedicated model context
    Each Skill Function handles one user task at a time. Its input is the user's request plus a short summary of relevant history — no unrelated conversation, no foreign tool definitions, no system prompts from other tasks.
    Skills call other skills
    When a workflow becomes too complex for a single skill, the author splits it into sub-skills, each handling one piece, and the main skill orchestrates them — just like function calls in software.
    No external tool calling — a zero-trust sandbox
    A Skill Function is a pure knowledge skill. It cannot call tools directly — no curl, no bash, no local file access, no network egress. A malicious Skill Function cannot reach into your local environment.
    Discovery via MCP tool call
    Skill Function exposes a standard MCP tool-calling interface. When a user subscribes to a cloud skill, it automatically appears in their local agent through MCP tool discovery — no files to download, no local deployment.
    3

    Comparison: Claude Skills, MCP, RAG

    DimensionClaude SkillsMCP Tool CallingTraditional RAGSkill Function
    Execution contextShared windowShared windowShared windowDedicated, isolated
    Model selectionAgent flagshipAgent flagshipAgent flagshipPer-skill, author-bound
    CompositionProgressive disclosureAgent-mediatedNoneSkill-to-skill calls
    Tool accessFull localFull localn/aNone (sandboxed)
    Scales beyond 1 windowNoNoNoYes
    The distinction: RAG is knowledge retrieved into context. Skill Function is intelligence executed outside context — complex knowledge decomposed into a directed graph of self-contained, callable skill functions.
    4

    Use cases

    Skill Function enables two compositional patterns that are impossible with single-window skills: navigation-based RAG and parallel aggregation.

    4.1 Navigation-based RAG (index + sub-skills)

    A large document is split into logical sections, each section becomes a standalone sub-skill holding its full text, and an index skill holds only the summaries. The index skill operates as a deterministic routing policy over abstract skill signatures — not a raw semantic vector lookup.

    Example: A 500-page technical manual split into 20 section sub-skills. A user asks about a specific error code. The index skill checks its summaries, identifies the two relevant sections, calls them, and synthesizes the answer — without loading the other 18 sections.
    4.2 Parallel orchestrator (orchestrator + specialists)

    An orchestrator skill accepts a high-level request, invokes multiple specialist skills in parallel — each in its own isolated context — and aggregates the results into a cohesive response.

    Example: "We're launching a skincare product for Gen Z. Give me advertising strategy and pricing recommendations." The orchestrator calls ad-strategy and pricing-model in parallel, each with its own model and context, then combines their outputs. The agent's context never fills with intermediate results.
    5

    ROI: the economic value

    Skill Function reduces inference cost by 70–90% through three independent mechanisms, depending on workload composition and model-allocation strategy.

    Lever 1
    Right-sized models
    Match capability to task complexity
    Lever 2
    Clean context
    Cut tool defs, prompts, stale history
    Lever 3
    Efficient orchestration
    Parallel skills, not sequential calls
    Task typeTraditional modelSkill Function modelEst. savings
    Simple classificationGPT-4o / Claude Opus7B–9B dense OSS95–99%
    Data extractionGPT-4o / Claude Opus14B–35B MoE OSS80–90%
    Code generationGPT-4o / Claude Opus35B–70B MoE OSS60–80%
    Complex reasoningGPT-4o / Claude OpusSame tier0%
    Saving mechanismEstimated reduction
    Right-sized models70–90% of model cost
    Clean context90–95% of token volume
    Parallel orchestration50–80% of round trips
    Total70–90% total cost reduction
    Part I Conclusion: Skill Function is not an incremental improvement. It is a re-architecting of how AI agents acquire, share, and execute procedural knowledge — replacing context-centric reasoning with composition-centric execution, monolithic models with right-sized execution, and security risk with sandboxed isolation.
    Part II

    Right Model for Right Skill

    Stop using flagship models to 'summarize routine emails.' The author binds the model. The runtime executes it. The user never chooses.

    6

    Why existing agents can't choose the right model

    When you configure an agent (Claude Code, Cursor, and the like), you specify one primary model — the biggest, most expensive available. The model that chooses the skill is the model that runs the skill. This creates an inescapable coupling.

    Problem 1 — users don't know which model is "good enough"
    User questionWhy it's hard to answer
    Will a 7B model summarize my email correctly?Depends on length, language, required detail
    Is 14B enough for this contract extraction?Depends on contract complexity, legal terminology
    Can a 35B model handle my meeting transcript?Depends on length, number of speakers
    Problem 2 — per-task switching is impractical
    ObstacleDescription
    No runtime switchingThe primary model is global config. To change it you stop the agent, reconfigure, restart — losing all conversation context.
    Per-task switching impossibleOne conversation may contain both simple emails and complex transcripts. The agent cannot use 7B for one message and 70B for the next.
    Batch jobs have no interfaceFor scheduled reports and CI/CD pipelines there is no "user" to switch models. The system must decide automatically — or not at all.
    The bottom line: "Let the user choose" is not a solution — it shifts the burden from the system to a user not equipped to bear it. Skill Function solves all three failures by letting the author declare the model requirement once, and letting the system execute it every time.
    7

    The solution — the author binds the model

    Skill Function decouples the routing model from the execution model. When an author publishes a skill, they declare which model it runs on. The agent uses its own model only to select the skill; the skill then executes on its author-bound model, in its own isolated context. The user makes no model decision at all.

    They built and tested the skill
    The author knows from real evaluation which model tier produces correct results — not a guess, a measured floor.
    They know the task's true complexity
    Summarization, extraction, reasoning — each has a real capability requirement the author has already characterized.
    They optimize cost and quality together
    The author picks the smallest model that still passes their quality bar, so every caller inherits an already-tuned cost profile.
    They can ship custom models
    Fine-tuned or specialized endpoints can be bound to the skill and exposed to every caller without local setup.
    8

    Worked example — email summarization

    A knowledge worker receives two types of email daily: simple ones and complex ones. Using one flagship model for both is expensive waste. The Skill Function architecture comprises one orchestrator skill and two specialized execution sub-skills.

    SkillModelWhen used
    Email orchestrator3BAnalyzes email length and complexity, routes to the correct sub-skill
    Simple email summarizer7BShort emails, routine updates
    Complex email summarizer70BLong emails, multiple topics, requires deep understanding
    Part II Conclusion — The ROI: You don't need a flagship model to summarize a routine email. You need the right model for the right task — 70–90% lower inference cost with no quality loss. The user never chooses, the author binds, the runtime executes.

    Cost pays the bills. Consistency builds the business. Precision protects your outcomes.
    Part III

    Reasoning Beyond the Context Window

    How sub-skill calls enable compositional AI systems. The context window has long been the fundamental constraint of LLM systems. Skill Functions break the assumption that reasoning must happen inside one bounded workspace.

    9

    Why context windows limit reasoning

    A context window is more than a memory limit — it is the workspace where an LLM performs reasoning. Every piece of information required for a task must be present in that workspace at the same time.

    Consider analyzing a large codebase, a collection of documents, or a multi-step business workflow. The relevant information may be far larger than a single context window. Agents typically respond by truncating history, summarizing earlier content, or retrieving only selected fragments.

    The failure modes: Every tool call, observation, plan, and result competes for space in the same window. As context grows, reasoning quality degrades because important details are omitted, compressed, or buried — the well-known "Lost in the Middle" and "Needle in a Haystack" failures.
    10

    The traditional fixes — sliding window & summarization

    Sliding window
    Keeps only the most recent information in context, discarding older content as new information arrives.
    Summarization
    Compresses previous interactions into a shorter representation — preserving more history at the cost of detail and fidelity.

    More advanced systems introduce subagents. This improves organization and allows work to proceed in parallel, but each subagent still reasons within a fixed-size context window. The context window remains the fundamental unit of reasoning.

    11

    The InferX solution — sub-skill calls

    InferX Skill Functions apply a principle familiar in software engineering: when a function becomes too large, it is decomposed into smaller, specialized functions. Instead of scaling one window, InferX decomposes reasoning into a hierarchy of skills, each a unit of expertise that can invoke other skills when specialized capabilities are required.

    Clean sub-skill context
    Each sub-skill operates in its own isolated context and receives only what it needs: a context summary plus a work request, rather than the full conversation history. This mirrors human collaboration — when delegating work, we provide a concise briefing, not the entire discussion history.
    Clean parent skill context
    The parent does not consume the sub-skill's internal reasoning trace — only its final output, without exposure to intermediate steps. This prevents low-level reasoning noise from contaminating higher-level context and keeps the parent focused on synthesis and decision-making.
    12

    Real example — large document analysis

    Consider a 200-page technical document that needs deep analysis: extracting structure, identifying risks, summarizing key insights, and answering user questions.

    TRADITIONAL — TOKEN DUMP
    200-page document
    ↓ chunking / retrieval
    ↓ single context window
    ↓ LLM reasoning

    Relevant information competes with irrelevant in the same attention space; reasoning quality degrades as scale grows.
    SKILL FUNCTION — SKILL GRAPH
    DocumentAnalysis
    ├─ StructureExtraction
    ├─ RiskAnalysis
    │  ├─ FinancialRisks
    │  └─ ComplianceRisks
    └─ FinalSynthesis
    13

    Beyond bigger contexts — cleaner reasoning

    With Skill Functions, reasoning changes in two important ways. First, it becomes multi-round, compositional knowledge ingestion — each skill call introduces a new, focused context where additional information can be retrieved, processed, and transformed into structured outputs.

    Second, it changes how AI systems consume knowledge. Traditional AI relies on training-time knowledge and context-time knowledge. Skill Functions significantly expand the second category — because each skill call creates a new reasoning context, the system can continuously incorporate external knowledge across multiple stages of execution.

    Conclusion — Reasoning Beyond the Context Window: Skill Functions break the assumption that reasoning happens inside one bounded workspace. We are no longer constrained by how much information fits into a single window, but by how well we structure reasoning into reusable, well-defined skills. Intelligence shifts from memory scale to system design.
    Part IV

    Zero-Authority Reasoning

    The Skill Function Security Architecture. Local skills run inside your trust boundary — reading files, invoking shells, accessing credentials. Skill Function removes execution authority from the skill entirely.

    26.1%
    of 31,132 public skills have ≥1 vulnerability
    2.12×
    more vulns when skills bundle scripts
    → 0
    tool access inside the skill runtime
    14

    Local skills and the trust-boundary problem

    In most agent systems, a skill is installed locally and exposed to the agent as part of its execution environment. The skill's instructions, prompts, workflows, and tool definitions are loaded into the agent's context, where the model can read them and decide when to invoke associated tools — file systems, browsers, databases, email systems, cloud APIs, and other privileged resources available to the user.

    The root cause: The agent cannot perfectly distinguish trusted instructions, untrusted user input, retrieved content, and third-party skill logic — because all of them are processed within the same model context. A malicious skill, a compromised dependency, or a prompt injection hidden inside external content can influence the model's behavior and trigger actions involving privileged tools.
    15

    Why existing mitigations fail

    Many agent frameworks have introduced security controls — sandboxing, prompt hardening, permission prompts, static scanning, tool allow-lists, human approval. These reduce risk and make attacks harder, but they don't address the fundamental problem: the skill still executes inside the user's trust boundary.

    MitigationWhy it falls short
    SandboxingMay restrict some operations, but the skill continues to influence the agent's decision-making process.
    Permission promptsBlock certain actions, but rely on users correctly identifying malicious behavior.
    Static analysisDetects known patterns, but cannot predict how a model behaves with arbitrary prompts, tools, and content.
    Prompt hardeningMakes instructions harder to override, yet injection remains effective because the model must process trusted and untrusted inputs in one context.
    The evidence: Recent guardian-based defenses reduce attack success rates from 81.4% to 18.6% — but this still leaves measurable residual risk, and static guardians cannot adapt to novel variants. Mitigating, rather than eliminating, the root cause is insufficient.
    16

    Skill Function — a secure-by-design architecture

    Skill Function implements reasoning–execution separation by moving untrusted skill logic out of the user's trust boundary and into a controlled cloud environment. Each skill executes in a remote, isolated sandbox: it receives input through a standard MCP interface and returns structured outputs, but has no access to local files, system resources, shell commands, or user-owned tools.

    LOCAL SKILL — LARGE ATTACK SURFACE
    ⚠ Direct file / shell / API access
    ⚠ Injection → tool calls execute
    ⚠ Single injection → system compromise
    SKILL FUNCTION — CONTAINED
    ✓ No local tools, no system access
    ✓ Injection → only affects output text
    ✓ Agent decision layer gates all actions
    Why the attack is contained
    ·Skills have no direct access to local tools or system resources.
    ·Skills operate in a stateless, isolated execution environment.
    ·Tool invocation is fully owned by the agent runtime, not the skill.
    ·Outputs are treated as untrusted suggestions, not executable commands.
    C → 0
    Capabilities
    Third-party skills reduced to zero — no local execution, no privileged tools.
    A
    Autonomy
    Preserved for user approval at the decision layer.
    P
    Permissions
    Enforced at the platform boundary, least-privilege.
    The enterprise outcome: Enterprises no longer need to fully trust every skill they install. They only need to trust the platform's execution and policy layer. Security transforms from a distributed, fragile responsibility across every skill implementation into a single, enforceable system-level boundary.
    Get in touch

    Questions about Skill Function?

    We'd welcome a conversation about cloud-native Skill-as-a-Service, right-sized model execution, and zero-authority security for enterprise agent deployments.

    Brad Sun
    brad.sun@inferx.net
    Prashanth
    prashanth@inferx.net