* test(tools): add shim protection test for tool_implementations split
Covers all 48 top-level functions (33 do_* + 15 _helpers) extracted from
the original module. Guards the upcoming split: the shim must re-export
every symbol so existing 'from src.tool_implementations import X' imports
keep working. Passes on baseline (pre-split).
* refactor(tools): add src/tools/ package with shared _common
Slice 1 Task 2 (#4082/#4071). Adds the package skeleton and moves the
shared _parse_tool_args helper into src/tools/_common.py. Domain modules
will import from here. tool_implementations.py is untouched at this step.
* refactor(tools): extract system domain into src/tools/system.py
Slice 1 (#4082/#4071), Task 3: move the system-domain tool functions
(do_manage_skills/_skill_dump/do_manage_tasks/do_manage_endpoints/
do_manage_mcp/do_manage_webhooks/do_manage_tokens/do_manage_settings/
do_api_call/do_app_api) and the app_api blocklist constants out of
tool_implementations.py into a new src/tools/system.py module.
tool_implementations.py re-imports all of them so it stays a working
backward-compatible facade (shim test stays green).
- do_manage_mcp resolves get_mcp_manager via a function-local import
from tool_implementations so the test that patches
src.tool_implementations.get_mcp_manager still applies post-move.
- do_app_api imports _internal_headers and _INTERNAL_BASE (still in
tool_implementations) function-locally to avoid a circular import.
- Repoint test_context_budget introspection assertion to the moved
code's new home in src/tools/system.py.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* refactor(tools): extract cookbook domain into src/tools/cookbook.py
Moves the model-serving (cookbook) tool domain out of tool_implementations.py
into src/tools/cookbook.py as part of slice 1 (#4082/#4071):
- 13 do_* tools: download/serve/list/stop/tail/search/adopt/cached models,
list downloads/cancel, list cookbook servers, serve presets
- 9 private helpers: _cookbook_servers, _resolve_cookbook_host,
_cookbook_env_for_host, _infer_serve_{port,host}, _ensure_served_endpoint,
_cookbook_register_task, _cookbook_apply_retry_suggestion,
_scan_running_model_processes, _cookbook_kill_session
- _MODEL_PROCESS_PATTERNS constant (used only by _scan_running_model_processes)
tool_implementations.py stays a backward-compatible facade via a re-import
from src.tools.cookbook; src/tools/__init__ re-exports the same symbols.
_internal_headers and _INTERNAL_BASE stay in tool_implementations.py (shared
by system.py's do_app_api and many cookbook funcs). Each cookbook function
that needs them does a function-local import to avoid a top-level circular
dependency, matching the system-domain split.
Verified: compileall clean; shim test green; cookbook-touching suite
(652 passed, 1 skipped); full suite 3587 passed, 2 failed
(pre-existing test_api_chat_security, unrelated).
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* refactor(tools): extract search domain into src/tools/search.py
* refactor(tools): extract notes domain into src/tools/notes.py
* refactor(tools): extract calendar domain into src/tools/calendar.py
Repoints tests/test_caldav_bidirectional_sync.py source-introspection
to src/tools/calendar.py (do_manage_calendar moved there).
* refactor(tools): extract image domain into src/tools/image.py
* refactor(tools): extract research domain into src/tools/research.py
* refactor(tools): extract contacts domain into src/tools/contacts.py
* refactor(tools): extract vault domain into src/tools/vault.py
Repoints tests/test_vault_password_not_in_argv.py source-introspection
to src/tools/vault.py (the vault do_* helpers moved there).
* refactor(tools): collapse tool_implementations to clean re-export shim
Move shared _INTERNAL_BASE/_internal_headers to src/tools/_common.py and
drop the duplicate _parse_tool_args (already in _common). tool_implementations.py
is now a pure re-export facade (+ 3 pre-existing email-context helpers, out of
scope). Domain files' function-local imports of these names still resolve via
the facade re-export.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* fix(tools): port upstream cookbook workflow changes to split module
Rebase onto dev dropped c504214 ("Cookbook model workflow fixes") edits
to do_serve_model / do_tail_serve_output: the extraction commit moved
the pre-edit bodies into src/tools/cookbook.py and git auto-accepted the
deletion from tool_implementations.py, losing dev's changes. Restore them
in their post-split home:
- do_serve_model: add where/log_path/next_tools and the expanded
"Next required check" output message
- do_tail_serve_output: empty-output fallback message replacing
"(empty pane)"
(do_manage_settings web_fetch alias edit was already applied to
src/tools/system.py during the system-extract conflict resolution.)
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* fix(tools): break admin_tools circular import in split facade
After rebasing onto dev (#3629 moved the admin manage_* tools into
src/agent_tools/admin_tools), the facade re-exported them via a top-level
`from src.agent_tools.admin_tools import ...`. But src.agent_tools.__init__
imports this facade at top level, so the eager import re-entered the
partially-initialized agent_tools package and broke collection.
Re-export the admin symbols (do_manage_endpoints/mcp/webhooks/tokens/
settings, _MCP_DENIED_COMMANDS, _validate_mcp_command) lazily through
module __getattr__ instead, and drop them from src/tools/__init__ (they
no longer live in the src.tools package). system.py now holds only the
skills/tasks/api bridges; admin tools live solely in admin_tools.py,
matching upstream.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* fix(tools): re-export dropped helpers through the split shim
Address review finding from #4423: the compatibility facade claimed to
preserve every original top-level symbol but omitted three helpers the
old src.tool_implementations exposed. Re-export them and pin them in
the shim protection test:
- _string_arg, _validate_cookbook_ssh_target <- src/tools/cookbook.py
- _mcp_allowed_commands <- src/agent_tools/admin_tools.py (lazily via
__getattr__, to keep the agent_tools.__init__ <-> facade import acyclic
after the #3629 admin-tools migration)
All three added to tests/test_tool_implementations_shim.py _EXPECTED so
the test contract now matches its "every original top-level function"
comment.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* test(tools): self-verify shim re-exports every domain do_*
The hand-maintained _EXPECTED list in the shim protection test can drift
silently when a new tool is added to a domain module but not re-exported
by the facade — exactly the omission a reviewer flagged post-split.
Add an auto-discovering test that enumerates every do_* from the domain
modules (incl. admin_tools) and asserts reachability through the shim,
so a forgotten re-export fails the build automatically.
Uses hasattr (not dir(ti)) because the admin symbols are re-exported
lazily via module __getattr__ and don't appear in dir(ti).
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* test(tools): self-verify every in-repo facade import resolves
RaresKeY's P3 on the shim test was a claim-vs-reality gap: the docstring
said it protected "every from src.tool_implementations import X" but the
hand-maintained _EXPECTED list omitted three underscore helpers, so the
claim wasn't enforced. Re-exporting the three (cf1f5e3) fixed the known
gap; this closes the structural one.
Add test_every_facade_import_in_repo_resolves: ast-enumerate every
`from src.tool_implementations import X` site in src/ and tests/ and
assert hasattr(ti, X) for each. A forgotten re-export that anything in
the repo imports now fails the build automatically — including underscore
helpers, which the do_* discovery test does not cover.
Together with test_shim_reexports_every_domain_do_function, the shim
contract is now self-verifying. Demote _EXPECTED in the docstring to the
curated historical/downstream surface (the three helpers have no in-repo
consumer, so they stay manual by necessity) instead of "ground truth".
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* fix(tools): dedupe _parse_tool_args + align shim guard with route consumers
Addresses two P3s from review (RaresKeY, 2026-06-26):
1. maintainability — _common carried a full copy of _parse_tool_args
alongside the canonical src.tool_utils one; future parser fixes could
diverge. The two bodies were byte-identical in logic, so _common now
re-exports from tool_utils (a leaf module, no circular-import risk).
The single-source test is extended to assert _common._parse_tool_args
and tool_implementations._parse_tool_args are the same object as
tool_utils._parse_tool_args.
2. test — the shim guard's import-site scan only walked src/ and tests/,
missing routes/chat_routes.py's clear_active_email/set_active_email
imports, and _EXPECTED omitted the active-email facade helpers. The
scan now walks every first-party Python dir (pruning venvs/caches/data
in-place), and set/get/clear_active_email are added to _EXPECTED
(get_active_email has no in-repo importer, so the scan alone can't see
it).
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
---------
Co-authored-by: yuandonghao <yuandonghao@cohl.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
113 lines
5.1 KiB
Python
113 lines
5.1 KiB
Python
"""
|
|
tool_implementations.py
|
|
|
|
Extracted tool implementation functions (do_* and helpers) from agent_tools.py.
|
|
These handle the actual execution logic for each tool type.
|
|
"""
|
|
|
|
import logging
|
|
from typing import Dict, Optional
|
|
|
|
from src.tool_utils import get_mcp_manager # re-exported: tests patch src.tool_implementations.get_mcp_manager
|
|
|
|
# System-domain tools were extracted to src/tools/system.py (slice 1,
|
|
# #4082/#4071); the admin manage_* tools live in src/agent_tools/admin_tools
|
|
# after the upstream registry migration (#3629). Re-imported here so this
|
|
# module stays a working facade.
|
|
from src.tools.system import ( # noqa: F401
|
|
do_manage_skills, _skill_dump, do_manage_tasks,
|
|
do_api_call, do_app_api,
|
|
_APP_API_BLOCKLIST_PREFIXES, _APP_API_BLOCKLIST_METHOD_PATH,
|
|
)
|
|
# Admin manage_* tools (endpoints/mcp/webhooks/tokens/settings) live in
|
|
# src/agent_tools/admin_tools after the upstream registry migration (#3629).
|
|
# Re-exported lazily via __getattr__: src.agent_tools.__init__ imports this
|
|
# facade at top level, so a eager `from src.agent_tools.admin_tools import`
|
|
# here would re-enter the partially-initialized agent_tools package (circular).
|
|
_ADMIN_TOOL_SYMBOLS = (
|
|
"do_manage_endpoints", "do_manage_mcp", "do_manage_webhooks",
|
|
"do_manage_tokens", "do_manage_settings",
|
|
"_MCP_DENIED_COMMANDS", "_validate_mcp_command", "_mcp_allowed_commands",
|
|
)
|
|
|
|
|
|
def __getattr__(name):
|
|
if name in _ADMIN_TOOL_SYMBOLS:
|
|
from src.agent_tools import admin_tools
|
|
return getattr(admin_tools, name)
|
|
raise AttributeError(f"module {__name__!r} has no attribute {name!r}")
|
|
# Cookbook (model serving) domain extracted to src/tools/cookbook.py
|
|
# (slice 1, #4082/#4071). Re-imported here so this module stays a working
|
|
# facade. cookbook.py pulls `_internal_headers` / `_INTERNAL_BASE` back
|
|
# function-locally from this facade (which re-exports them from _common).
|
|
from src.tools.cookbook import ( # noqa: F401
|
|
do_download_model, do_serve_model, do_list_served_models,
|
|
do_stop_served_model, do_tail_serve_output, do_list_downloads,
|
|
do_cancel_download, do_search_hf_models, do_adopt_served_model,
|
|
do_list_cookbook_servers, do_list_serve_presets, do_serve_preset,
|
|
do_list_cached_models,
|
|
_cookbook_servers, _resolve_cookbook_host, _cookbook_env_for_host,
|
|
_infer_serve_port, _infer_serve_host, _ensure_served_endpoint,
|
|
_cookbook_register_task, _cookbook_apply_retry_suggestion,
|
|
_scan_running_model_processes, _cookbook_kill_session,
|
|
_MODEL_PROCESS_PATTERNS,
|
|
_string_arg, _validate_cookbook_ssh_target,
|
|
)
|
|
# Search domain extracted to src/tools/search.py (slice 1, #4082/#4071).
|
|
# Re-imported here so this module stays a working facade.
|
|
from src.tools.search import do_search_chats # noqa: F401
|
|
# Notes domain extracted to src/tools/notes.py (slice 1, #4082/#4071).
|
|
from src.tools.notes import do_manage_notes # noqa: F401
|
|
# Calendar domain extracted to src/tools/calendar.py (slice 1, #4082/#4071).
|
|
from src.tools.calendar import do_manage_calendar # noqa: F401
|
|
# Image domain extracted to src/tools/image.py (slice 1, #4082/#4071).
|
|
from src.tools.image import do_edit_image # noqa: F401
|
|
# Research domain extracted to src/tools/research.py (slice 1, #4082/#4071).
|
|
from src.tools.research import do_manage_research, do_trigger_research # noqa: F401
|
|
# Contacts domain extracted to src/tools/contacts.py (slice 1, #4082/#4071).
|
|
from src.tools.contacts import do_resolve_contact, do_manage_contact # noqa: F401
|
|
# Vault domain extracted to src/tools/vault.py (slice 1, #4082/#4071).
|
|
from src.tools.vault import ( # noqa: F401
|
|
_load_vault_config, _run_bw,
|
|
do_vault_search, do_vault_get, do_vault_unlock,
|
|
)
|
|
# Shared helpers live in src/tools/_common.py. Re-exported here so the
|
|
# function-local `from src.tool_implementations import _INTERNAL_BASE` (and
|
|
# friends) used by domain files still resolve through this facade.
|
|
from src.tools._common import _parse_tool_args, _INTERNAL_BASE, _internal_headers # noqa: F401
|
|
|
|
logger = logging.getLogger(__name__)
|
|
|
|
# ---------------------------------------------------------------------------
|
|
# Active email state
|
|
# ---------------------------------------------------------------------------
|
|
|
|
# When the user has an email reader window open, the frontend tells the
|
|
# backend about it on each chat submit. Email tools can resolve "this email"
|
|
# without guessing a UID. Cleared between requests by chat_routes.
|
|
_active_email_ref: Optional[Dict[str, str]] = None
|
|
|
|
|
|
def set_active_email(uid: Optional[str], folder: Optional[str] = None, account: Optional[str] = None,
|
|
subject: Optional[str] = None, sender: Optional[str] = None) -> None:
|
|
"""Stash the email currently open in the UI. None clears it."""
|
|
global _active_email_ref
|
|
if not uid:
|
|
_active_email_ref = None
|
|
return
|
|
_active_email_ref = {
|
|
"uid": str(uid),
|
|
"folder": str(folder or "INBOX"),
|
|
"account": str(account or ""),
|
|
"subject": str(subject or ""),
|
|
"from": str(sender or ""),
|
|
}
|
|
|
|
|
|
def get_active_email() -> Optional[Dict[str, str]]:
|
|
return _active_email_ref
|
|
|
|
|
|
def clear_active_email() -> None:
|
|
global _active_email_ref
|
|
_active_email_ref = None
|