Audit Codex MCP tests: identify workarounds hiding bugs

Browse Source

WHAT:
- Ran full server test suite (13/13 MCP tests pass)
- Identified 2 workarounds in codex-mcp-agent.test.ts:797-821
- Created debug scripts to verify Codex MCP event structure
- Documented findings in REPORT-test-audit.md

FINDINGS:
1. "Codex doesn't expose read_file" - FALSE. File reads are exposed
   via exec_command_begin/end with parsed_cmd[].type === "read"
2. "web_search doesn't return results" - FALSE. Results are exposed
   via mcp_tool_call_end with result.Ok.content[]

EVIDENCE:
- scripts/codex-file-read-debug.ts proves file read events exist
- scripts/codex-websearch-debug.ts proves search results exist

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

...

This commit is contained in:

Mohamed Boudra

2025-12-25 14:53:51 +07:00

co-authored by Claude Opus 4.5

parent 28514f5b76

commit 30af3ffd1a

3 changed files with 3455 additions and 0 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

test-audit.txt

+3226

File diff suppressed because it is too large Load Diff