Check manifest builder failure rate (last 100 requests)
Validates
Confirms overall manifest builder health. High failure rates indicate Haiku API issues or JSON generation problems. High skip rates are informational.
Assertion Value
Success rate
Expected Output
Output shows total, failed, skipped counts and a success rate. Healthy: failed=0 or very low. Skipped count expected for clarification turns and channel_override_none channels.
Script
mongosh "mongodb://jmashore:P3anu%[email protected]:27017/" --eval 'db = db.getSiblingDB("zoey"); var total = db.zoey_detail_log.countDocuments({"steps.manifest_builder": {$exists:true}}); var failed = db.zoey_detail_log.countDocuments({"steps.manifest_builder.error": {$ne:null}}); var skipped = db.zoey_detail_log.countDocuments({"steps.manifest_builder.skipped": true}); print("Total with manifest step: " + total + ", Failed: " + failed + ", Skipped: " + skipped + ", Success rate: " + ((total - failed - skipped) / total * 100).toFixed(1) + "%")' --quiet
Run Tool
Run History
No runs yet