Agent in a Bottle: Can LLM Agents Turn Their Capabilities into Cheap Artifacts?