Skip to content

investigate how to add an input token limit for text results from tools #47

@BBBmau

Description

@BBBmau

models have a cost for both input tokens and output tokens where input tokens are what get used up the most due to massive amounts of documentation from our tools depending on the type module/resource. There should be a limit for how much our MCP server produces in terms of tokens.

Which should consider either having this be a resource by resource option or a general MCP server option that's set as one of our parameters.

When the limit is set it will only output the created content upto the set limit + an error for the model to use to indicate to the user that the token limit was reached on this prompt.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions