How do I set up a credit group?

Estimating Token Usage   Using Your Credit Group  

Establishing a Dartmouth Chat Credit Group  

When using the cloud models, a daily token limit is enforced. Each model has a different token “price” associated with its use. The relative expense is indicated in the model selector by dollar signs ($) - i.e., the more dollar signs, the more expensive the tokens and the faster you will hit the daily limit.

These token limits are expressed as credits, shown in the upper right-hand corner in the credit counter. There is a daily credit limit of 2,000 credits.

If you find that you and your team need additional credits you can request that a Credit Group be established. This will allow you and other members of the Dartmouth community (we do not allow external collaborators at this time unless they have a Sponsored Account) to purchase additional credits.

To purchase additional credits please fill out this form. You will need to provide a brief description of your Credit Group, as well as the NetIDs or email addresses of group members.

This provides you (and your team, if applicable) a monthly budget of credits. At the end of the month you will only be billed for the credits you use. This budget will reset on a monthly basis up to the end date you provided in the form.

Estimating Token Usage  

Token cost per provider varies and links for each provider are listed below.

To help estimate token usage (and thus establish your working budget), you can use the Dartmouth Tokenizer. Using this tool, you can choose a model, construct potential prompts, and get immediate (and free!) feedback about relative cost.

Dartmouth Tokenizer Screenshot

Using Your Credit Group  

Once your Credit Group has been established, you will be issued a “Virtual Key” that you can use in Dartmouth Chat to draw upon your new credit allowance.

In Dartmouth Chat setup a connection to the Credit Group as follows:

  • Click your Profile in the upper right-hand or lower left-hand corner and go to Settings -> Connections

  • Fill in the following fields

URL: https://llm-proxy.dartmouth.edu
Key: YOUR VIRTUAL KEY GOES HERE
Prefix ID: ENTER A 3 TO 6 CHARACTER PREFIX THAT DESCRIBES YOUR CREDIT GROUP

  • Click Save on The Edit Connection Window and then Save again on the Settings Window.

  • In the Model Selection you will now see a “Direct” Filter for your Credit Group’s Model. Select one of these models and you will notice your Credit Group allowance in the upper-right hand corner.

credit group

Didn’t find what you needed? Please reach out to research.computing@dartmouth.edu.

On this page: