Project · Public

LLM Testing

By @nobilitybeyond

Test LLMs for FolioProjects

Sign in to follow
Created
Jan 6, 2024
Budget
$25,000.00
Location
Remote
Share, broadcast and print
Open broadcast feed

Sustainability initiatives

No sustainability initiatives classified yet.

Public Broadcast · screens & websites

Shows only publicly available records. Private records are excluded, even when you are signed in.

Launch Broadcast ↗

About this project

Test multiple LLMs for utilization within FolioProjects. Include the following in the test: Claude 2 by Anthropic, Llama 2 by Meta, Chat GPT by Open AI, and Mistral 7b by Mistral AI.

Test the models for a range of skills including useful answers and predictions. Have the developers document the cost and time each model takes for generation, separate to user billing.

Introduce Reinforcement learning from human feedback (RLHF) as part of the interface rollout. This will also form our second phase of testing which will be long term user engagement monitoring.

HueFlux feedback

Recorded project feedback. These responses do not establish property condition or represent the whole community.

No feedback yet

Share your view using the controls below.

Positive feedback
Negative feedback

Project polls

Answer specific questions about this project and view the results the owner chooses to share.

View project polls

Poll answers are measured separately from HueFlux feedback.

References

Twitter ↗

Focus areas

Comments

New comments are public while this project is public. Earlier members-only comments remain restricted.

Sign in to comment.

No comments on this page.