2
edits
Changes
→Proposed Purchases
<b> API SERVICES </b>
If we set up a rig we can get google one and openai accounts so we can set up our own agents to do activites for the benefit of society. This might be against everything we stand for.
* $20/month rate limit Openai api
** The comparable local model would be at minimum llama 3.2 11B (about as good as chatgpt 4o on everything but logically stepping through problems) (logic can be improved with prompting techniques consisting of long prompts since context length doesn't matter anymore). We need at least a 24gb of VRAM (we'd be using about 22gb of it a long prompt will push it over)
** https://openai.com/api/pricing/
* $20/month Google One with Gemini subscription
** We get 2TB of storage and access to the web app for Gemini Pro. Currently the api is free at 10req/min (not enough for things you'd use an api for)
** https://one.google.com/about/?g1_landing_page=0
[[Category:Infrastructure]] [[Category:VTLUUG:Projects]]