corpus.blog
41,715 blogs · 5,239,565 posts Claim your blog
Record · corpus.blog/posts/01a08c5a-c939-712a-bb00-4fe8c319f431

Serverless AI Inference with Gemma 2 using Mozilla's llamafile on AWS Lambda

unremarkable.ai · published 6 July 2024

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at unremarkable.ai Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
External links
32
Words captured
1,501

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://blog.google/technology/developers/google-gemma-2/?ref=unremarkable.ai
blog.google
https://www.youtube.com/watch?v=mjTIm7DH_eE&ref=unremarkable.ai
youtube.com
https://huggingface.co/google/gemma-2-9b?ref=unremarkable.ai
huggingface.co
https://www.reddit.com/r/LocalLLaMA/comments/1drxhlh/gemma_2_9b_appreciation_post/?ref=unremarkable.ai
reddit.com
http://llamafile.ai/?ref=unremarkable.ai
llamafile.ai
https://justine.lol/index.html?ref=unremarkable.ai
justine.lol
https://github.com/ggerganov/llama.cpp?ref=unremarkable.ai
github.com
https://cosmo.zip/?ref=unremarkable.ai
cosmo.zip
https://huggingface.co/Mozilla/llava-v1.5-7b-llamafile/tree/main?ref=unremarkable.ai
huggingface.co
https://huggingface.co/Mozilla/Mistral-7B-Instruct-v0.2-llamafile/tree/main?ref=unremarkable.ai
huggingface.co
https://huggingface.co/Mozilla/Phi-3-mini-4k-instruct-llamafile/tree/main?ref=unremarkable.ai
huggingface.co
https://t.co/gq4bWFlgmS?ref=unremarkable.ai
t.co
https://twitter.com/JustineTunney/status/1808165898743878108?ref_src=twsrc%5Etfw&ref=unremarkable.ai
twitter.com
https://x.com/StabilityAI/status/1809274908641489160?ref=unremarkable.ai
x.com
https://adithyask.medium.com/deploy-mistral-llama-7b-on-aws-in-10-mins-cc80e88d13f2?ref=unremarkable.ai
adithyask.medium.com
https://arxiv.org/abs/2106.09685?ref=unremarkable.ai
arxiv.org
https://docs.aws.amazon.com/serverless-application-model/latest/developerguide/install-sam-cli.html?ref=unremarkable.ai
docs.aws.amazon.com
https://aws.amazon.com/blogs/aws/announcing-aws-lambda-function-urls-built-in-https-endpoints-for-single-function-microservices/?ref=unremarkable.ai
aws.amazon.com
https://github.com/Mozilla-Ocho/llamafile?tab=readme-ov-file&ref=unremarkable.ai
github.com
https://github.com/awslabs/aws-lambda-web-adapter?ref=unremarkable.ai
github.com
https://aws.amazon.com/blogs/aws/aws-lambda-functions-powered-by-aws-graviton2-processor-run-your-functions-on-arm-and-get-up-to-34-better-price-performance/?ref=unremarkable.ai
aws.amazon.com
https://aws.amazon.com/about-aws/whats-new/2020/12/aws-lambda-supports-10gb-memory-6-vcpu-cores-lambda-functions/?ref=unremarkable.ai
aws.amazon.com
https://docs.aws.amazon.com/lambda/latest/dg/images-create.html?ref=unremarkable.ai
docs.aws.amazon.com
https://github.com/metaskills/llamafile-on-lambda?ref=unremarkable.ai
github.com
https://github.com/metaskills/llamafile-on-lambda/blob/main/variables.sh?ref=unremarkable.ai
github.com
https://www.npmjs.com/package/inquirer?ref=unremarkable.ai
npmjs.com
https://docs.aws.amazon.com/lambda/latest/dg/runtimes-extensions-api.html?ref=unremarkable.ai
docs.aws.amazon.com
https://github.com/metaskills/llamafile-on-lambda/commit/7af2398f7b0f2e8efab5eab88aae2c5c38ad9201?ref=unremarkable.ai
github.com
https://github.com/Mozilla-Ocho/llamafile/issues/485?ref=unremarkable.ai
github.com
https://huggingface.co/jartine/gemma-2-9b-it-llamafile/tree/main?ref=unremarkable.ai
huggingface.co
https://www.linkedin.com/in/metaskills/?ref=unremarkable.ai
linkedin.com
https://x.com/metaskills?ref=unremarkable.ai
x.com
Elsewhere on unremarkable.ai (2)