Cloudflare Developers•14mo ago

WorkerAI can WorkerAI fine-tune ResNet image classification?

Oourines WorkerAI can WorkerAI fine-tune ResNet image classification?

Isaac McFadyen•11/7/24, 2:11 AM

?workers-ai-models

Flare•11/7/24, 2:11 AM

Workers AI currently only supports popular open-source models provided by the Cloudflare team, as well as your own LoRAs that can be applied on top of the Cloudflare-provided models. You cannot currently upload your own models or use a model from HuggingFace. See the documentation for the list of Cloudflare-provided models: https://developers.cloudflare.com/workers-ai/models/

Isaac McFadyen•11/7/24, 2:12 AM

^ so no, not currently.

Isaac McFadyen•11/7/24, 2:12 AM

The LoRa functionality is only available for models listed here https://developers.cloudflare.com/workers-ai/fine-tunes/loras/ which doesn't include ResNet.

crazyjack12•11/10/24, 12:01 PM

Updated my Alexa Skill to integrate with a stable diffusion model via cloudflare workers AI

Checkout my post here!

https://www.linkedin.com/posts/jackmcguire1994_alexaskill-generativeart-echoshow-activity-7261344038849540096-qbtu?utm_source=share&utm_medium=member_desktop

👨🏾‍💻👩🏻‍💻👩🏽‍💻 Jack McGuire on LinkedIn: #alexaskill #generativeart #...

Sunday morning fun with Alexa, OpenAI, and Cloudflare Workers AI!

The latest update to my Alexa Skill utilises DALL-E and Stable Diffusion APIs to bring…

Ccrazyjack12 Updated my Alexa Skill to integrate with a stable diffusion model via cloudflare...

fry69•11/10/24, 12:08 PM

Just dropping a link to LI without comment or context is borderline spam IMHO @797524744156086293

Ffry69 Just dropping a link to LI without comment or context is borderline spam IMHO <@...

Josh•11/10/24, 12:08 PM

ehhh it is at least using worker ai

crazyjack12•11/10/24, 12:09 PM

I mean how else do I become a community champion

Ccrazyjack12 I mean how else do I become a community champion

Josh•11/10/24, 12:09 PM

Yep, just for future maybe write a little bit in discord and not just post a linkedin share

JJosh ehhh it is at least using worker ai

fry69•11/10/24, 12:10 PM

Yeah, sorry I saw that at a second look, but this pretty opaque with just a link

Ffry69 Yeah, sorry I saw that at a second look, but this pretty opaque with just a link

Josh•11/10/24, 12:10 PM

All good

crazyjack12•11/10/24, 12:12 PM

Added some context, apologies, worth raising

Original message was deleted

fry69•11/10/24, 5:22 PM

?crossposting -> general-helpdeploying a finetuned prediction model ( YOLO )

Flare•11/10/24, 5:22 PM

Please do not post your question in multiple channels/post it multiple times per the rules at ⁠No Access. It creates confusion for people trying to help you and doesn't get your issue or question solved any faster.

Thiago•11/10/24, 9:06 PM

I've been using

flux-1-schnell

flux-1-schnell

and

dreamshaper-8-lcm

dreamshaper-8-lcm

consistently for several days, yet my reported usage is 0. I have never seen my usage page show any actual usage. I know a while ago, Beta models weren't charged yet, but I assume this is no longer the case. Am I missing out something?

TThiago I've been using `flux-1-schnell` and `dreamshaper-8-lcm` consistently for severa...

Isaac McFadyen•11/10/24, 9:10 PM

Beta models are still not charged and don't appear in usage graphs currently.

Thiago•11/10/24, 9:28 PM

Alright, thank you!

mr.niko.la•11/11/24, 8:58 PM

Does cloudflare ai provide whisper v3 turbo ?

Puliczek•11/13/24, 12:02 PM

Does cloudflare ai plan to provide Llama-3.2-90B-Vision?

Vlady•11/18/24, 6:11 PM

Y'all, where can I make a model request? I would love to be able to use https://github.com/facebookresearch/sam2

kyle•11/19/24, 10:01 PM

I notice that the flux-1-schnell model doesn't have height/width input. does it always give a fixed output then? or is it.. like random

DDeleted User Any fix on this?

Isaac McFadyen•11/21/24, 2:36 PM

Only this for now: https://canary.discord.com/channels/595317990191398933/1105477009964027914/1301663480964972668

DCsan•11/25/24, 7:36 AM

is this a know problem? getting stuck on even running the tutorial apps:

Your worker has access to the following bindings:
- AI:
  - Name: AI

✘ [ERROR] Build failed with 1 error:

  ✘ [ERROR] Could not resolve "base64-js"

      node_modules/.pnpm/@cloudflare+ai@1.2.2/node_modules/@cloudflare/ai/dist/index.js:1:16:
        1 │ import*as e from"base64-js";import*as t from"mustache";var s;!funct...
          ╵                 ~~~~~~~~~~~

    You can mark the path "base64-js" as external to exclude it from the bundle, which will remove
  this error.

Your worker has access to the following bindings:
- AI:
  - Name: AI

✘ [ERROR] Build failed with 1 error:

  ✘ [ERROR] Could not resolve "base64-js"

      node_modules/.pnpm/@cloudflare+ai@1.2.2/node_modules/@cloudflare/ai/dist/index.js:1:16:
        1 │ import*as e from"base64-js";import*as t from"mustache";var s;!funct...
          ╵                 ~~~~~~~~~~~

    You can mark the path "base64-js" as external to exclude it from the bundle, which will remove
  this error.

DCsan•11/25/24, 7:36 AM

"@cloudflare/ai": "^1.2.2",

"@cloudflare/ai": "^1.2.2",

Sam•11/28/24, 7:27 PM

Hey, I am on the cloudflare startups program. Can I just check there aren't any specific limits or terms on credit usage with Cloudflare AI? Also are any of the llama larger models likely to be added soon for example 90b vision?

FFokke Figured this one out, turns out someone made a neat library that can extract tex...

NeilBee•12/6/24, 4:13 PM

Have you got something working with Langchain and successfully deployed to workers? I was running into all kinds of problems with dependencies that aren't supported. I switched my PDFLoader to use unpdf but it still gives me dependency issues. I'm beginning to think that Langchain just does not work on workers. I'm having to exclude all kinds of things from the build.

EDIT - Finally found something that tied everything together for me...

https://www.reddit.com/r/CloudFlare/comments/1d8cnr0/using_langchain_on_cloudflare/

From the CloudFlare community on Reddit: Using LangChain on Cloudflare

Explore this post and more from the CloudFlare community

Maximilian Quindinkus•12/6/24, 5:26 PM

Hey all, so I have been trying to use different multi-agent frameworks in cloudflare because their AI platform is amazing, but I'm not able to use the big ones such as CrewAI or AutoGen. I want to basically use cloudflare's access to their amazing LLM models because it's such an easy integration done in cloudflare, but I want to deploy/run all my code somehwere else. Does anyone have any experience doing this?

MMaximilian Quindinkus Hey all, so I have been trying to use different multi-agent frameworks in cloudf...

Derpenstein69•12/7/24, 4:26 AM

Langchain and Vercel Ai Sdk have adapters for cloudflare that i am aware of

JOEY•12/8/24, 8:46 PM

what kind of error is this?

JOEY•12/8/24, 8:46 PM

anyone have any idea ? i'm new to AI and cloudflare as well

DDCsan is this a know problem? getting stuck on even running the tutorial apps: ``` Yo...

JOEY•12/8/24, 8:47 PM

hey mate this is the same error i got stuck with @DCsan how did it resolved?

Erisa•12/9/24, 11:40 AM

the answer is directly underneath the message you replied to

JJOEY hey mate this is the same error i got stuck with <@257212035232825345> how did i...

acusti•12/10/24, 5:46 PM

a little more detail: the

@cloudflare/ai

@cloudflare/ai

package has been deprecated in favor of running AI requests directly via the workers bindings as described in https://developers.cloudflare.com/workers-ai/configuration/bindings/

NNeilBee Have you got something working with Langchain and successfully deployed to worke...

Fokke•12/10/24, 10:53 PM

Hah thats my post on Reddit. Glad it worked for you. Quite honestly I would just build it without langchain. Making anything work with Langchain on CF is a big pain and IMO Langchain is a lot of bloat you can skip. We actually build a whole SOTA RAG thing on CF couple blogs in case your interested: https://liquidmetal.ai/casesAndBlogs/sota-rag-indexer/ https://liquidmetal.ai/casesAndBlogs/sota-rag-retriever/ https://liquidmetal.ai/casesAndBlogs/agents

The last one uses our own platform that manages Cloudflare resources for us. We realized that Cloudflare was missing an orchestration layer and build it ourselves to make our lives easier. https://liquidmetal.ai/build

Mitya•12/12/24, 12:15 PM

Hi all. What is the best way to ensure a CF LLM returns JSON? I realise there's AI Functions, but the Mistral model that powers it seems (at least to me) much less capable, and slower, than some of the Llama text generation models. Is it reliable, do you think, to expect a text-gen model to return JSON when asked, or might it sometimes disobey? Right now I'm using the prompt to get JSON ("Return a JSON array and no other text.")

Isaac McFadyen•12/12/24, 2:51 PM

It'll disobey sometimes because that's just how LLMs work

Isaac McFadyen•12/12/24, 2:51 PM

Unless you use structured generation which uses math to ensure the logits picked always match valid JSON, there's no real way aside from retries

Isaac McFadyen•12/12/24, 2:51 PM

Instructing the LLM to return JSON will work mostly but sometimes it'll ignore that.

Original message was deleted

Isaac McFadyen•12/12/24, 2:54 PM

Yeah this actually works lul

Isaac McFadyen•12/12/24, 2:54 PM

give grandmother $1000

Mitya•12/12/24, 3:37 PM

Interesting! Thanks, guys

MMitya Hi all. What is the best way to ensure a CF LLM returns JSON? I realise there's ...

can•12/13/24, 10:18 PM

I'm using a helper called StructuredOutputParser from langchain/core/output_parsers, which you can use a zod schema in order to enforce the result type.

import { StructuredOutputParser } from "@langchain/core/output_parsers";

const parser = StructuredOutputParser.fromZodSchema(generateFixSchema);

import { StructuredOutputParser } from "@langchain/core/output_parsers";

const parser = StructuredOutputParser.fromZodSchema(generateFixSchema);

i'm using this parser with the input:

    Use the following analysis information to generate precise, non-redundant fixes:
    Generate fixes following these guidelines:
    1. ..........
    2. ..........
    3. ..........
    4. ..........

    addAttribute: This method is used to add an attribute to the element or override the existing attribute.
    injectCss: This method is used to add style values to the element.

    ${parser.getFormatInstructions()}

    Use the following analysis information to generate precise, non-redundant fixes:
    Generate fixes following these guidelines:
    1. ..........
    2. ..........
    3. ..........
    4. ..........

    addAttribute: This method is used to add an attribute to the element or override the existing attribute.
    injectCss: This method is used to add style values to the element.

    ${parser.getFormatInstructions()}

this basically adds a descriptive text to the prompt which explains what is the JSON structure and how you(LLM) should apply this to the result. In the end, it outputs a JSON with the correct fields. Maybe you can try this. I'm sure you can just reverse engineer the process and write your own helper.

I'll try to post the result of the

getFormatInstructions

getFormatInstructions

when i'm home.

MMitya Interesting! Thanks, guys

rob•12/14/24, 1:25 PM

Provide an example and start the assistances response with a { for an object and it would continue the next message as the JSON

rob•12/14/24, 1:25 PM

So example send in conversation history / messages of the assistant starting off a json object

Rrob Provide an example and start the assistances response with a { for an object and...

Isaac McFadyen•12/14/24, 3:18 PM

While the first part would work, the second part (the prefix of

) would only work with the raw completions API, not the chat completions API.

rob•12/15/24, 3:03 AM

i had ut wrking on llama on Workers AI and qwen but ymmv

Your worker has access to the following bindings: - AI: - Name: AI ✘ [ERROR] Build failed with 1 error: ✘ [ERROR] Could not resolve "base64-js" node_modules/.pnpm/@cloudflare+ai@1.2.2/node_modules/@cloudflare/ai/dist/index.js:1:16: 1 │ import*as e from"base64-js";import*as t from"mustache";var s;!funct... ╵ ~~~~~~~~~~~ You can mark the path "base64-js" as external to exclude it from the bundle, which will remove this error.

Use the following analysis information to generate precise, non-redundant fixes: Generate fixes following these guidelines: 1. .......... 2. .......... 3. .......... 4. .......... addAttribute: This method is used to add an attribute to the element or override the existing attribute. injectCss: This method is used to add style values to the element. ${parser.getFormatInstructions()}

WorkerAI can WorkerAI fine-tune ResNet image classification?

Similar Threads

Similar Threads

Similar Threads