Can whisper return the duration of the input audio?

Winston•4/22/24, 7:51 AM

any know how to pass the negative prompt for stable difussion ai worker? the doc looks like doesn't support negative prompt?

QQuill Can whisper return the duration of the input audio?

Isaac McFadyen•4/22/24, 12:33 PM

It should be fairly easy to compute yourself?

Isaac McFadyen•4/22/24, 12:33 PM

Number of samples / sample rate.

Isaac McFadyen•4/22/24, 12:33 PM

Ex. 961234 samples at 16000 hz is 60.077125 secs

Isaac McFadyen•4/22/24, 12:34 PM

Whisper definitely can return timestamps but I don't think it returns the total duration

rob•4/22/24, 12:39 PM

Ya just do the calc right

IIsaac McFadyen Whisper definitely can return timestamps but I don't think it returns the total ...

QuillOP•4/22/24, 12:53 PM

Other providers like Azure STT returned the duration. So It would be better for Whisper to return the calculated duration

QQuill Other providers like Azure STT returned the duration. So It would be better for ...

Isaac McFadyen•4/22/24, 12:55 PM

The whisper model itself doesn't return the duration. I suppose it's possible that Workers AI could calculate and return the duration outside of the model, but they'd be doing nothing different than what you would be doing by doing

num samples / sample rate

num samples / sample rate

IIsaac McFadyen The whisper model itself doesn't return the duration. I suppose it's possible th...

QuillOP•4/22/24, 1:02 PM

Thanks for this solution. Btw should I need some library to get audio samples num?

Chaika•4/22/24, 1:13 PM

the catalog show two different llama-3-8b-instruct authors, but meta-llama doesn't work,

Error: No such model @hf/meta-llama/llama-3-8b-instruct or task

Error: No such model @hf/meta-llama/llama-3-8b-instruct or task

LLogan Grasby @Quill This will return: `{ "text": "Hello, how are you doing today?", "...

QuillOP•4/22/24, 1:18 PM

I tried @cf/openai/whisper. the returned vtt seems very inaccurate, here is the example input https://github.com/Azure-Samples/cognitive-services-speech-sdk/raw/master/samples/cpp/windows/console/samples/enrollment_audio_katie.wav

LLogan Grasby Try @cf/openai/whisper-tiny-en . Maybe large shows up tomorrow too...

QuillOP•4/22/24, 4:08 PM

@cf/openai/whisper-tiny-en is worse than @cf/openai/whisper. When will large-v3 show up? Thanks

Bilal Mbarki•4/22/24, 11:06 PM

can you do facial rekon on workers-ai

Cameron Aaron•4/23/24, 2:43 AM

any idea if/when cloudflare will get the Meta Llama 3 70b Instruct

Cameron Aaron•4/23/24, 2:43 AM

I think it might be one of the few models with a knowlege cut off that will work for my app

Cameron Aaron•4/23/24, 2:43 AM

and I think it will be cheaper than gpt 4 turbo

Cameron Aaron•4/23/24, 2:44 AM

I cant really undertstand the pricing because its very non standard

CCameron Aaron I think it might be one of the few models with a knowlege cut off that will work...

Andy zhou•4/23/24, 4:34 AM

it seems cf only deployed small model

AAndy zhou it seems cf only deployed small model

ddts86•4/23/24, 11:24 AM

yes, I would like bigger models.

rzvdrl•4/23/24, 6:11 PM

Is there a way to use a custom model?

Rrzvdrl Is there a way to use a custom model?

Isaac McFadyen•4/23/24, 6:16 PM

?workers-ai-models

Flare•4/23/24, 6:16 PM

Workers AI currently only supports popular open-source models provided by the Cloudflare team. You cannot currently upload your own models or use a model from HuggingFace. See the documentation for the list of Cloudflare-provided models: https://developers.cloudflare.com/workers-ai/models/

Isaac McFadyen•4/23/24, 6:16 PM

I should probably update that because LoRAs are now possible, just not custom models.

rzvdrl•4/23/24, 7:02 PM

It would be awesome if I could import any hf model

Cameron Aaron•4/24/24, 12:20 AM

I run https://slangtranslator.com/ and rn we use GPT 4 turbo do you know a model that might work better that I can use on AI worker like a LORA? Right now i'm using the AI gateway but I think that AI worker might be cheaper than GPT 4 turbo but I cant tell

Slang Translator - Translate Slang to English

Translate slang into standard English. Understand the meaning and context of popular slang terms.

LLogan Grasby Try @cf/openai/whisper-tiny-en . Maybe large shows up tomorrow too...

QuillOP•4/24/24, 3:00 AM

How about the process? Thanks

CCameron Aaron I run https://slangtranslator.com/ and rn we use GPT 4 turbo do you know a model...

chand1012•4/24/24, 5:40 PM

Llama 3 8B is smarter than some of the early iterations of GPT-4

rob•4/24/24, 5:47 PM

yah and that without any tuning

thipperz•4/24/24, 5:47 PM

Hi there,

Is it currently possible to generarate Google Vertex AI multimodal embeddings using Workers AI or proxying through it?

https://cloud.google.com/vertex-ai/generative-ai/docs/model-reference/multimodal-embeddings

Google Cloud

Multimodal embeddings | Generative AI on Vertex AI | Google Clo...

Tthipperz Hi there, Is it currently possible to generarate Google Vertex AI multimodal em...

scotto•4/24/24, 6:31 PM

similar question but for images, i know we have resnet but in the docs is used for classification and not embedding generation

Mmichelle anyone using function calling e.g., with openai or others? would love to ask som...

scotto•4/25/24, 2:14 PM

i'm am using with openai

Mmichelle anyone using function calling e.g., with openai or others? would love to ask som...

cosbgn•4/25/24, 4:35 PM

Yeah with openai quite extensively (unfetch.com)

cosbgn•4/25/24, 4:36 PM

Would love to be able to switch to other models, especially on CF if function calling would be supported

Hello, I’m Allie!•4/26/24, 11:06 AM

Hey @michelle, remember talking about TTS Model support at one point(though it has been a little while). If you are still looking for one, I've been having pretty good results with

sherpa-onnx

sherpa-onnx

, though not entirely sure how that fits in with how #workers-ai works on the backend

cj•4/26/24, 1:27 PM

Is uform-gen2-qwen-500m multilingual? Can I use

prompt

prompt

to get response in a specific language?

Cloudflare Docs

uform-gen2-qwen-500m · Cloudflare Workers AI docs

Run AI models in Workers, Pages, or via API.

cj•4/26/24, 1:29 PM

Also, as it is in

beta

beta

it is free for now. Any idea how much it would cost once out of beta?

Alex•4/26/24, 5:35 PM

Is there some kind of moderation api to check the user input like openai has? I don't want my account banned because users are inputting naughty stuff

Mmichelle you can try llamaguard https://developers.cloudflare.com/workers-ai/models/llama...

Alex•4/26/24, 6:38 PM

thanks i will look into it

hob8yte•4/27/24, 3:03 AM

I'm evaluating using Workers AI instead of OpenAI for turning text into JSON, but am nearly always passing too much text in and getting this error. Is there a way to get around this? Do I need to pass in multiple prompts?

InferenceUpstreamError: must have required property 'prompt', must NOT have more than 6144 characters, must match exactly one schema in oneOf

InferenceUpstreamError: must have required property 'prompt', must NOT have more than 6144 characters, must match exactly one schema in oneOf

ddts86•4/27/24, 9:11 AM

what does this error mean: InferenceUpstreamError: {"success":false,"errors":[{"code":10000,"message":"Authentication error"}]}

ddts86•4/27/24, 9:30 AM

I use the local storage for kv namespace and I run npx wrangler dev. When I call local api for the model, I got this error.

tutankhamen•4/27/24, 12:19 PM

How much would llama-3-8b-instruct cost if you charged for it?

I must say this "neuron" idea of yours is terrible and poorly documented. It's as if even you don't understand it yourself. You keep talking about neurons, yet all the calculation and examples are in 1M input/output tokens. It's impossible to make any sense of how many neurons a model uses.

GenshinMinecraft•4/27/24, 2:51 PM

i want to ask a question
now all the aimodel is beta
so i can use them for free and unlimit？

Ggotfredsen call my crazy but would that not be a smart ide to use Apples OpenELM https://hu...

user•4/28/24, 4:14 AM

boost :lul:

Can whisper return the duration of the input audio?

Similar Threads

Similar Threads

Similar Threads