Cloudflare Developers•2y ago

otherwise just open devtools & look at the scripts request

kianOP•1/12/24, 10:11 PM

Ranjan Mangla•1/13/24, 6:04 AM

I have links to files on my ftp server, I can't ssh into server

Ranjan Mangla•1/13/24, 6:04 AM

Is there any way I can download those files in workers

Ranjan Mangla•1/13/24, 6:05 AM

If I only pass the link as a post request and it then downloads it and then transfer to R2

Ranjan Mangla•1/13/24, 6:05 AM

Fetch is not working

Ranjan Mangla•1/13/24, 6:05 AM

In this regard

Arma•1/13/24, 7:21 AM

Fetch only does HTTP so you can’t do FTP with that

Arma•1/13/24, 7:22 AM

Maybe there is a serverless package that lets you do ftp ?

Arma•1/13/24, 7:27 AM

There is a TCP api for workers so it’s definitely possible https://developers.cloudflare.com/workers/runtime-apis/tcp-sockets

TCP sockets · Cloudflare Workers docs

Use the connect()connect() API to create outbound TCP connections from Workers.

Arma•1/13/24, 7:36 AM

Btw if you download each file to memory on the worker, it will only work for files up to 128 MB

Arma•1/13/24, 7:37 AM

Since your use case is a one time operation, I would simply download the FTP contents on my machine and upload them with the wrangler cli

Ranjan Mangla•1/13/24, 7:43 AM

Actually it's not, we are migrating data from our ftp server to R2

RRanjan Mangla Actually it's not, we are migrating data from our ftp server to R2

Hello, I’m Allie!•1/13/24, 8:03 AM

You can use rclone to move from FTP to R2 too

Hello, I’m Allie!•1/13/24, 8:03 AM

You can’t run it on a Worker, but it can be a tad faster

Hello, I’m Allie!•1/13/24, 8:03 AM

And less complex

Arma•1/13/24, 8:04 AM

My thinking is, you can either
- implement FTP minimally over the workers TCP api and use that to connect to your existing file server, then stream the response to R2
- use your existing file server’s HTTP api (if it has any) via fetch then put the response on R2

Ranjan Mangla•1/13/24, 8:06 AM

Thanks @HardlyHolidayin’ & @Arma

Ranjan Mangla•1/13/24, 8:06 AM

Will explore rclone one

Ranjan Mangla•1/13/24, 8:07 AM

@Arma can you shed more light on the TCP method, didn't understand properly

Arma•1/13/24, 8:16 AM

Most unsecured protocols like FTP, SMTP and HTTP run over TCP. There isn’t a standard api to use TCP with JavaScript because the browsers don’t allow it. But Workers do allow it so Cloudflare added a non standard api to use TCP directly. See the link above.

If you care enough to run your workload on Workers, this is a complicated but possible way to do it. You would look at the FTP spec online, and implement the minimum that you need, using the TCP stuff that Workers let you do. If you’re not comfortable with this endeavour there may be more sensible ways to solve your problem though

Arma•1/13/24, 8:17 AM

But this is the Workers channel so I’ll provide you with the Workers solution ahah

alen•1/13/24, 8:52 AM

how do i use download from R2 in my website?

alen•1/13/24, 8:53 AM

what link do i need to use?

Gunnar•1/13/24, 9:14 AM

Hi,
"Keep in mind that Workers have a memory limit of 128MB per Worker and loading particularly large files into a Worker’s memory multiple times may reach this limit. To ensure memory usage does not reach this limit, consider using Streams."
https://developers.cloudflare.com/r2/api/workers/workers-api-usage/

If I have private videos for users (think udemy f.ex.), are CF Streams my only option because of this Worker 128mb memory limit?

Use R2 from Workers · Cloudflare R2 docs

C3 (create-cloudflare-cli) is a command-line tool designed to help you set up and deploy Workers & Pages applications to Cloudflare as fast as …

Original message was deleted

alen•1/13/24, 9:16 AM

i already set up a custom domain in the R2

alen•1/13/24, 9:16 AM

i search it in the bucket it is okay

alen•1/13/24, 9:17 AM

but if i want to create a button in my website , when my client want to download the file they just click the button

alen•1/13/24, 9:17 AM

and this can't work

alen•1/13/24, 9:18 AM

it can work in pc,if i just set up a code to open the directly link of the file it will work in pc, but in iOS can't work

alen•1/13/24, 9:18 AM

in IOS it just open the file

alen•1/13/24, 9:18 AM

no download

Arma•1/13/24, 9:18 AM

~~You have to use multipart~~ I’m misremembering, it’s the related Content-Disposition header that controls the save as dialog

alen•1/13/24, 9:19 AM

multipart?

Arma•1/13/24, 9:21 AM

When you have this header in the response, the browsers will offer to « save as » to disk :

Arma•1/13/24, 9:21 AM

Content-Disposition: attachment; filename="filename.jpg"Content-Disposition: attachment; filename="filename.jpg"

Arma•1/13/24, 9:22 AM

MDN Web Docs

Content-Disposition - HTTP | MDN

In a regular HTTP response, the Content-Disposition response header is a header indicating if the content is expected to be displayed inline in the browser, that is, as a Web page or as part of a Web page, or as an attachment, that is downloaded and saved locally.

Arma•1/13/24, 9:31 AM

Another solution is to use the download attribute on your <a> tag

Arma•1/13/24, 9:32 AM

https://developer.mozilla.org/en-US/docs/Web/HTML/Element/a#attributes

MDN Web Docs

: The Anchor element - HTML: HyperText Markup Language | MDN

The HTML element (or anchor element), with its href attribute, creates a hyperlink to web pages, files, email addresses, locations in the same page, or anything else a URL can address.

Original message was deleted

Ɽ

ⱤØ₥₳₦•1/13/24, 3:46 PM

Ma'am if I access public url of bucket object then will that count as read?

zegevlier•1/13/24, 3:46 PM

Yes

Socal•1/13/24, 4:27 PM

is there a way to add npm packages to a cloudflare email worker?

I was originally thinking of using standard workers with parse api from mail jet, but if I'm able to handle it all just using email workers it would be more optimal

SSocal is there a way to add npm packages to a cloudflare email worker? I was origina...

Cyb3r-Jak3•1/13/24, 6:08 PM

For other packages with a worker you have to use wrangler and not quick edit

Kkian what's the code that doesn't work/the error

crossbeau•1/13/24, 6:17 PM

Its an issue with multipart uploads, the form data is getting stripped. So when i do a check to see if “image/png” or “application/pdf” it fails to find that info. (I have an app front R2 and Images) so need to tell the app which location to upload to