I have links to files on my ftp server, I can't ssh into server
I have links to files on my ftp server, I can't ssh into server
RIs there any way I can download those files in workers
RIf I only pass the link as a post request and it then downloads it and then transfer to R2
RFetch is not working
RIn this regard
AFetch only does HTTP so you can’t do FTP with that
AMaybe there is a serverless package that lets you do ftp ?
AThere is a TCP api for workers so it’s definitely possible https://developers.cloudflare.com/workers/runtime-apis/tcp-sockets
Use the
connect() API to create outbound TCP connections from Workers.
ABtw if you download each file to memory on the worker, it will only work for files up to 128 MB
ASince your use case is a one time operation, I would simply download the FTP contents on my machine and upload them with the wrangler cli
RActually it's not, we are migrating data from our ftp server to R2
HYou can use rclone to move from FTP to R2 too
HYou can’t run it on a Worker, but it can be a tad faster
HAnd less complex
AMy thinking is, you can either
- implement FTP minimally over the workers TCP api and use that to connect to your existing file server, then stream the response to R2
- use your existing file server’s HTTP api (if it has any) via fetch then put the response on R2
RThanks @HardlyHolidayin’ & @Arma
RWill explore rclone one
R@Arma can you shed more light on the TCP method, didn't understand properly
AMost unsecured protocols like FTP, SMTP and HTTP run over TCP. There isn’t a standard api to use TCP with JavaScript because the browsers don’t allow it. But Workers do allow it so Cloudflare added a non standard api to use TCP directly. See the link above.
If you care enough to run your workload on Workers, this is a complicated but possible way to do it. You would look at the FTP spec online, and implement the minimum that you need, using the TCP stuff that Workers let you do. If you’re not comfortable with this endeavour there may be more sensible ways to solve your problem though
If you care enough to run your workload on Workers, this is a complicated but possible way to do it. You would look at the FTP spec online, and implement the minimum that you need, using the TCP stuff that Workers let you do. If you’re not comfortable with this endeavour there may be more sensible ways to solve your problem though
ABut this is the Workers channel so I’ll provide you with the Workers solution ahah
Ahow do i use download from R2 in my website?
Awhat link do i need to use?
GHi,
"Keep in mind that Workers have a memory limit of 128MB per Worker and loading particularly large files into a Worker’s memory multiple times may reach this limit. To ensure memory usage does not reach this limit, consider using Streams."
https://developers.cloudflare.com/r2/api/workers/workers-api-usage/
If I have private videos for users (think udemy f.ex.), are CF Streams my only option because of this Worker 128mb memory limit?
"Keep in mind that Workers have a memory limit of 128MB per Worker and loading particularly large files into a Worker’s memory multiple times may reach this limit. To ensure memory usage does not reach this limit, consider using Streams."
https://developers.cloudflare.com/r2/api/workers/workers-api-usage/
If I have private videos for users (think udemy f.ex.), are CF Streams my only option because of this Worker 128mb memory limit?
C3 (create-cloudflare-cli) is a command-line tool designed to help you set up and deploy Workers & Pages applications to Cloudflare as fast as …
Ai already set up a custom domain in the R2
Ai search it in the bucket it is okay
Abut if i want to create a button in my website , when my client want to download the file they just click the button
Aand this can't work
Ait can work in pc,if i just set up a code to open the directly link of the file it will work in pc, but in iOS can't work
Ain IOS it just open the file
Ano download
AAmultipart?
AWhen you have this header in the response, the browsers will offer to « save as » to disk :
AContent-Disposition: attachment; filename="filename.jpg"AMDN Web Docs
In a regular HTTP response, the Content-Disposition response header is a header indicating if the content is expected to be displayed inline in the browser, that is, as a Web page or as part of a Web page, or as an attachment, that is downloaded and saved locally.
AAnother solution is to use the download attribute on your <a> tag
AMDN Web Docs
The HTML element (or anchor element), with its href attribute, creates a hyperlink to web pages, files, email addresses, locations in the same page, or anything else a URL can address.
ⱤMa'am if I access public url of bucket object then will that count as read?
ZYes
Sis there a way to add npm packages to a cloudflare email worker?
I was originally thinking of using standard workers with parse api from mail jet, but if I'm able to handle it all just using email workers it would be more optimal
I was originally thinking of using standard workers with parse api from mail jet, but if I'm able to handle it all just using email workers it would be more optimal
CFor other packages with a worker you have to use wrangler and not quick edit
CIts an issue with multipart uploads, the form data is getting stripped. So when i do a check to see if “image/png” or “application/pdf” it fails to find that info. (I have an app front R2 and Images) so need to tell the app which location to upload to
PShould I use durable object when I need websocket connection which should be maintain over 30 seconds?
MHi
MYou have been too blocked my Goole problem
Xhi tell me what’s the plan?
CPlan for what?
Xplan for our work?
CWhat work?
CYou don’t know?
Xnothing boss
