Wasp•3y ago

Schedule email with sendgrid

According to the api of sendgrid you can schedule emails via the

send_at

send_at

header: https://docs.sendgrid.com/for-developers/sending-email/building-an-x-smtpapi-header#scheduling-your-send
But this sadly does not seem to be possible using the wasp's

emailSender

emailSender

api: https://wasp-lang.dev/docs/advanced/email#javascript-api. Is there a nice and clean workaround or is it planned to add more headers to the

emailSender

emailSender

api?

heyooo•12/1/23, 8:26 AM

looks likethe docs you mention explain that you should place:
x-smtpapi: {"send_at":"[when you want to send the mail]"}
before the "from:" line in that email

like this:
import { emailSender } from "@wasp/email/index.js";

// In some action handler...
const info = await emailSender.send({
x-smtpapi: {"send_at":"[when you want to send the mail]"}
from: {
name: "John Doe",
email: "john@doe.com",
},
to: "user@domain.com",
subject: "Saying hello",
text: "Hello world",
html: "Hello <strong>world</strong>",
});

GwaggliOP•12/1/23, 1:15 PM

the

emailSender

emailSender

seems to ignore properties not mentioned in their API. Also the typescript implementation does not accept any other properties (although i tried to ignore this by defining it as

any

any

heyooo•12/3/23, 12:54 AM

You’ll probably want to do it the easy way and just replace that function with the twilio node package. https://docs.sendgrid.com/for-developers/sending-email/quickstart-nodejs

Email API Quickstart for Node.js to Send Email

Sending your first email using the SendGrid REST API and Node.js.

GGwaggli According to the api of sendgrid you can schedule emails via the `send_at` heade...

Vinny•12/4/23, 10:15 AM

hmm you could always create a queue via Wasp Jobs and use the

delay()

delay()

method: https://wasp-lang.dev/docs/advanced/jobs

you can pass the number of seconds, Date, or ISO date string

Vinny•12/4/23, 10:21 AM

your email sending logic would be a function you reference in your wasp file, then you'd import the job and pass the arguments to it with the delay you want:

martinsos•12/5/23, 10:20 AM

@Gwaggli it would be nice if we had support for these extra fields, you are right, thanks for this feedback! We already have an issue for this: https://github.com/wasp-lang/wasp/issues/1553 -> I added your comment there also now.
We will be looking into this at some point, it is not currently at the top list of our priorities, but once we are going to be working again on email sender, then we will see how to work this in.

GwaggliOP•12/8/23, 7:45 PM

Thank you both! i will try the delay approach in the meantime

GwaggliOP•12/9/23, 1:35 PM

I tried to use scheduled Jobs to get the job done but now I have another issue: When I first start the app after restarting my Mac the app starts normally (after starting the db) but once I restart the app (

wasp start

wasp start

) again, it fails saying: even tho my database is running on that port.
Any idea why this might occur?
And one additional question. When I have

console.log

console.log

statements inside the job (hosted on ) should I see those logs in the monitoring as well or is this written somewhere else?

GGwaggli I tried to use scheduled Jobs to get the job done but now I have another issue: ...

Vinny•12/10/23, 1:11 PM

Hmm I think maybe @miho knows something about this

Vinny•12/10/23, 1:11 PM

Are you sure your db is running?

Vinny•12/10/23, 1:11 PM

And yes you’ll see the logs in monitoring on fly

GwaggliOP•12/10/23, 5:39 PM

Yes as the app starts the first time after booting up the pc and only after changing the source code and thus recompiling i get this error message.

martinsos•12/13/23, 3:20 PM

Logs should be written in the same machine, as Jobs are running on that same machine.

martinsos•12/13/23, 3:45 PM

pg-boss connection refused -> that sounds like a possible issue! Maybe pg-boss doesn't disconnect gracefully in that situation?
Just to clarify some things:

Does this happen when you change stuff in source files and
```
wasp start
```
```
wasp start
```
restarts itself, or when you kill
```
wasp start
```
```
wasp start
```
and then start it again yourself?
How do you fix it once it happens?

GwaggliOP•12/14/23, 7:03 AM

Yes it happens when wasp itself restarts on source file changes. But after that also happens if i manually restart the process.
I was not yet able to fix it other than by restarting my machine. As I am not familiar with pg-boss I did not really know where to start looking.

martinsos•12/15/23, 4:32 PM

Ok thanks @Gwaggli , we will create an issue for this and look it up for sure! I might get back to you in a couple of days with more questions if I don't manage to reproduce it.

GwaggliOP•12/15/23, 5:26 PM

Thank you! Happy to assist

martinsos•12/19/23, 5:04 PM

So I created issue for this here to track it https://github.com/wasp-lang/wasp/issues/1605 . Some additional questions:

What happens if you restart the database? I guess that also fixes the problem?
How are you running the db? On your own or with
```
wasp start db
```
```
wasp start db
```
?

GitHub

Pg-boss connection · Issue #1605 · wasp-lang/wasp

When I first start the app after restarting my Mac the app starts normally (after starting the db) but once I restart the app (wasp start) again, it fails saying: [Server!] pg-boss failed to start!...

GwaggliOP•12/19/23, 6:33 PM

Thank you!
Should i respond here or in the issue itself?

No restarting the DB does sadly not fix the problem.
I normally start the db with
```
wasp db start
```
```
wasp db start
```
but
```
wasp start db
```
```
wasp start db
```
has the same outcome I just realised. I stop the DB by ctrl+c.

martinsos•12/20/23, 12:53 PM

Oh wow restarting the DB doesn't help but restarting Mac does -> ok that is quite weird. That sounds like there is maybe some process remaining running? Hmm pretty weird! But this is important to know, thanks.

You can write here or on issue, both is fine -> I will transfer this info to the issue now.

And yes

wasp start db

wasp start db

and

wasp db start

wasp db start

are aliases, they do the same thing :).

GwaggliOP•12/20/23, 9:43 PM

Yes, I just did it again. Restarting the Mac is the only way for me to get it back to work. Also when I quit the

wasp start

wasp start

command and restart it manually it does result in the same error. Does indeed sound like some weird background process, but then again restarting the Database itself works fine without issue and the pg-boss error is about not being able to connect. :/

GwaggliOP•12/20/23, 9:58 PM

Just tried to reproduce this error with a fresh project but when I did create a new wasp project with and selected it worked fine. In this project I can restart wasp as much as I want and it does compile successully.

GwaggliOP•12/20/23, 10:00 PM

When I then stop the stop the new test db and app and try to start my real app I get the same error.

MEE6•12/20/23, 10:00 PM

Wohooo @Gwaggli, you just became a Waspeteer level 4!

GwaggliOP•12/20/23, 10:16 PM

Neither upgrading the wasp cli nor cleaning the

.wasp

.wasp

output directory helped. I created my App back in April I don't know if that helps. I might try tomorrow to set up a new App, and copy all my code over to the new app directory and see if that helps in any way.
Edit: Just tried to create a new wasp project with and selected

basic

basic

and copied the content of my wasp file and the source code over and run into the same problem.

GwaggliOP•12/21/23, 8:34 AM

If I mess up the pg-boss by restarting my real application I can't run the freshly created app anymore either. Also restarting rancher desktop does not resolve the issue.

martinsos•12/22/23, 1:53 PM

Thanks for all this info -> that sounds like something is certainly being left behind.
Let me try to replicate this on my machine.

martinsos•12/22/23, 2:09 PM

Ok, so I just tried to replicate it with on of our example apps that demonstrate jobs, and I couldn't replicate the problem.

It is a pretty simple app, so what might be great is if you try to run it and see if it works for you.

Locally clone this repo: https://github.com/wasp-lang/wasp .
Then, checkout the branch and go into directory. This is an example app I mentioned.
Do

wasp db start

wasp db start

and leave it running, then in another terminal window do

wasp db migrate-dev

wasp db migrate-dev

and once that is done do

wasp start

wasp start

.
You might need to wait 10 to 20 seconds for it to fetch initial data (via jobs), but once that works, it should show some github repo stats on the screen (like num of gh stars and similar).

Now, I tried killing

wasp start

wasp start

manually and starting it again, I tried modifying main.wasp, I tried modifying code on the client, and also code on the server, and nothing caused any issues. I am interesting how this will go for you. I was using the latest version of Wasp, .

Additional to this, it would be good if you could let me know some extra info about your machine: OS you are running, node version, anything else you think might be significant.

Finally, if you are not able to replicate the error with our example, what remains is you taking your app and stripping out stuff from it until you get to minimal working thing that causes error -> then you can share that with us and we can see if it also happens on our sides, under the same conditions (same OS, node version, ...).

GwaggliOP•12/25/23, 1:25 PM

Hi Martinsos,
Thank you again for the effort! Really much appreciated

I tried it the way you described it. Again first run worked perfectly fine and it showed the stats. But after restarting the same error occurred but with a more comprehensive error trace. I piped it into a file and uploaded it here: https://filetransfer.io/data-package/Y2ncLq3a#link

I am working on a Macbook Pro with an M2 Max chip, 64 GB memory, and Sonoma 14.2.1
Using node 18.2.0 as suggested by wasp with npm version 8.19.2 and Posgtresql@14 via homebrew. (just also tried postgres@16 now and ran into the same issue)

I hope this helps.

Edit: As soon as I remove the jobs declaration from the wasp file, it recompiles and starts working again.

FileTransfer.io

Download Data package from December 25th.

Size of the data package: 104.1 kB. Free transfer of up to 6 GB of photos, videos and documents. Send large files via email or a link to share. No registration, no ads, just simple file sharing!

martinsos•12/28/23, 5:48 PM

Thanks, this helps a lot!
For the record, log is quite longer, but it doesn't seem to say anything new, it seems it is the same error -> pg-boss can't connect to the database.
So yeah, it seems like it can connect to the database, it is just pg-boss that is causing issues?
All that info about node and postgres version helps quite a bit, thanks for that.
I just tried replicating it again, and I also tried varying postgres version from 14 to 16, but no luck, doesn't seem to be the cause.
We also have one other user seemingly having the same issue as you, so there is certainly something to it, we just need to figure out how to replicate it on our side.
I am on Linux, and both you and that other user are Mac with Mx chips, so we will have a team member with Mac try to replicate it tomorrow and let's see where that gets us.

In the meantime, one thing that might be useful is log from your

wasp db start

wasp db start

command -> what it logs when it starts, but also any logs that might appear on failed connection by pg-boss.

miho•12/29/23, 9:52 AM

Hey @Gwaggli could you please try running the following minimal example app I put together?

It has two things:

it tries to run some PgBoss job
it tries just to connect to a Postgres DB

If you could please download and unzip it. Then

npm install

npm install

then check out the for a command to run the database with .

After that please run the two tests by running:

first
then

Please report back when you have time

archive_name.zip5.43KB

GwaggliOP•1/1/24, 2:00 PM

Hey @miho
Thanks a lot! I just did as you described but weirdly enough i get the mentioned error from the very first start already.
The output from the db start command is attached as a file bc its too long:
https://filetransfer.io/data-package/DGfy2QsL#link
Weird is the second last line?

Log from the

npm run start

npm run start

command:

FileTransfer.io

Download Data package from January 1st.

Size of the data package: 3.29 kB. Free transfer of up to 6 GB of photos, videos and documents. Send large files via email or a link to share. No registration, no ads, just simple file sharing!

GwaggliOP•1/1/24, 3:34 PM

Also i found this thread on github: https://github.com/brianc/node-postgres/issues/2895

GitHub

Node.js LTS v18.12.0 breaks · Issue #2895 · brianc/node-postgres

Hello, I seem to have connection issues when I tried the latest Node.js LTS. I downgraded back to v16.18.0 and everything started working again. Is there anything I can provide to assist?

martinsos•1/2/24, 2:43 PM

Logs from

wasp db start

wasp db start

are looking fine -> that "shutdown" part is a bit weird to see, but if I remember correctly, we normally have that in the output, so that is probably just fine.

I will leave the rest to @miho !

miho•1/2/24, 3:33 PM

@Gwaggli have you tried running the second command ?

Could you also share the output of that, thank you!

GwaggliOP•1/3/24, 3:24 PM

@miho Like this?

GwaggliOP•1/3/24, 3:48 PM

Just noticed, that the error message looks the same as when I do not start the db at all for both runs.

GwaggliOP•1/3/24, 3:56 PM

This is the DB Log. I kind of think it could have something to do with the ipV6 issue I linked above. As it always states Is there a way, we can tell pg-boss to use ipV4 connection to try it?

martinsos•1/4/24, 9:01 AM

Yeah, it is as if it can't connect to the database. WHat is weird though, is that all works if you turn of pg-boss, right?

ipV4 vs V6 -> interesting idea, but I see from db logs that is listening to both V4 and V6 hm.

I will let @miho lead the main course of inquiry, but as a side question: do you have any other Postgres processes running? Maybe the Postgres server started on startup?

miho•1/4/24, 10:16 AM

WHat is weird though, is that all works if you turn of pg-boss, right?

The second test disproves that, since the second test is just connecting with

pg

pg

to the database.

@Gwaggli one thing to note in the DB output it says:

listening on IPv4 address "0.0.0.0" port 5432

and

listening on IPv6 address "::" port 5432

which would mean that Postgres is listening on both IPv6 and IPv4

Maybe try changing the

localhost

localhost

127.0.0.1

127.0.0.1

in the test app I sent you? That's one of the things we can also try doing, that forces the app to use IPv4 connection to the DB

martinsos•1/4/24, 10:35 AM

@Gwaggli I asked if you have a native Postgres running on your machine because I know on Mac if you have native Postgres running and then also run Postgres via Docker (like

wasp start db

wasp start db

does) then you get into some weird situation where that port 5432 gets taken by native postgres and it looks like

wasp start db

wasp start db

is also using that port, but is not, it is really just some kind of virtual port or what is it.
So I am interested really if something else took over that port and therefore our

wasp start db

wasp start db

doesn't really get to listen to it, although it thinks it does.

Besides that, another thing that might be interesting checking is what is running on port 5432. Quick googling tells me might do the job? Not sure though, maybe there is a better way. You could try checking what is running on port 5432 without

wasp start db

wasp start db

running, and then also with it running.

GwaggliOP•1/4/24, 12:20 PM

@miho I replaced the

localhost

localhost

with

127.0.0.1

127.0.0.1

and both runs seemed to work in your test setup.
@martinsos I also uninstalled postgres with brew and tried again, this did however make no difference. Still the same error.
Is there a way i can set the local db connection string to

127.0.0.1

127.0.0.1

instead of localhost?

GwaggliOP•1/4/24, 12:25 PM

Alright, got it!
When i set the

DATABASE_URL

DATABASE_URL

env variable, i can not start the db. But when i only set it after starting the db but before starting the app it works and the app builds successfully! Is there a way we can change

localhost

localhost

127.0.0.1

127.0.0.1

without this workaround?
Thanks a lot for the patience and help! Very much appreciated!

miho•1/4/24, 1:32 PM

This definitely indicates a problem with IPv6 vs. IPv4 connectivity issues hmmm. I think it should just work with

localhost

localhost

with the usual setup. We'll try to figure it out and maybe ping you with some additional tests if you are okay helping us with that?

One thing you can do now for your local development is to run the database with a

docker run

docker run

command instead of using our

wasp start db

wasp start db

command. Then, you are free to set your

DATABASE_URL

DATABASE_URL

to the one you need with

127.0.0.1

127.0.0.1

and you can develop you like, it's not a big deal until we figure out the real issue with the IPv6 addresses

miho•1/4/24, 1:33 PM

An example

docker run

docker run

command you can use:

GwaggliOP•1/4/24, 3:06 PM

Thanks a lot! I will be definitely available to further help you. And thanks for the docker command, I might try this in the meantime

martinsos•1/8/24, 12:59 PM

I wonder why this error started happening recently, and why was it manifesting with pg-boss and not normal db connection?
@miho what do you think, should we change the local db connection string from

localhost

localhost

127.0.0.1

127.0.0.1

?
What should we do in the future to avoi dthis problem happening for other people?

miho•1/8/24, 1:41 PM

@martinsos the second test indicates that the same error happens for normal db connection

As for the question, I'm not sure. Changing the connection string from

localhost

localhost

127.0.0.1

127.0.0.1

makes us less future-proof since

localhost

localhost

resolves to what ever it needs to e.g.

127.0.0.1

127.0.0.1

or maybe some other setup in the

/etc/hosts

/etc/hosts

. We should further investigate this and see if Node.js on MacOS doesn't work properly and what is the recommdeded Node.js fix. If possible I'd avoid modifying Wasp to accommodate Node.js's quirks that can be worked around (possibly, but I can't know for sure).

martinsos•1/8/24, 1:59 PM

Oh ok makes sense, wasn't aware of this!
@miho can you create a GH issue for this please?

miho•1/8/24, 2:03 PM

Here's an issue where we can track it: https://github.com/wasp-lang/wasp/issues/1621

GitHub

Connection to the database via IPv6 fails · Issue #1621 · wasp-lang...

Some users reported failures with pg-boss's connection to the database. On a closer look, it seems that it's a general database connection issue due to using IPv6 to connect. Check this out...