WAF Custom Rules

I have a wordpress site hosted on AWS with Cloudflare in front of it. I set up a custom rule to skip any checks from one of the API's that loads data into the site. It worked fine for about 30 minutes and then it quit working and now its giving managed challenge again.

Any ideas what would cause it to quit working?